[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:00:33.461642  7088 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.236.62:39463
I20260709 13:00:33.463186  7088 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:00:33.464205  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:33.480923  7095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:33.480968  7097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:33.482393  7088 server_base.cc:1061] running on GCE node
W20260709 13:00:33.481547  7094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:34.592614  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:34.592869  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:34.593052  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602034593034 us; error 0 us; skew 500 ppm
I20260709 13:00:34.593853  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:34.598948  7088 webserver.cc:533] Webserver started at http://127.6.236.62:39413/ using document root <none> and password file <none>
I20260709 13:00:34.599773  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:34.599987  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:34.600419  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:34.606195  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/master-0-root/instance:
uuid: "9ceb25848caf43df80f7382829ac79b4"
format_stamp: "Formatted at 2026-07-09 13:00:34 on dist-test-slave-j4mc"
I20260709 13:00:34.613986  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:00:34.619311  7103 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:34.620458  7088 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:34.620810  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/master-0-root
uuid: "9ceb25848caf43df80f7382829ac79b4"
format_stamp: "Formatted at 2026-07-09 13:00:34 on dist-test-slave-j4mc"
I20260709 13:00:34.621138  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:34.686966  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:34.688478  7088 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:00:34.688910  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:34.757834  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.62:39463
I20260709 13:00:34.757866  7154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.62:39463 every 8 connection(s)
I20260709 13:00:34.765769  7155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:34.787220  7155 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4: Bootstrap starting.
I20260709 13:00:34.793076  7155 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:34.794976  7155 log.cc:826] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4: Log is configured to *not* fsync() on all Append() calls
I20260709 13:00:34.799693  7155 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4: No bootstrap required, opened a new log
I20260709 13:00:34.820597  7155 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ceb25848caf43df80f7382829ac79b4" member_type: VOTER }
I20260709 13:00:34.821197  7155 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:34.821466  7155 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ceb25848caf43df80f7382829ac79b4, State: Initialized, Role: FOLLOWER
I20260709 13:00:34.822476  7155 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ceb25848caf43df80f7382829ac79b4" member_type: VOTER }
I20260709 13:00:34.822984  7155 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:34.823271  7155 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:34.823594  7155 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:34.827721  7155 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ceb25848caf43df80f7382829ac79b4" member_type: VOTER }
I20260709 13:00:34.828541  7155 leader_election.cc:304] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ceb25848caf43df80f7382829ac79b4; no voters: 
I20260709 13:00:34.830370  7155 leader_election.cc:290] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:34.830681  7158 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:34.833158  7158 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 1 LEADER]: Becoming Leader. State: Replica: 9ceb25848caf43df80f7382829ac79b4, State: Running, Role: LEADER
I20260709 13:00:34.834035  7158 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ceb25848caf43df80f7382829ac79b4" member_type: VOTER }
I20260709 13:00:34.835119  7155 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:34.843573  7159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ceb25848caf43df80f7382829ac79b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ceb25848caf43df80f7382829ac79b4" member_type: VOTER } }
I20260709 13:00:34.844269  7159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:34.844060  7160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ceb25848caf43df80f7382829ac79b4. Latest consensus state: current_term: 1 leader_uuid: "9ceb25848caf43df80f7382829ac79b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ceb25848caf43df80f7382829ac79b4" member_type: VOTER } }
I20260709 13:00:34.844620  7160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:34.847416  7165 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:34.859642  7165 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:34.863274  7088 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:34.877733  7165 catalog_manager.cc:1383] Generated new cluster ID: 448674b49aa1426b9cc98464ca18a410
I20260709 13:00:34.878244  7165 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:34.899783  7165 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:34.901482  7165 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:34.916257  7165 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4: Generated new TSK 0
I20260709 13:00:34.917244  7165 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:34.930745  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:34.940095  7177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:34.941184  7178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:34.944842  7180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:34.944908  7088 server_base.cc:1061] running on GCE node
I20260709 13:00:34.945935  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:34.946239  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:34.946450  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602034946431 us; error 0 us; skew 500 ppm
I20260709 13:00:34.947240  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:34.951237  7088 webserver.cc:533] Webserver started at http://127.6.236.1:38857/ using document root <none> and password file <none>
I20260709 13:00:34.951943  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:34.952188  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:34.952530  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:34.954046  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-0-root/instance:
uuid: "926587bb15f743eeac9e5fc8e12427f0"
format_stamp: "Formatted at 2026-07-09 13:00:34 on dist-test-slave-j4mc"
I20260709 13:00:34.961199  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:00:34.966430  7185 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:34.967324  7088 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:00:34.967695  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "926587bb15f743eeac9e5fc8e12427f0"
format_stamp: "Formatted at 2026-07-09 13:00:34 on dist-test-slave-j4mc"
I20260709 13:00:34.968087  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:35.002313  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:35.004081  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:35.006794  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:35.012401  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:35.012729  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:35.013043  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:35.013260  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:35.100075  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:43053
I20260709 13:00:35.100119  7247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:43053 every 8 connection(s)
I20260709 13:00:35.107805  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:35.119237  7252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:35.121400  7253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:35.132028  7255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:35.132207  7088 server_base.cc:1061] running on GCE node
I20260709 13:00:35.133143  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:35.133345  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:35.133512  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602035133493 us; error 0 us; skew 500 ppm
I20260709 13:00:35.134109  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:35.137276  7088 webserver.cc:533] Webserver started at http://127.6.236.2:44779/ using document root <none> and password file <none>
I20260709 13:00:35.137934  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:35.138168  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:35.138507  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:35.139894  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-1-root/instance:
uuid: "5c88e61aaf404e7094f2efd1e010c569"
format_stamp: "Formatted at 2026-07-09 13:00:35 on dist-test-slave-j4mc"
I20260709 13:00:35.142540  7248 heartbeater.cc:344] Connected to a master server at 127.6.236.62:39463
I20260709 13:00:35.143030  7248 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:35.144356  7248 heartbeater.cc:507] Master 127.6.236.62:39463 requested a full tablet report, sending...
I20260709 13:00:35.145826  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:00:35.148583  7120 ts_manager.cc:194] Registered new tserver with Master: 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053)
I20260709 13:00:35.150202  7260 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:35.151482  7088 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:35.151748  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-1-root
uuid: "5c88e61aaf404e7094f2efd1e010c569"
format_stamp: "Formatted at 2026-07-09 13:00:35 on dist-test-slave-j4mc"
I20260709 13:00:35.152016  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:35.152194  7120 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37320
I20260709 13:00:35.192188  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:35.193527  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:35.195936  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:35.198822  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:35.199011  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:35.199261  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:35.199412  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:35.289912  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.2:40963
I20260709 13:00:35.290046  7322 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.2:40963 every 8 connection(s)
I20260709 13:00:35.295861  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:35.303251  7326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:35.309743  7323 heartbeater.cc:344] Connected to a master server at 127.6.236.62:39463
I20260709 13:00:35.310158  7323 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:35.311111  7323 heartbeater.cc:507] Master 127.6.236.62:39463 requested a full tablet report, sending...
W20260709 13:00:35.311266  7327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:35.313508  7120 ts_manager.cc:194] Registered new tserver with Master: 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:35.315202  7120 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37324
W20260709 13:00:35.316177  7329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:35.317126  7088 server_base.cc:1061] running on GCE node
I20260709 13:00:35.318406  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:35.318658  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:35.318864  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602035318847 us; error 0 us; skew 500 ppm
I20260709 13:00:35.319583  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:35.322194  7088 webserver.cc:533] Webserver started at http://127.6.236.3:38641/ using document root <none> and password file <none>
I20260709 13:00:35.322778  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:35.323004  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:35.323310  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:35.324712  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-2-root/instance:
uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
format_stamp: "Formatted at 2026-07-09 13:00:35 on dist-test-slave-j4mc"
I20260709 13:00:35.330260  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:00:35.334173  7334 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:35.334903  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:00:35.335223  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-2-root
uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
format_stamp: "Formatted at 2026-07-09 13:00:35 on dist-test-slave-j4mc"
I20260709 13:00:35.335609  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602033297011-7088-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:35.383379  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:35.384913  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:35.386518  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:35.389249  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:35.389516  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:35.389784  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:35.389986  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:35.470276  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.3:36207
I20260709 13:00:35.470342  7396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.3:36207 every 8 connection(s)
I20260709 13:00:35.486925  7397 heartbeater.cc:344] Connected to a master server at 127.6.236.62:39463
I20260709 13:00:35.487299  7397 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:35.488035  7397 heartbeater.cc:507] Master 127.6.236.62:39463 requested a full tablet report, sending...
I20260709 13:00:35.489951  7120 ts_manager.cc:194] Registered new tserver with Master: 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:35.490687  7088 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014998132s
I20260709 13:00:35.491513  7120 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37326
I20260709 13:00:35.540872  7120 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37332:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:35.544416  7120 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:35.763468  7213 tablet_service.cc:1511] Processing CreateTablet for tablet f47c7ea1bc4742a68285127be1fc87bb (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:35.765128  7213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47c7ea1bc4742a68285127be1fc87bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.767172  7212 tablet_service.cc:1511] Processing CreateTablet for tablet a303edb58b594e0db3e6764d554d73a8 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:35.771961  7212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a303edb58b594e0db3e6764d554d73a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.776540  7285 tablet_service.cc:1511] Processing CreateTablet for tablet ccda16172ee74fce911224858260829a (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:35.778617  7285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccda16172ee74fce911224858260829a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.783301  7283 tablet_service.cc:1511] Processing CreateTablet for tablet b7cb2db3aa0c44358c3f69d74637b359 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:35.787004  7287 tablet_service.cc:1511] Processing CreateTablet for tablet a303edb58b594e0db3e6764d554d73a8 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:35.787282  7282 tablet_service.cc:1511] Processing CreateTablet for tablet c71e0b12377f47aea4a28490469b0ceb (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:35.791893  7283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cb2db3aa0c44358c3f69d74637b359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.791779  7207 tablet_service.cc:1511] Processing CreateTablet for tablet c71e0b12377f47aea4a28490469b0ceb (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:35.793967  7206 tablet_service.cc:1511] Processing CreateTablet for tablet cc9f0ce1685f4c16bbd45e973de27b27 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:35.795502  7207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c71e0b12377f47aea4a28490469b0ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.798393  7206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9f0ce1685f4c16bbd45e973de27b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.803503  7287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a303edb58b594e0db3e6764d554d73a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.799925  7281 tablet_service.cc:1511] Processing CreateTablet for tablet cc9f0ce1685f4c16bbd45e973de27b27 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:35.806500  7288 tablet_service.cc:1511] Processing CreateTablet for tablet f47c7ea1bc4742a68285127be1fc87bb (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:35.808954  7205 tablet_service.cc:1511] Processing CreateTablet for tablet c4602fb7fa82436eb409097dcc26acc1 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:35.814000  7208 tablet_service.cc:1511] Processing CreateTablet for tablet b7cb2db3aa0c44358c3f69d74637b359 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:35.814854  7282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c71e0b12377f47aea4a28490469b0ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.817411  7288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47c7ea1bc4742a68285127be1fc87bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.818593  7281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9f0ce1685f4c16bbd45e973de27b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.817672  7208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cb2db3aa0c44358c3f69d74637b359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.821326  7210 tablet_service.cc:1511] Processing CreateTablet for tablet ccda16172ee74fce911224858260829a (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:35.830156  7284 tablet_service.cc:1511] Processing CreateTablet for tablet 95b3bfd3a58149d3ad6700c6041b37e1 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:35.837361  7209 tablet_service.cc:1511] Processing CreateTablet for tablet 95b3bfd3a58149d3ad6700c6041b37e1 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:35.839251  7205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4602fb7fa82436eb409097dcc26acc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.848217  7284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b3bfd3a58149d3ad6700c6041b37e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.843688  7286 tablet_service.cc:1511] Processing CreateTablet for tablet 666a0cd8b4154f99becedaadc57a3cda (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:35.863381  7209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b3bfd3a58149d3ad6700c6041b37e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:35.869539  7168 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:35.864838  7280 tablet_service.cc:1511] Processing CreateTablet for tablet c4602fb7fa82436eb409097dcc26acc1 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:35.868707  7210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccda16172ee74fce911224858260829a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.879725  7211 tablet_service.cc:1511] Processing CreateTablet for tablet 666a0cd8b4154f99becedaadc57a3cda (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:35.892701  7211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666a0cd8b4154f99becedaadc57a3cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.880352  7286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666a0cd8b4154f99becedaadc57a3cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.900993  7280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4602fb7fa82436eb409097dcc26acc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.906042  7362 tablet_service.cc:1511] Processing CreateTablet for tablet f47c7ea1bc4742a68285127be1fc87bb (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:35.915627  7362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47c7ea1bc4742a68285127be1fc87bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.915274  7361 tablet_service.cc:1511] Processing CreateTablet for tablet a303edb58b594e0db3e6764d554d73a8 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:35.915344  7360 tablet_service.cc:1511] Processing CreateTablet for tablet 666a0cd8b4154f99becedaadc57a3cda (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:35.928303  7359 tablet_service.cc:1511] Processing CreateTablet for tablet ccda16172ee74fce911224858260829a (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:35.935909  7415 tablet_bootstrap.cc:492] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
I20260709 13:00:35.934538  7360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666a0cd8b4154f99becedaadc57a3cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.933250  7358 tablet_service.cc:1511] Processing CreateTablet for tablet 95b3bfd3a58149d3ad6700c6041b37e1 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:35.938800  7357 tablet_service.cc:1511] Processing CreateTablet for tablet b7cb2db3aa0c44358c3f69d74637b359 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:35.990696  7355 tablet_service.cc:1511] Processing CreateTablet for tablet cc9f0ce1685f4c16bbd45e973de27b27 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:35.989459  7361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a303edb58b594e0db3e6764d554d73a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.994290  7356 tablet_service.cc:1511] Processing CreateTablet for tablet c71e0b12377f47aea4a28490469b0ceb (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:36.011822  7359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccda16172ee74fce911224858260829a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:36.013618  7356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c71e0b12377f47aea4a28490469b0ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:36.014753  7416 tablet_bootstrap.cc:492] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.018884  7354 tablet_service.cc:1511] Processing CreateTablet for tablet c4602fb7fa82436eb409097dcc26acc1 (DEFAULT_TABLE table=test-workload [id=6a6835f523c141209db4fbc7a943c346]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:36.026549  7355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9f0ce1685f4c16bbd45e973de27b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:36.038216  7415 tablet_bootstrap.cc:654] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.042707  7354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4602fb7fa82436eb409097dcc26acc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:36.044461  7357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cb2db3aa0c44358c3f69d74637b359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:36.048044  7358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b3bfd3a58149d3ad6700c6041b37e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:36.074358  7416 tablet_bootstrap.cc:654] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.084702  7415 tablet_bootstrap.cc:492] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.085187  7415 ts_tablet_manager.cc:1403] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.162s	user 0.021s	sys 0.000s
I20260709 13:00:36.121706  7419 tablet_bootstrap.cc:492] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
I20260709 13:00:36.134348  7416 tablet_bootstrap.cc:492] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.134894  7416 ts_tablet_manager.cc:1403] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.151s	user 0.010s	sys 0.023s
I20260709 13:00:36.129191  7415 raft_consensus.cc:359] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.137413  7415 raft_consensus.cc:385] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.137795  7415 raft_consensus.cc:740] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.143689  7415 consensus_queue.cc:260] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.150761  7416 raft_consensus.cc:359] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.156066  7248 heartbeater.cc:499] Master 127.6.236.62:39463 was elected leader, sending a full tablet report...
I20260709 13:00:36.151908  7416 raft_consensus.cc:385] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.157411  7416 raft_consensus.cc:740] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.160151  7415 ts_tablet_manager.cc:1434] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.018s
I20260709 13:00:36.160944  7323 heartbeater.cc:499] Master 127.6.236.62:39463 was elected leader, sending a full tablet report...
I20260709 13:00:36.161247  7415 tablet_bootstrap.cc:492] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
I20260709 13:00:36.158149  7416 consensus_queue.cc:260] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.171283  7419 tablet_bootstrap.cc:654] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.173944  7416 ts_tablet_manager.cc:1434] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:00:36.174472  7415 tablet_bootstrap.cc:654] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.175048  7416 tablet_bootstrap.cc:492] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.192646  7415 tablet_bootstrap.cc:492] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.193228  7415 ts_tablet_manager.cc:1403] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.007s
I20260709 13:00:36.193509  7416 tablet_bootstrap.cc:654] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.196288  7415 raft_consensus.cc:359] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.197100  7415 raft_consensus.cc:385] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.197548  7415 raft_consensus.cc:740] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.198377  7419 tablet_bootstrap.cc:492] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
I20260709 13:00:36.198863  7419 ts_tablet_manager.cc:1403] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.005s
I20260709 13:00:36.198477  7415 consensus_queue.cc:260] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.201999  7419 raft_consensus.cc:359] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.203043  7419 raft_consensus.cc:385] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.203420  7419 raft_consensus.cc:740] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.205865  7419 consensus_queue.cc:260] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.205221  7415 ts_tablet_manager.cc:1434] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:00:36.208652  7415 tablet_bootstrap.cc:492] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
I20260709 13:00:36.211422  7397 heartbeater.cc:499] Master 127.6.236.62:39463 was elected leader, sending a full tablet report...
I20260709 13:00:36.213653  7419 ts_tablet_manager.cc:1434] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:36.215090  7419 tablet_bootstrap.cc:492] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
I20260709 13:00:36.217715  7416 tablet_bootstrap.cc:492] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.220685  7416 ts_tablet_manager.cc:1403] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.005s
I20260709 13:00:36.221499  7415 tablet_bootstrap.cc:654] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.223582  7416 raft_consensus.cc:359] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.224326  7416 raft_consensus.cc:385] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.224640  7416 raft_consensus.cc:740] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.225461  7416 consensus_queue.cc:260] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.227686  7421 raft_consensus.cc:493] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.227792  7416 ts_tablet_manager.cc:1434] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:36.228127  7421 raft_consensus.cc:515] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.228847  7416 tablet_bootstrap.cc:492] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.237330  7421 leader_election.cc:290] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.252072  7416 tablet_bootstrap.cc:654] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.252696  7415 tablet_bootstrap.cc:492] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.253225  7415 ts_tablet_manager.cc:1403] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.004s
I20260709 13:00:36.254969  7419 tablet_bootstrap.cc:654] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.272936  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
W20260709 13:00:36.275218  7188 leader_election.cc:343] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.277567  7415 raft_consensus.cc:359] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.278331  7415 raft_consensus.cc:385] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.278623  7415 raft_consensus.cc:740] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.279158  7416 tablet_bootstrap.cc:492] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.279683  7416 ts_tablet_manager.cc:1403] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.008s
I20260709 13:00:36.279485  7415 consensus_queue.cc:260] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.281960  7415 ts_tablet_manager.cc:1434] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:00:36.282395  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
I20260709 13:00:36.282899  7415 tablet_bootstrap.cc:492] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
W20260709 13:00:36.284108  7189 leader_election.cc:343] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.284552  7189 leader_election.cc:304] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 926587bb15f743eeac9e5fc8e12427f0; no voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:36.285290  7421 raft_consensus.cc:2749] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:36.285118  7416 raft_consensus.cc:359] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.285876  7416 raft_consensus.cc:385] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.286212  7416 raft_consensus.cc:740] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.286924  7416 consensus_queue.cc:260] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.289774  7419 tablet_bootstrap.cc:492] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
I20260709 13:00:36.289875  7416 ts_tablet_manager.cc:1434] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:36.290290  7419 ts_tablet_manager.cc:1403] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.000s
I20260709 13:00:36.290843  7416 tablet_bootstrap.cc:492] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.293465  7419 raft_consensus.cc:359] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.294171  7419 raft_consensus.cc:385] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.294477  7419 raft_consensus.cc:740] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.295289  7419 consensus_queue.cc:260] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
W20260709 13:00:36.296298  7398 tablet.cc:2406] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:36.298689  7419 ts_tablet_manager.cc:1434] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:36.299608  7419 tablet_bootstrap.cc:492] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
I20260709 13:00:36.304550  7415 tablet_bootstrap.cc:654] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.308537  7419 tablet_bootstrap.cc:654] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.309092  7416 tablet_bootstrap.cc:654] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.317111  7415 tablet_bootstrap.cc:492] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.317678  7415 ts_tablet_manager.cc:1403] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.005s
I20260709 13:00:36.318120  7419 tablet_bootstrap.cc:492] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
I20260709 13:00:36.318635  7419 ts_tablet_manager.cc:1403] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:00:36.319358  7416 tablet_bootstrap.cc:492] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.319793  7416 ts_tablet_manager.cc:1403] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:00:36.321317  7419 raft_consensus.cc:359] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.322316  7419 raft_consensus.cc:385] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.320886  7415 raft_consensus.cc:359] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.322660  7419 raft_consensus.cc:740] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.322503  7416 raft_consensus.cc:359] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.323086  7415 raft_consensus.cc:385] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.323215  7416 raft_consensus.cc:385] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.323581  7415 raft_consensus.cc:740] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.323580  7416 raft_consensus.cc:740] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.323601  7419 consensus_queue.cc:260] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.324572  7416 consensus_queue.cc:260] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.326557  7419 ts_tablet_manager.cc:1434] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:36.326714  7416 ts_tablet_manager.cc:1434] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:00:36.327519  7419 tablet_bootstrap.cc:492] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
I20260709 13:00:36.327519  7416 tablet_bootstrap.cc:492] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.328819  7425 raft_consensus.cc:493] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.329283  7425 raft_consensus.cc:515] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.334190  7416 tablet_bootstrap.cc:654] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.324744  7415 consensus_queue.cc:260] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.343674  7425 leader_election.cc:290] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053)
I20260709 13:00:36.345633  7415 ts_tablet_manager.cc:1434] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:00:36.348532  7416 tablet_bootstrap.cc:492] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.353012  7420 raft_consensus.cc:493] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.358306  7416 ts_tablet_manager.cc:1403] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.031s	user 0.004s	sys 0.014s
I20260709 13:00:36.359279  7415 tablet_bootstrap.cc:492] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
I20260709 13:00:36.357837  7420 raft_consensus.cc:515] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.360024  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
I20260709 13:00:36.360738  7223 raft_consensus.cc:2468] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 0.
I20260709 13:00:36.361136  7416 raft_consensus.cc:359] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.356850  7425 raft_consensus.cc:493] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.361605  7420 leader_election.cc:290] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.356253  7419 tablet_bootstrap.cc:654] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.361923  7425 raft_consensus.cc:515] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.363931  7425 leader_election.cc:290] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:36.364403  7416 raft_consensus.cc:385] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.364718  7416 raft_consensus.cc:740] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.367535  7338 leader_election.cc:304] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:36.368366  7425 raft_consensus.cc:2804] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:36.368712  7425 raft_consensus.cc:493] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.369055  7425 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.370411  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
W20260709 13:00:36.372174  7338 leader_election.cc:343] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.375782  7425 raft_consensus.cc:515] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.378499  7425 leader_election.cc:290] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053)
I20260709 13:00:36.380520  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:36.381214  7223 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.387404  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:36.387557  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:36.377802  7416 consensus_queue.cc:260] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
W20260709 13:00:36.389869  7337 leader_election.cc:343] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.390388  7337 leader_election.cc:304] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0
W20260709 13:00:36.392123  7337 leader_election.cc:343] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.390456  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
W20260709 13:00:36.395610  7337 leader_election.cc:343] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.393368  7425 raft_consensus.cc:2749] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:36.397070  7421 raft_consensus.cc:493] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.397742  7421 raft_consensus.cc:515] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.399808  7421 leader_election.cc:290] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.401162  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
W20260709 13:00:36.403667  7189 leader_election.cc:343] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.407234  7419 tablet_bootstrap.cc:492] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
I20260709 13:00:36.407718  7419 ts_tablet_manager.cc:1403] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.003s
I20260709 13:00:36.411198  7223 raft_consensus.cc:2468] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 1.
I20260709 13:00:36.411008  7419 raft_consensus.cc:359] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.411731  7419 raft_consensus.cc:385] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.412026  7419 raft_consensus.cc:740] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.411377  7415 tablet_bootstrap.cc:654] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.412396  7338 leader_election.cc:304] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:36.412927  7416 ts_tablet_manager.cc:1434] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.002s
I20260709 13:00:36.421886  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:36.422356  7425 raft_consensus.cc:2804] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.422509  7296 raft_consensus.cc:2468] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 0.
I20260709 13:00:36.423753  7188 leader_election.cc:304] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:36.424538  7421 raft_consensus.cc:2804] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:36.424723  7416 tablet_bootstrap.cc:492] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.424904  7421 raft_consensus.cc:493] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.425262  7421 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.430399  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccda16172ee74fce911224858260829a" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
I20260709 13:00:36.431105  7223 raft_consensus.cc:2468] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 0.
I20260709 13:00:36.431766  7421 raft_consensus.cc:515] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.432587  7264 leader_election.cc:304] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:36.433493  7420 raft_consensus.cc:2804] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:36.433849  7420 raft_consensus.cc:493] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.434204  7420 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.432879  7416 tablet_bootstrap.cc:654] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.437899  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccda16172ee74fce911224858260829a" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
I20260709 13:00:36.441414  7420 raft_consensus.cc:515] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.442165  7425 raft_consensus.cc:697] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Becoming Leader. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:36.443064  7425 consensus_queue.cc:237] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.444376  7415 tablet_bootstrap.cc:492] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.445572  7415 ts_tablet_manager.cc:1403] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.004s
I20260709 13:00:36.449152  7421 leader_election.cc:290] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.412760  7419 consensus_queue.cc:260] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.450268  7371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:36.450443  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccda16172ee74fce911224858260829a" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:36.450553  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccda16172ee74fce911224858260829a" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:36.450923  7223 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.451318  7372 raft_consensus.cc:2468] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 0.
I20260709 13:00:36.451565  7419 ts_tablet_manager.cc:1434] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.005s
I20260709 13:00:36.452539  7419 tablet_bootstrap.cc:492] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
W20260709 13:00:36.454972  7189 leader_election.cc:343] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.455461  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:36.448647  7420 leader_election.cc:290] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.456017  7296 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.448654  7415 raft_consensus.cc:359] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.457269  7415 raft_consensus.cc:385] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.457610  7415 raft_consensus.cc:740] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.458612  7415 consensus_queue.cc:260] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.463189  7223 raft_consensus.cc:2468] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 1.
I20260709 13:00:36.464578  7264 leader_election.cc:304] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:36.465155  7415 ts_tablet_manager.cc:1434] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.006s
I20260709 13:00:36.467856  7415 tablet_bootstrap.cc:492] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
I20260709 13:00:36.467064  7420 raft_consensus.cc:2804] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.467809  7118 catalog_manager.cc:5697] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3). New cstate: current_term: 1 leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:36.471879  7420 raft_consensus.cc:697] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:36.472699  7420 consensus_queue.cc:237] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.475996  7296 raft_consensus.cc:2468] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 1.
I20260709 13:00:36.486899  7421 raft_consensus.cc:493] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.487468  7421 raft_consensus.cc:515] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.489245  7188 leader_election.cc:304] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:36.489558  7416 tablet_bootstrap.cc:492] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.489720  7421 leader_election.cc:290] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.490523  7416 ts_tablet_manager.cc:1403] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.003s
I20260709 13:00:36.490914  7421 raft_consensus.cc:2804] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.491463  7421 raft_consensus.cc:697] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:36.492547  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4602fb7fa82436eb409097dcc26acc1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
I20260709 13:00:36.492403  7415 tablet_bootstrap.cc:654] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.500566  7372 raft_consensus.cc:2468] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 0.
I20260709 13:00:36.502180  7419 tablet_bootstrap.cc:654] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.502025  7189 leader_election.cc:304] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:36.500995  7421 consensus_queue.cc:237] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.505967  7416 raft_consensus.cc:359] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.510491  7416 raft_consensus.cc:385] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.514014  7416 raft_consensus.cc:740] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.516238  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4602fb7fa82436eb409097dcc26acc1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:36.517607  7421 raft_consensus.cc:2804] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:36.518270  7421 raft_consensus.cc:493] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.518625  7421 raft_consensus.cc:3060] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:36.519246  7188 leader_election.cc:343] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.523133  7416 consensus_queue.cc:260] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.525920  7416 ts_tablet_manager.cc:1434] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:00:36.531177  7416 tablet_bootstrap.cc:492] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.525908  7119 catalog_manager.cc:5697] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.547808  7416 tablet_bootstrap.cc:654] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.549652  7415 tablet_bootstrap.cc:492] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.555713  7420 raft_consensus.cc:493] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.556634  7420 raft_consensus.cc:515] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.558900  7420 leader_election.cc:290] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.553612  7415 ts_tablet_manager.cc:1403] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.013s
I20260709 13:00:36.560679  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
I20260709 13:00:36.563354  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
I20260709 13:00:36.564028  7372 raft_consensus.cc:2468] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 0.
I20260709 13:00:36.564496  7415 raft_consensus.cc:359] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.565239  7415 raft_consensus.cc:385] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.565532  7415 raft_consensus.cc:740] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.565894  7264 leader_election.cc:304] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 
I20260709 13:00:36.566846  7420 raft_consensus.cc:2804] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:36.566994  7264 leader_election.cc:343] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.567236  7420 raft_consensus.cc:493] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.567616  7420 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.574175  7415 consensus_queue.cc:260] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.577297  7415 ts_tablet_manager.cc:1434] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:00:36.579242  7416 tablet_bootstrap.cc:492] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.578689  7415 tablet_bootstrap.cc:492] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
I20260709 13:00:36.575860  7421 raft_consensus.cc:515] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.582023  7420 raft_consensus.cc:515] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.583040  7421 leader_election.cc:290] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.583935  7420 leader_election.cc:290] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.580687  7416 ts_tablet_manager.cc:1403] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.022s
I20260709 13:00:36.584385  7419 tablet_bootstrap.cc:492] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
I20260709 13:00:36.584583  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:36.584878  7419 ts_tablet_manager.cc:1403] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.025s
I20260709 13:00:36.585214  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4602fb7fa82436eb409097dcc26acc1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:36.585740  7296 raft_consensus.cc:3060] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.586496  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:36.587059  7372 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.587097  7416 raft_consensus.cc:359] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.587857  7416 raft_consensus.cc:385] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.588168  7416 raft_consensus.cc:740] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.588966  7416 consensus_queue.cc:260] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
W20260709 13:00:36.590693  7264 leader_election.cc:343] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.590811  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4602fb7fa82436eb409097dcc26acc1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:36.591385  7370 raft_consensus.cc:3060] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.591547  7416 ts_tablet_manager.cc:1434] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:36.592489  7416 tablet_bootstrap.cc:492] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.593961  7415 tablet_bootstrap.cc:654] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.583539  7120 catalog_manager.cc:5697] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.594779  7372 raft_consensus.cc:2468] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 1.
I20260709 13:00:36.595959  7264 leader_election.cc:304] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:36.596750  7420 raft_consensus.cc:2804] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.597188  7420 raft_consensus.cc:697] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:36.587781  7419 raft_consensus.cc:359] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.597961  7420 consensus_queue.cc:237] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.598461  7419 raft_consensus.cc:385] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.598919  7419 raft_consensus.cc:740] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.599653  7419 consensus_queue.cc:260] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.602010  7419 ts_tablet_manager.cc:1434] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:00:36.602945  7419 tablet_bootstrap.cc:492] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
I20260709 13:00:36.603873  7296 raft_consensus.cc:2468] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 1.
I20260709 13:00:36.604571  7370 raft_consensus.cc:2468] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 1.
I20260709 13:00:36.606279  7188 leader_election.cc:304] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:36.607053  7421 raft_consensus.cc:2804] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.607510  7421 raft_consensus.cc:697] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:36.608297  7421 consensus_queue.cc:237] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.610455  7450 raft_consensus.cc:493] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.610903  7450 raft_consensus.cc:515] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.613009  7450 leader_election.cc:290] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.613723  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:36.614895  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
W20260709 13:00:36.616215  7189 leader_election.cc:343] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.617112  7419 tablet_bootstrap.cc:654] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.605105  7416 tablet_bootstrap.cc:654] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.622339  7296 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 0.
I20260709 13:00:36.623680  7188 leader_election.cc:304] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:36.624754  7450 raft_consensus.cc:2804] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:36.625130  7450 raft_consensus.cc:493] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.625442  7450 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.627671  7419 tablet_bootstrap.cc:492] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
I20260709 13:00:36.628152  7419 ts_tablet_manager.cc:1403] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 13:00:36.631006  7419 raft_consensus.cc:359] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.634868  7450 raft_consensus.cc:515] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.637681  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:36.638037  7416 tablet_bootstrap.cc:492] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.638267  7298 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.638576  7416 ts_tablet_manager.cc:1403] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 13:00:36.643572  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:36.631693  7419 raft_consensus.cc:385] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.644459  7419 raft_consensus.cc:740] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
W20260709 13:00:36.645179  7189 leader_election.cc:343] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.645838  7450 leader_election.cc:290] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.646392  7298 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 1.
I20260709 13:00:36.645193  7419 consensus_queue.cc:260] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.649940  7188 leader_election.cc:304] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:36.650911  7419 ts_tablet_manager.cc:1434] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:00:36.651895  7419 tablet_bootstrap.cc:492] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
I20260709 13:00:36.657665  7415 tablet_bootstrap.cc:492] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.658149  7415 ts_tablet_manager.cc:1403] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.016s
I20260709 13:00:36.659468  7425 raft_consensus.cc:493] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.659919  7425 raft_consensus.cc:515] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.660175  7416 raft_consensus.cc:359] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.660953  7416 raft_consensus.cc:385] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.661291  7416 raft_consensus.cc:740] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.661871  7425 leader_election.cc:290] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:36.662621  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
I20260709 13:00:36.662551  7416 consensus_queue.cc:260] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.663725  7450 raft_consensus.cc:2804] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.663869  7415 raft_consensus.cc:359] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.664568  7415 raft_consensus.cc:385] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.664848  7415 raft_consensus.cc:740] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.664206  7450 raft_consensus.cc:697] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:36.665472  7416 ts_tablet_manager.cc:1434] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:00:36.666373  7416 tablet_bootstrap.cc:492] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0: Bootstrap starting.
I20260709 13:00:36.665818  7450 consensus_queue.cc:237] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.665655  7120 catalog_manager.cc:5697] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.667995  7419 tablet_bootstrap.cc:654] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.664901  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:36.672539  7416 tablet_bootstrap.cc:654] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.673238  7298 raft_consensus.cc:2393] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 671aa7cab27d4c8a8f8bf80d621b92fe in current term 1: Already voted for candidate 926587bb15f743eeac9e5fc8e12427f0 in this term.
I20260709 13:00:36.674378  7337 leader_election.cc:304] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:36.665597  7415 consensus_queue.cc:260] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.675014  7425 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.676553  7415 ts_tablet_manager.cc:1434] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:00:36.677520  7415 tablet_bootstrap.cc:492] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
I20260709 13:00:36.684443  7415 tablet_bootstrap.cc:654] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.686120  7425 raft_consensus.cc:2749] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:36.686262  7119 catalog_manager.cc:5697] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:36.690205  7151 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 7091
W20260709 13:00:36.692353  7151 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 7154
W20260709 13:00:36.693363  7151 debug-util.cc:398] Leaking SignalData structure 0x7b080018c220 after lost signal to thread 7259
I20260709 13:00:36.696659  7450 raft_consensus.cc:493] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.697275  7450 raft_consensus.cc:515] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.700208  7450 leader_election.cc:290] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.702128  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
I20260709 13:00:36.702857  7370 raft_consensus.cc:2468] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 0.
I20260709 13:00:36.703454  7416 tablet_bootstrap.cc:492] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0: No bootstrap required, opened a new log
I20260709 13:00:36.703900  7416 ts_tablet_manager.cc:1403] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 13:00:36.704581  7189 leader_election.cc:304] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:36.706547  7416 raft_consensus.cc:359] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.707167  7416 raft_consensus.cc:385] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.707528  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:36.707417  7416 raft_consensus.cc:740] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.708765  7416 consensus_queue.cc:260] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.710623  7416 ts_tablet_manager.cc:1434] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:36.711217  7421 raft_consensus.cc:2804] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:36.712204  7421 raft_consensus.cc:493] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:36.712292  7188 leader_election.cc:343] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.712735  7421 raft_consensus.cc:3060] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.720650  7119 catalog_manager.cc:5697] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.724371  7420 raft_consensus.cc:493] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.724886  7420 raft_consensus.cc:515] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.727854  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
I20260709 13:00:36.728544  7223 raft_consensus.cc:2468] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 0.
I20260709 13:00:36.729902  7264 leader_election.cc:304] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:36.730219  7420 leader_election.cc:290] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.730679  7420 raft_consensus.cc:2804] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:36.731063  7420 raft_consensus.cc:493] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.731439  7420 raft_consensus.cc:3060] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.731134  7421 raft_consensus.cc:515] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.731931  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
W20260709 13:00:36.734762  7264 leader_election.cc:343] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.733166  7421 leader_election.cc:290] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.736042  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:36.736584  7370 raft_consensus.cc:3060] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.737514  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
W20260709 13:00:36.739638  7188 leader_election.cc:343] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:36.738617  7419 tablet_bootstrap.cc:492] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
I20260709 13:00:36.740599  7419 ts_tablet_manager.cc:1403] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.005s
I20260709 13:00:36.742321  7415 tablet_bootstrap.cc:492] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.742717  7415 ts_tablet_manager.cc:1403] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.065s	user 0.025s	sys 0.025s
I20260709 13:00:36.743723  7370 raft_consensus.cc:2468] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 1.
I20260709 13:00:36.744714  7189 leader_election.cc:304] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:36.745168  7415 raft_consensus.cc:359] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.745797  7421 raft_consensus.cc:2804] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.746330  7421 raft_consensus.cc:697] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:36.747146  7421 consensus_queue.cc:237] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.747211  7419 raft_consensus.cc:359] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.750200  7419 raft_consensus.cc:385] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.745801  7415 raft_consensus.cc:385] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.750792  7415 raft_consensus.cc:740] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.750566  7419 raft_consensus.cc:740] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.751586  7415 consensus_queue.cc:260] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.753540  7415 ts_tablet_manager.cc:1434] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:00:36.754429  7415 tablet_bootstrap.cc:492] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569: Bootstrap starting.
I20260709 13:00:36.751878  7419 consensus_queue.cc:260] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.758711  7420 raft_consensus.cc:515] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.760730  7420 leader_election.cc:290] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.762961  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:36.763598  7223 raft_consensus.cc:3060] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.764747  7415 tablet_bootstrap.cc:654] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.767292  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:36.767946  7370 raft_consensus.cc:3060] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.780133  7419 ts_tablet_manager.cc:1434] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.003s
I20260709 13:00:36.787127  7223 raft_consensus.cc:2468] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 1.
I20260709 13:00:36.790432  7264 leader_election.cc:304] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:36.791365  7420 raft_consensus.cc:2804] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.791879  7420 raft_consensus.cc:697] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:36.792711  7420 consensus_queue.cc:237] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.789006  7419 tablet_bootstrap.cc:492] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
I20260709 13:00:36.808720  7120 catalog_manager.cc:5697] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.785133  7370 raft_consensus.cc:2468] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 1.
I20260709 13:00:36.824993  7419 tablet_bootstrap.cc:654] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.830507  7120 catalog_manager.cc:5697] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.836120  7419 tablet_bootstrap.cc:492] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
I20260709 13:00:36.836658  7419 ts_tablet_manager.cc:1403] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.048s	user 0.003s	sys 0.014s
I20260709 13:00:36.839792  7419 raft_consensus.cc:359] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.840592  7419 raft_consensus.cc:385] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.840909  7419 raft_consensus.cc:740] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.841835  7419 consensus_queue.cc:260] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.843017  7415 tablet_bootstrap.cc:492] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569: No bootstrap required, opened a new log
I20260709 13:00:36.843433  7415 ts_tablet_manager.cc:1403] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569: Time spent bootstrapping tablet: real 0.089s	user 0.028s	sys 0.007s
I20260709 13:00:36.845830  7415 raft_consensus.cc:359] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.846800  7415 raft_consensus.cc:385] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.847076  7415 raft_consensus.cc:740] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.847652  7415 consensus_queue.cc:260] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.849825  7415 ts_tablet_manager.cc:1434] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:00:36.851002  7419 ts_tablet_manager.cc:1434] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:00:36.851840  7419 tablet_bootstrap.cc:492] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe: Bootstrap starting.
I20260709 13:00:36.856673  7425 consensus_queue.cc:1048] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:36.861101  7419 tablet_bootstrap.cc:654] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.872366  7419 tablet_bootstrap.cc:492] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe: No bootstrap required, opened a new log
W20260709 13:00:36.872609  7168 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:36.872879  7419 ts_tablet_manager.cc:1403] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:00:36.875507  7419 raft_consensus.cc:359] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.876245  7419 raft_consensus.cc:385] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.876542  7419 raft_consensus.cc:740] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.880852  7419 consensus_queue.cc:260] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.881666  7298 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.883419  7419 ts_tablet_manager.cc:1434] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:00:36.891255  7443 consensus_queue.cc:1048] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:36.911718  7420 raft_consensus.cc:493] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.912211  7420 raft_consensus.cc:515] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:36.914274  7420 leader_election.cc:290] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:36.915922  7370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
I20260709 13:00:36.917265  7370 raft_consensus.cc:2393] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c88e61aaf404e7094f2efd1e010c569 in current term 1: Already voted for candidate 926587bb15f743eeac9e5fc8e12427f0 in this term.
I20260709 13:00:36.920863  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
I20260709 13:00:36.922561  7264 leader_election.cc:304] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569; no voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:36.923345  7420 raft_consensus.cc:3060] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.929777  7420 raft_consensus.cc:2749] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:36.988843  7421 consensus_queue.cc:1048] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:37.004436  7449 consensus_queue.cc:1048] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:37.015739  7425 raft_consensus.cc:493] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.016255  7425 raft_consensus.cc:515] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.018327  7425 leader_election.cc:290] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:37.019145  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
I20260709 13:00:37.019858  7223 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 0.
I20260709 13:00:37.021138  7338 leader_election.cc:304] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:37.019814  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:37.022218  7298 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 0.
I20260709 13:00:37.023734  7425 raft_consensus.cc:2804] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:37.024121  7425 raft_consensus.cc:493] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.024457  7425 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:37.026368  7223 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:37.030949  7425 raft_consensus.cc:515] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.034053  7222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:37.034682  7222 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:37.034917  7425 leader_election.cc:290] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:37.042699  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:37.043300  7298 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:37.043910  7449 consensus_queue.cc:1048] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.056104  7222 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 1.
I20260709 13:00:37.057605  7338 leader_election.cc:304] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:37.058557  7425 raft_consensus.cc:2804] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:37.059082  7425 raft_consensus.cc:697] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Becoming Leader. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:37.060691  7420 consensus_queue.cc:1048] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.063810  7425 consensus_queue.cc:237] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.068044  7298 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 1.
I20260709 13:00:37.073348  7370 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:37.077324  7372 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:37.081341  7420 consensus_queue.cc:1048] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.085249  7449 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.105932  7447 consensus_queue.cc:1048] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:37.108546  7120 catalog_manager.cc:5697] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3). New cstate: current_term: 1 leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.111088  7421 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.130214  7420 consensus_queue.cc:1048] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.135819  7450 consensus_queue.cc:1048] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.162613  7449 raft_consensus.cc:493] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5c88e61aaf404e7094f2efd1e010c569)
I20260709 13:00:37.163111  7449 raft_consensus.cc:515] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.178107  7449 leader_election.cc:290] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:37.179996  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:37.180147  7447 consensus_queue.cc:1048] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.190433  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
I20260709 13:00:37.192241  7189 leader_election.cc:304] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 926587bb15f743eeac9e5fc8e12427f0; no voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:37.193477  7449 raft_consensus.cc:2749] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.196544  7449 consensus_queue.cc:1048] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.232690  7449 consensus_queue.cc:1048] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.275969  7420 consensus_queue.cc:1048] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.332523  7369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
mode: GRACEFUL
new_leader_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:42576
I20260709 13:00:37.333273  7369 raft_consensus.cc:606] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Received request to transfer leadership to TS 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:37.339309  7369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
mode: GRACEFUL
new_leader_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:42576
I20260709 13:00:37.339913  7369 raft_consensus.cc:606] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Received request to transfer leadership to TS 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:37.355899  7298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
mode: GRACEFUL
new_leader_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:35574
I20260709 13:00:37.356542  7298 raft_consensus.cc:606] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Received request to transfer leadership to TS 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:37.362336  7298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccda16172ee74fce911224858260829a"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
mode: GRACEFUL
new_leader_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:35574
I20260709 13:00:37.362946  7298 raft_consensus.cc:606] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Received request to transfer leadership to TS 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:37.379841  7222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
mode: GRACEFUL
new_leader_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:00:37.380486  7222 raft_consensus.cc:606] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Received request to transfer leadership to TS 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:37.386579  7449 raft_consensus.cc:993] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0: : Instructing follower 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:37.387079  7450 raft_consensus.cc:1081] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Signalling peer 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:37.388931  7298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:35548
I20260709 13:00:37.389511  7298 raft_consensus.cc:493] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.389861  7298 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.391021  7222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
mode: GRACEFUL
new_leader_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:00:37.391590  7222 raft_consensus.cc:606] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Received request to transfer leadership to TS 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:37.397388  7222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
mode: GRACEFUL
new_leader_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:00:37.397256  7298 raft_consensus.cc:515] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.398146  7222 raft_consensus.cc:606] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Received request to transfer leadership to TS 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:37.400229  7222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:37.400813  7222 raft_consensus.cc:3055] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.401119  7222 raft_consensus.cc:740] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:37.401885  7222 consensus_queue.cc:260] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.403159  7222 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.405197  7223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4602fb7fa82436eb409097dcc26acc1"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
mode: GRACEFUL
new_leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:00:37.405761  7223 raft_consensus.cc:606] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Received request to transfer leadership to TS 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:37.409469  7222 raft_consensus.cc:2468] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 2.
I20260709 13:00:37.410429  7298 leader_election.cc:290] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 2 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:37.410655  7264 leader_election.cc:304] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:37.411510  7420 raft_consensus.cc:2804] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.411998  7420 raft_consensus.cc:697] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:37.412773  7420 consensus_queue.cc:237] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.412699  7369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:37.414319  7369 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.420944  7369 raft_consensus.cc:2468] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 2.
I20260709 13:00:37.421353  7118 catalog_manager.cc:5697] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 1 to 2, leader changed from 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1) to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.494475  7450 raft_consensus.cc:993] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0: : Instructing follower 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:37.494937  7450 raft_consensus.cc:1081] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Signalling peer 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:37.496690  7298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:35548
I20260709 13:00:37.497265  7298 raft_consensus.cc:493] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.497638  7298 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.504719  7298 raft_consensus.cc:515] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.511662  7222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:37.512378  7222 raft_consensus.cc:3055] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.512778  7222 raft_consensus.cc:740] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:37.512921  7369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:37.513612  7369 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.513604  7222 consensus_queue.cc:260] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.515918  7222 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.519534  7447 raft_consensus.cc:993] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569: : Instructing follower 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:37.519953  7486 raft_consensus.cc:1081] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Signalling peer 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:37.521744  7223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccda16172ee74fce911224858260829a"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:51936
I20260709 13:00:37.522315  7223 raft_consensus.cc:493] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.522652  7223 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.541216  7369 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 2.
I20260709 13:00:37.545077  7264 leader_election.cc:304] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 
I20260709 13:00:37.545957  7447 raft_consensus.cc:2804] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.546427  7447 raft_consensus.cc:697] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:37.547179  7447 consensus_queue.cc:237] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.542624  7223 raft_consensus.cc:515] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.552866  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccda16172ee74fce911224858260829a" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:37.553440  7296 raft_consensus.cc:3055] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.553735  7296 raft_consensus.cc:740] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:37.554522  7296 consensus_queue.cc:260] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.555584  7296 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.555330  7118 catalog_manager.cc:5697] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 1 to 2, leader changed from 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1) to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.566938  7425 consensus_queue.cc:1048] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.578981  7425 raft_consensus.cc:993] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe: : Instructing follower 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:37.579380  7425 raft_consensus.cc:1081] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Signalling peer 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:37.585228  7220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:51926
I20260709 13:00:37.585785  7220 raft_consensus.cc:493] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.586136  7220 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.591777  7425 consensus_queue.cc:1048] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:37.543320  7298 leader_election.cc:290] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 2 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:37.595067  7220 raft_consensus.cc:515] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.601135  7221 raft_consensus.cc:1240] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Rejecting Update request from peer 671aa7cab27d4c8a8f8bf80d621b92fe for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.543622  7222 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 2.
I20260709 13:00:37.609370  7298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:37.610018  7298 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.614553  7223 leader_election.cc:290] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:37.618572  7296 raft_consensus.cc:2468] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:37.622015  7188 leader_election.cc:304] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:37.622888  7450 raft_consensus.cc:2804] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.623358  7450 raft_consensus.cc:697] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:37.624114  7450 consensus_queue.cc:237] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.632498  7220 leader_election.cc:290] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:37.634184  7118 catalog_manager.cc:5697] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 1 to 2, leader changed from 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2) to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:37.638576  7337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:40963, user_credentials={real_user=slave}} blocked reactor thread for 55159.4us
I20260709 13:00:37.640852  7369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccda16172ee74fce911224858260829a" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:37.641392  7369 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.644094  7371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:37.644629  7371 raft_consensus.cc:3055] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.644927  7371 raft_consensus.cc:740] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:37.645668  7371 consensus_queue.cc:260] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.646766  7371 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.654542  7371 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:37.655565  7189 leader_election.cc:304] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:37.656373  7450 raft_consensus.cc:2804] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.657605  7450 raft_consensus.cc:697] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:37.658406  7450 consensus_queue.cc:237] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.666198  7118 catalog_manager.cc:5697] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 1 to 2, leader changed from 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3) to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.674590  7449 raft_consensus.cc:993] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0: : Instructing follower 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:37.675019  7449 raft_consensus.cc:1081] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Signalling peer 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:37.676652  7297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:35548
I20260709 13:00:37.677179  7297 raft_consensus.cc:493] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.677505  7297 raft_consensus.cc:3060] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.682394  7298 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:37.687454  7296 raft_consensus.cc:1240] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Rejecting Update request from peer 671aa7cab27d4c8a8f8bf80d621b92fe for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:00:37.685655  7297 raft_consensus.cc:515] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.691239  7297 leader_election.cc:290] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 2 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:37.686662  7369 raft_consensus.cc:2468] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:37.692902  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:37.693099  7371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c71e0b12377f47aea4a28490469b0ceb" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:37.693600  7220 raft_consensus.cc:3055] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.694109  7220 raft_consensus.cc:740] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:37.695046  7220 consensus_queue.cc:260] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.696309  7220 raft_consensus.cc:3060] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.693660  7371 raft_consensus.cc:3060] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.703212  7220 raft_consensus.cc:2468] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 2.
I20260709 13:00:37.703472  7486 raft_consensus.cc:993] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569: : Instructing follower 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:37.703918  7420 raft_consensus.cc:1081] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Signalling peer 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:37.704454  7264 leader_election.cc:304] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:37.705260  7420 raft_consensus.cc:2804] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.705715  7420 raft_consensus.cc:697] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:37.706512  7420 consensus_queue.cc:237] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.708272  7223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:51936
I20260709 13:00:37.714025  7450 raft_consensus.cc:993] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0: : Instructing follower 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:37.714485  7450 raft_consensus.cc:1081] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Signalling peer 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:37.715124  7118 catalog_manager.cc:5697] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 1 to 2, leader changed from 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1) to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.716063  7369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4602fb7fa82436eb409097dcc26acc1"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:00:37.716584  7369 raft_consensus.cc:493] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.716914  7369 raft_consensus.cc:3060] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.723037  7369 raft_consensus.cc:515] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.708882  7223 raft_consensus.cc:493] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.725860  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4602fb7fa82436eb409097dcc26acc1" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:37.726336  7223 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.726438  7220 raft_consensus.cc:3055] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.726799  7220 raft_consensus.cc:740] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:37.727527  7220 consensus_queue.cc:260] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.728284  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4602fb7fa82436eb409097dcc26acc1" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:37.728560  7220 raft_consensus.cc:3060] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.728854  7297 raft_consensus.cc:3060] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.734957  7369 leader_election.cc:290] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 2 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:37.736716  7297 raft_consensus.cc:2468] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 2.
I20260709 13:00:37.738009  7337 leader_election.cc:304] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 
I20260709 13:00:37.738971  7500 raft_consensus.cc:2804] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.739459  7500 raft_consensus.cc:697] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 LEADER]: Becoming Leader. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:37.735044  7220 raft_consensus.cc:2468] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 2.
I20260709 13:00:37.740274  7500 consensus_queue.cc:237] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.740962  7371 raft_consensus.cc:2468] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 2.
I20260709 13:00:37.747844  7118 catalog_manager.cc:5697] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe reported cstate change: term changed from 1 to 2, leader changed from 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1) to 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3). New cstate: current_term: 2 leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.750294  7502 raft_consensus.cc:993] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe: : Instructing follower 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:37.750782  7500 raft_consensus.cc:1081] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Signalling peer 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:37.752485  7220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:51926
I20260709 13:00:37.753083  7220 raft_consensus.cc:493] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.753479  7220 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.756685  7223 raft_consensus.cc:515] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.759595  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:37.760222  7297 raft_consensus.cc:3055] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.760589  7297 raft_consensus.cc:740] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:37.761467  7297 consensus_queue.cc:260] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.762578  7297 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.763456  7223 leader_election.cc:290] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:37.762349  7220 raft_consensus.cc:515] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.765085  7371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:37.765697  7371 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.768417  7220 leader_election.cc:290] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:37.768641  7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:37.770355  7296 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.773720  7297 raft_consensus.cc:2468] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:37.775074  7188 leader_election.cc:304] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:37.776094  7491 raft_consensus.cc:2804] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.776525  7491 raft_consensus.cc:697] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:37.777000  7296 raft_consensus.cc:2468] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:37.777347  7491 consensus_queue.cc:237] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.778147  7188 leader_election.cc:304] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:37.779116  7450 raft_consensus.cc:2804] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.779577  7450 raft_consensus.cc:697] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:37.780310  7450 consensus_queue.cc:237] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.785691  7371 raft_consensus.cc:2468] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:37.786463  7369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:37.787448  7369 raft_consensus.cc:3055] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.787787  7369 raft_consensus.cc:740] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:37.788666  7369 consensus_queue.cc:260] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:37.790259  7369 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.791698  7118 catalog_manager.cc:5697] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 1 to 2, leader changed from 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2) to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.793200  7118 catalog_manager.cc:5697] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 1 to 2, leader changed from 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3) to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.796870  7369 raft_consensus.cc:2468] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:37.930882  7220 raft_consensus.cc:1275] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:37.932111  7420 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:37.947432  7369 raft_consensus.cc:1275] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:37.949048  7447 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:37.986383  7369 raft_consensus.cc:1275] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:37.987802  7447 consensus_queue.cc:1048] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:37.998123  7220 raft_consensus.cc:1275] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.000116  7486 consensus_queue.cc:1048] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.007323  7296 raft_consensus.cc:1275] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.012428  7450 consensus_queue.cc:1048] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.022935  7369 raft_consensus.cc:1275] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.025517  7449 consensus_queue.cc:1048] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.124107  7369 raft_consensus.cc:1275] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.125510  7449 consensus_queue.cc:1048] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.134276  7296 raft_consensus.cc:1275] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.136183  7421 consensus_queue.cc:1048] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:38.172646  7296 raft_consensus.cc:1275] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.173933  7449 consensus_queue.cc:1048] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.186311  7369 raft_consensus.cc:1275] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.187618  7491 consensus_queue.cc:1048] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.208375  7220 raft_consensus.cc:1275] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.209525  7447 consensus_queue.cc:1048] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.217724  7369 raft_consensus.cc:1275] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.219571  7420 consensus_queue.cc:1048] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.225221  7296 raft_consensus.cc:1275] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.226789  7500 consensus_queue.cc:1048] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.237134  7220 raft_consensus.cc:1275] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.238482  7502 consensus_queue.cc:1048] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.249341  7296 raft_consensus.cc:1275] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.250744  7491 consensus_queue.cc:1048] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.267858  7369 raft_consensus.cc:1275] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.269447  7491 consensus_queue.cc:1048] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.434162  7088 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:00:40.434983  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:40.461709  7220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
mode: GRACEFUL
new_leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:38126
I20260709 13:00:40.462291  7220 raft_consensus.cc:606] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Received request to transfer leadership to TS 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:40.471913  7297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
mode: GRACEFUL
new_leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:49086
I20260709 13:00:40.472425  7297 raft_consensus.cc:606] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Received request to transfer leadership to TS 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:40.473536  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:40.473999  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:40.562152  7517 raft_consensus.cc:993] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569: : Instructing follower 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:40.562614  7517 raft_consensus.cc:1081] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Signalling peer 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:40.564232  7369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:42564
I20260709 13:00:40.564682  7369 raft_consensus.cc:493] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.564957  7369 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.569556  7369 raft_consensus.cc:515] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:40.571209  7369 leader_election.cc:290] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 3 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:40.571784  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:40.572258  7220 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.572141  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:40.572675  7297 raft_consensus.cc:3055] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:40.572923  7297 raft_consensus.cc:740] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:40.573503  7297 consensus_queue.cc:260] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:40.574348  7297 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.576431  7220 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 3.
I20260709 13:00:40.577333  7338 leader_election.cc:304] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:40.577934  7512 raft_consensus.cc:2804] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:40.578758  7297 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 3.
I20260709 13:00:40.579104  7512 raft_consensus.cc:697] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Becoming Leader. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:40.579905  7512 consensus_queue.cc:237] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:40.588529  7118 catalog_manager.cc:5697] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe reported cstate change: term changed from 2 to 3, leader changed from 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2) to 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3). New cstate: current_term: 3 leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.839287  7513 raft_consensus.cc:993] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0: : Instructing follower 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:40.839658  7513 raft_consensus.cc:1081] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Signalling peer 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:40.840869  7369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:00:40.841285  7369 raft_consensus.cc:493] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.841572  7369 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.847358  7369 raft_consensus.cc:515] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:40.848837  7369 leader_election.cc:290] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 3 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:40.849473  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:40.849786  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:40.850041  7220 raft_consensus.cc:3055] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:40.850296  7297 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.850390  7220 raft_consensus.cc:740] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:40.851085  7220 consensus_queue.cc:260] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:40.851926  7220 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.854923  7297 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 3.
I20260709 13:00:40.855777  7337 leader_election.cc:304] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 
I20260709 13:00:40.856348  7220 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 3.
I20260709 13:00:40.856371  7512 raft_consensus.cc:2804] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:40.856913  7512 raft_consensus.cc:697] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Becoming Leader. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:40.857537  7512 consensus_queue.cc:237] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:40.863827  7118 catalog_manager.cc:5697] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe reported cstate change: term changed from 2 to 3, leader changed from 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1) to 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3). New cstate: current_term: 3 leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.978130  7220 raft_consensus.cc:1275] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:40.979563  7512 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:40.987723  7297 raft_consensus.cc:1275] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:40.989636  7518 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.273036  7220 raft_consensus.cc:1275] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:41.274149  7518 consensus_queue.cc:1048] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.282227  7297 raft_consensus.cc:1275] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:41.284237  7518 consensus_queue.cc:1048] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.474736  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:41.483616  7220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
mode: GRACEFUL
new_leader_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:00:41.484086  7220 raft_consensus.cc:606] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Received request to transfer leadership to TS 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:41.488286  7369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
mode: GRACEFUL
new_leader_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:42576
I20260709 13:00:41.488694  7369 raft_consensus.cc:606] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Received request to transfer leadership to TS 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:41.492928  7220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
mode: GRACEFUL
new_leader_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:00:41.493439  7220 raft_consensus.cc:606] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Received request to transfer leadership to TS 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:41.497485  7220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccda16172ee74fce911224858260829a"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
mode: GRACEFUL
new_leader_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:00:41.497936  7220 raft_consensus.cc:606] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Received request to transfer leadership to TS 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:41.509196  7372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
mode: GRACEFUL
new_leader_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:42576
I20260709 13:00:41.509675  7372 raft_consensus.cc:606] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Received request to transfer leadership to TS 5c88e61aaf404e7094f2efd1e010c569
I20260709 13:00:41.661522  7513 raft_consensus.cc:993] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0: : Instructing follower 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.661944  7534 raft_consensus.cc:1081] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Signalling peer 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.663434  7297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccda16172ee74fce911224858260829a"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:35548
I20260709 13:00:41.663903  7297 raft_consensus.cc:493] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.664191  7297 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.668931  7297 raft_consensus.cc:515] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.670508  7297 leader_election.cc:290] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 3 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:41.671134  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccda16172ee74fce911224858260829a" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:41.671399  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccda16172ee74fce911224858260829a" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:41.671749  7220 raft_consensus.cc:3055] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:41.671885  7372 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.672084  7220 raft_consensus.cc:740] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:41.672863  7220 consensus_queue.cc:260] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.673995  7220 raft_consensus.cc:3060] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.678386  7372 raft_consensus.cc:2468] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 3.
I20260709 13:00:41.679627  7264 leader_election.cc:304] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 
I20260709 13:00:41.679888  7220 raft_consensus.cc:2468] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 3.
I20260709 13:00:41.680259  7517 raft_consensus.cc:2804] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:41.682554  7517 raft_consensus.cc:697] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:41.683348  7517 consensus_queue.cc:237] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.690279  7118 catalog_manager.cc:5697] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 2 to 3, leader changed from 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1) to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.756565  7518 raft_consensus.cc:993] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe: : Instructing follower 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.756958  7532 raft_consensus.cc:1081] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Signalling peer 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.758488  7297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:35558
I20260709 13:00:41.758988  7297 raft_consensus.cc:493] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.759338  7297 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.763351  7297 raft_consensus.cc:515] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.764706  7297 leader_election.cc:290] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 4 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:41.765429  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:41.765709  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a303edb58b594e0db3e6764d554d73a8" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:41.765908  7220 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.766211  7372 raft_consensus.cc:3055] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:41.766461  7372 raft_consensus.cc:740] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:41.767051  7372 consensus_queue.cc:260] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.767881  7372 raft_consensus.cc:3060] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.770233  7220 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 4.
I20260709 13:00:41.771136  7264 leader_election.cc:304] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:41.771890  7517 raft_consensus.cc:2804] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:41.772276  7517 raft_consensus.cc:697] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:41.772342  7372 raft_consensus.cc:2468] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 4.
I20260709 13:00:41.773018  7517 consensus_queue.cc:237] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.778286  7118 catalog_manager.cc:5697] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 3 to 4, leader changed from 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3) to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.796109  7513 raft_consensus.cc:993] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0: : Instructing follower 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.796486  7534 raft_consensus.cc:1081] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Signalling peer 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.797684  7297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:35548
I20260709 13:00:41.798111  7297 raft_consensus.cc:493] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.798393  7297 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.802496  7297 raft_consensus.cc:515] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.803912  7297 leader_election.cc:290] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 3 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:41.804643  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:41.804944  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:41.805227  7220 raft_consensus.cc:3055] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:41.805459  7372 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.805558  7220 raft_consensus.cc:740] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:41.806366  7220 consensus_queue.cc:260] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.807484  7220 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.811671  7372 raft_consensus.cc:2468] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 3.
I20260709 13:00:41.812693  7264 leader_election.cc:304] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 
I20260709 13:00:41.812938  7220 raft_consensus.cc:2468] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 3.
I20260709 13:00:41.813423  7517 raft_consensus.cc:2804] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:41.813882  7517 raft_consensus.cc:697] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:41.814567  7517 consensus_queue.cc:237] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.820240  7118 catalog_manager.cc:5697] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 2 to 3, leader changed from 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1) to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.899940  7513 raft_consensus.cc:993] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0: : Instructing follower 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.900313  7534 raft_consensus.cc:1081] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Signalling peer 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.902100  7297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:35548
I20260709 13:00:41.902599  7297 raft_consensus.cc:493] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.902868  7297 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.907027  7297 raft_consensus.cc:515] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.908423  7297 leader_election.cc:290] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 3 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:41.909161  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:41.909375  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:41.909587  7220 raft_consensus.cc:3055] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:41.909896  7220 raft_consensus.cc:740] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:41.909917  7372 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.910521  7220 consensus_queue.cc:260] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.911291  7220 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.914300  7372 raft_consensus.cc:2468] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 3.
I20260709 13:00:41.914939  7220 raft_consensus.cc:2468] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 3.
I20260709 13:00:41.915191  7264 leader_election.cc:304] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 
I20260709 13:00:41.915881  7517 raft_consensus.cc:2804] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:41.916244  7517 raft_consensus.cc:697] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:41.916863  7517 consensus_queue.cc:237] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.922273  7118 catalog_manager.cc:5697] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 2 to 3, leader changed from 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1) to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.935412  7518 raft_consensus.cc:993] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe: : Instructing follower 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.935905  7532 raft_consensus.cc:1081] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Signalling peer 5c88e61aaf404e7094f2efd1e010c569 to start an election
I20260709 13:00:41.937345  7297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
 from {username='slave'} at 127.0.0.1:35558
I20260709 13:00:41.937798  7297 raft_consensus.cc:493] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.938125  7297 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.942313  7297 raft_consensus.cc:515] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.943754  7297 leader_election.cc:290] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 4 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:41.944617  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:41.944864  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "5c88e61aaf404e7094f2efd1e010c569" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:41.945140  7220 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.945365  7372 raft_consensus.cc:3055] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:41.945667  7372 raft_consensus.cc:740] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:41.946434  7372 consensus_queue.cc:260] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.947562  7372 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.950980  7220 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 4.
I20260709 13:00:41.951943  7264 leader_election.cc:304] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:41.952564  7517 raft_consensus.cc:2804] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:41.952922  7517 raft_consensus.cc:697] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 LEADER]: Becoming Leader. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:41.953176  7372 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c88e61aaf404e7094f2efd1e010c569 in term 4.
I20260709 13:00:41.953691  7517 consensus_queue.cc:237] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:41.959259  7118 catalog_manager.cc:5697] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 reported cstate change: term changed from 3 to 4, leader changed from 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3) to 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "5c88e61aaf404e7094f2efd1e010c569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.136791  7372 raft_consensus.cc:1275] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:42.137954  7517 consensus_queue.cc:1048] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:42.146273  7220 raft_consensus.cc:1275] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:42.147560  7535 consensus_queue.cc:1048] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:43.262162  7549 raft_consensus.cc:493] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5c88e61aaf404e7094f2efd1e010c569)
I20260709 13:00:43.262773  7549 raft_consensus.cc:515] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:43.266196  7549 leader_election.cc:290] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:43.275959  7550 raft_consensus.cc:493] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c88e61aaf404e7094f2efd1e010c569)
I20260709 13:00:43.276363  7550 raft_consensus.cc:515] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:43.278318  7550 leader_election.cc:290] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:43.279201  7223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "926587bb15f743eeac9e5fc8e12427f0" is_pre_election: true
I20260709 13:00:43.280144  7372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" is_pre_election: true
I20260709 13:00:43.282104  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:43.284071  7337 leader_election.cc:304] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe; no voters: 5c88e61aaf404e7094f2efd1e010c569, 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:43.286140  7550 raft_consensus.cc:2749] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:43.303392  7223 raft_consensus.cc:1275] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:43.303442  7222 raft_consensus.cc:1275] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:43.305593  7372 raft_consensus.cc:1275] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:43.305940  7369 raft_consensus.cc:1275] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:43.306559  7222 raft_consensus.cc:1275] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:43.307807  7223 raft_consensus.cc:1275] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:43.309170  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c88e61aaf404e7094f2efd1e010c569" is_pre_election: true
I20260709 13:00:43.309648  7369 raft_consensus.cc:1275] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:43.310218  7552 consensus_queue.cc:1048] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:43.310596  7372 raft_consensus.cc:1275] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Refusing update from remote peer 5c88e61aaf404e7094f2efd1e010c569: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:43.310387  7548 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:43.311597  7552 consensus_queue.cc:1048] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:43.313022  7554 consensus_queue.cc:1048] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:43.313823  7552 consensus_queue.cc:1048] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:43.314050  7555 consensus_queue.cc:1048] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:43.314333  7554 consensus_queue.cc:1048] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:43.315377  7555 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:43.315701  7188 leader_election.cc:304] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 926587bb15f743eeac9e5fc8e12427f0; no voters: 5c88e61aaf404e7094f2efd1e010c569, 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:43.316326  7549 raft_consensus.cc:2749] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:43.790396  7393 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0060 after lost signal to thread 7091
W20260709 13:00:43.791254  7393 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0740 after lost signal to thread 7154
W20260709 13:00:43.792060  7393 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3740 after lost signal to thread 7247
W20260709 13:00:43.792850  7393 debug-util.cc:398] Leaking SignalData structure 0x7b08001f70e0 after lost signal to thread 7322
W20260709 13:00:43.793614  7393 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6a60 after lost signal to thread 7396
I20260709 13:00:45.167335  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.174582  7297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
mode: GRACEFUL
new_leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:49086
I20260709 13:00:45.175525  7297 raft_consensus.cc:606] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Received request to transfer leadership to TS 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:45.178548  7297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
mode: GRACEFUL
new_leader_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:49086
I20260709 13:00:45.179026  7297 raft_consensus.cc:606] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Received request to transfer leadership to TS 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:45.181327  7297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
mode: GRACEFUL
new_leader_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:49086
I20260709 13:00:45.181819  7297 raft_consensus.cc:606] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Received request to transfer leadership to TS 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:45.184005  7297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
mode: GRACEFUL
new_leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:49086
I20260709 13:00:45.184433  7297 raft_consensus.cc:606] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 LEADER]: Received request to transfer leadership to TS 671aa7cab27d4c8a8f8bf80d621b92fe
I20260709 13:00:45.186643  7297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb"
dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
mode: GRACEFUL
new_leader_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:49086
I20260709 13:00:45.187227  7297 raft_consensus.cc:606] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Received request to transfer leadership to TS 926587bb15f743eeac9e5fc8e12427f0
I20260709 13:00:45.188349  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:45.188766  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:45.247066  7555 raft_consensus.cc:993] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569: : Instructing follower 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:45.247651  7579 raft_consensus.cc:1081] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Signalling peer 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:45.249223  7220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:51936
I20260709 13:00:45.249794  7220 raft_consensus.cc:493] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.250216  7220 raft_consensus.cc:3060] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.257272  7220 raft_consensus.cc:515] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.259678  7220 leader_election.cc:290] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:45.260748  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:45.260911  7369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cb2db3aa0c44358c3f69d74637b359" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:45.261552  7369 raft_consensus.cc:3060] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.261511  7297 raft_consensus.cc:3055] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:45.262104  7297 raft_consensus.cc:740] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:45.262996  7297 consensus_queue.cc:260] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.264221  7297 raft_consensus.cc:3060] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.266546  7369 raft_consensus.cc:2468] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:45.267722  7189 leader_election.cc:304] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:45.269248  7580 raft_consensus.cc:2804] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:45.270195  7580 raft_consensus.cc:697] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:45.270504  7297 raft_consensus.cc:2468] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 2.
I20260709 13:00:45.271236  7580 consensus_queue.cc:237] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.279621  7117 catalog_manager.cc:5697] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 1 to 2, leader changed from 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2) to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.299801  7555 raft_consensus.cc:993] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569: : Instructing follower 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:45.300248  7579 raft_consensus.cc:1081] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Signalling peer 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:45.301607  7220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:51936
I20260709 13:00:45.302138  7220 raft_consensus.cc:493] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.302460  7220 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.308384  7220 raft_consensus.cc:515] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.310669  7220 leader_election.cc:290] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 3 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:45.310912  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:45.311474  7297 raft_consensus.cc:3055] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:45.311735  7369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b3bfd3a58149d3ad6700c6041b37e1" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:45.311818  7297 raft_consensus.cc:740] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:45.312273  7369 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.312659  7297 consensus_queue.cc:260] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.313681  7297 raft_consensus.cc:3060] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.317884  7369 raft_consensus.cc:2468] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 3.
I20260709 13:00:45.318738  7189 leader_election.cc:304] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:45.319365  7580 raft_consensus.cc:2804] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:45.319726  7580 raft_consensus.cc:697] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:45.320436  7297 raft_consensus.cc:2468] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 3.
I20260709 13:00:45.320519  7580 consensus_queue.cc:237] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.328500  7117 catalog_manager.cc:5697] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 2 to 3, leader changed from 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2) to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 3 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.430241  7555 raft_consensus.cc:993] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569: : Instructing follower 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:45.430691  7579 raft_consensus.cc:1081] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Signalling peer 926587bb15f743eeac9e5fc8e12427f0 to start an election
I20260709 13:00:45.431984  7220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb"
dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
 from {username='slave'} at 127.0.0.1:51936
I20260709 13:00:45.432488  7220 raft_consensus.cc:493] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.432797  7220 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.438438  7220 raft_consensus.cc:515] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.440140  7220 leader_election.cc:290] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 4 election: Requested vote from peers 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963), 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3:36207)
I20260709 13:00:45.440768  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:45.441092  7369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47c7ea1bc4742a68285127be1fc87bb" candidate_uuid: "926587bb15f743eeac9e5fc8e12427f0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
I20260709 13:00:45.441277  7297 raft_consensus.cc:3055] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:45.441540  7369 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.441561  7297 raft_consensus.cc:740] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:45.442420  7297 consensus_queue.cc:260] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.443483  7297 raft_consensus.cc:3060] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.447237  7369 raft_consensus.cc:2468] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 4.
I20260709 13:00:45.448200  7189 leader_election.cc:304] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:45.448930  7580 raft_consensus.cc:2804] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:45.449888  7580 raft_consensus.cc:697] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 4 LEADER]: Becoming Leader. State: Replica: 926587bb15f743eeac9e5fc8e12427f0, State: Running, Role: LEADER
I20260709 13:00:45.450732  7297 raft_consensus.cc:2468] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926587bb15f743eeac9e5fc8e12427f0 in term 4.
I20260709 13:00:45.450783  7580 consensus_queue.cc:237] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.459188  7118 catalog_manager.cc:5697] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 reported cstate change: term changed from 3 to 4, leader changed from 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2) to 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1). New cstate: current_term: 4 leader_uuid: "926587bb15f743eeac9e5fc8e12427f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.508219  7555 raft_consensus.cc:993] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569: : Instructing follower 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:45.508628  7555 raft_consensus.cc:1081] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Signalling peer 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:45.510003  7369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:42564
I20260709 13:00:45.510437  7369 raft_consensus.cc:493] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.510685  7369 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.515065  7369 raft_consensus.cc:515] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.516606  7369 leader_election.cc:290] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 4 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:45.517573  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:45.518126  7297 raft_consensus.cc:3055] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:45.517993  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666a0cd8b4154f99becedaadc57a3cda" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:45.518448  7297 raft_consensus.cc:740] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:45.518738  7220 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.519155  7297 consensus_queue.cc:260] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.520177  7297 raft_consensus.cc:3060] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.524508  7220 raft_consensus.cc:2468] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 4.
I20260709 13:00:45.525801  7297 raft_consensus.cc:2468] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 4.
I20260709 13:00:45.525727  7338 leader_election.cc:304] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:45.526752  7550 raft_consensus.cc:2804] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:45.527995  7550 raft_consensus.cc:697] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 LEADER]: Becoming Leader. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:45.528741  7550 consensus_queue.cc:237] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.535703  7118 catalog_manager.cc:5697] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe reported cstate change: term changed from 3 to 4, leader changed from 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2) to 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3). New cstate: current_term: 4 leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.558344  7579 raft_consensus.cc:993] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569: : Instructing follower 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:45.558794  7555 raft_consensus.cc:1081] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 LEADER]: Signalling peer 671aa7cab27d4c8a8f8bf80d621b92fe to start an election
I20260709 13:00:45.560093  7369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27"
dest_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe"
 from {username='slave'} at 127.0.0.1:42564
I20260709 13:00:45.560489  7369 raft_consensus.cc:493] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.560760  7369 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.565716  7369 raft_consensus.cc:515] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.567262  7369 leader_election.cc:290] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 5 election: Requested vote from peers 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053), 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963)
I20260709 13:00:45.567998  7220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "926587bb15f743eeac9e5fc8e12427f0"
I20260709 13:00:45.568243  7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f0ce1685f4c16bbd45e973de27b27" candidate_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5c88e61aaf404e7094f2efd1e010c569"
I20260709 13:00:45.568552  7220 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.568795  7297 raft_consensus.cc:3055] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:45.569095  7297 raft_consensus.cc:740] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5c88e61aaf404e7094f2efd1e010c569, State: Running, Role: LEADER
I20260709 13:00:45.569775  7297 consensus_queue.cc:260] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.570847  7297 raft_consensus.cc:3060] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.572491  7220 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 5.
I20260709 13:00:45.573284  7338 leader_election.cc:304] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 671aa7cab27d4c8a8f8bf80d621b92fe, 926587bb15f743eeac9e5fc8e12427f0; no voters: 
I20260709 13:00:45.573891  7550 raft_consensus.cc:2804] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:45.574273  7550 raft_consensus.cc:697] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 5 LEADER]: Becoming Leader. State: Replica: 671aa7cab27d4c8a8f8bf80d621b92fe, State: Running, Role: LEADER
I20260709 13:00:45.575037  7550 consensus_queue.cc:237] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } }
I20260709 13:00:45.576630  7297 raft_consensus.cc:2468] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 671aa7cab27d4c8a8f8bf80d621b92fe in term 5.
I20260709 13:00:45.581771  7118 catalog_manager.cc:5697] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe reported cstate change: term changed from 4 to 5, leader changed from 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2) to 671aa7cab27d4c8a8f8bf80d621b92fe (127.6.236.3). New cstate: current_term: 5 leader_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.724941  7297 raft_consensus.cc:1275] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:45.726313  7580 consensus_queue.cc:1048] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.739987  7369 raft_consensus.cc:1275] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:45.742756  7580 consensus_queue.cc:1048] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.853163  7297 raft_consensus.cc:1275] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.854323  7580 consensus_queue.cc:1048] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:45.866056  7369 raft_consensus.cc:1275] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.867839  7599 consensus_queue.cc:1048] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:45.915133  7297 raft_consensus.cc:1275] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:45.916146  7599 consensus_queue.cc:1048] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.927642  7369 raft_consensus.cc:1275] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Refusing update from remote peer 926587bb15f743eeac9e5fc8e12427f0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:45.929533  7594 consensus_queue.cc:1048] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "671aa7cab27d4c8a8f8bf80d621b92fe" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.948827  7297 raft_consensus.cc:1275] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:45.949864  7550 consensus_queue.cc:1048] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.958384  7220 raft_consensus.cc:1275] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:45.960319  7604 consensus_queue.cc:1048] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:46.019567  7297 raft_consensus.cc:1275] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 5 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:46.020740  7604 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c88e61aaf404e7094f2efd1e010c569" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:46.028613  7220 raft_consensus.cc:1275] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 5 FOLLOWER]: Refusing update from remote peer 671aa7cab27d4c8a8f8bf80d621b92fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:46.030120  7550 consensus_queue.cc:1048] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "926587bb15f743eeac9e5fc8e12427f0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:46.189615  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:46.194736  7088 tablet_server.cc:179] TabletServer@127.6.236.1:0 shutting down...
I20260709 13:00:46.214187  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:46.214879  7088 tablet_replica.cc:333] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.215512  7088 raft_consensus.cc:2243] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.216297  7088 raft_consensus.cc:2272] T b7cb2db3aa0c44358c3f69d74637b359 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.218609  7088 tablet_replica.cc:333] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.219080  7088 raft_consensus.cc:2243] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.219462  7088 raft_consensus.cc:2272] T 666a0cd8b4154f99becedaadc57a3cda P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.221305  7088 tablet_replica.cc:333] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.221776  7088 raft_consensus.cc:2243] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.222200  7088 raft_consensus.cc:2272] T cc9f0ce1685f4c16bbd45e973de27b27 P 926587bb15f743eeac9e5fc8e12427f0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.224014  7088 tablet_replica.cc:333] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.224458  7088 raft_consensus.cc:2243] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.224813  7088 raft_consensus.cc:2272] T c71e0b12377f47aea4a28490469b0ceb P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.226339  7088 tablet_replica.cc:333] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.226790  7088 raft_consensus.cc:2243] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.227145  7088 raft_consensus.cc:2272] T ccda16172ee74fce911224858260829a P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.228554  7088 tablet_replica.cc:333] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.228982  7088 raft_consensus.cc:2243] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.229344  7088 raft_consensus.cc:2272] T c4602fb7fa82436eb409097dcc26acc1 P 926587bb15f743eeac9e5fc8e12427f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.230895  7088 tablet_replica.cc:333] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.231328  7088 raft_consensus.cc:2243] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.231714  7088 raft_consensus.cc:2272] T a303edb58b594e0db3e6764d554d73a8 P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.233534  7088 tablet_replica.cc:333] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.233982  7088 raft_consensus.cc:2243] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.234679  7088 raft_consensus.cc:2272] T f47c7ea1bc4742a68285127be1fc87bb P 926587bb15f743eeac9e5fc8e12427f0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.236389  7088 tablet_replica.cc:333] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0: stopping tablet replica
I20260709 13:00:46.236800  7088 raft_consensus.cc:2243] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.237434  7088 raft_consensus.cc:2272] T 95b3bfd3a58149d3ad6700c6041b37e1 P 926587bb15f743eeac9e5fc8e12427f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.324370  7088 tablet_server.cc:196] TabletServer@127.6.236.1:0 shutdown complete.
I20260709 13:00:46.342123  7088 tablet_server.cc:179] TabletServer@127.6.236.2:0 shutting down...
I20260709 13:00:46.363478  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:46.364183  7088 tablet_replica.cc:333] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.364985  7088 raft_consensus.cc:2243] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.365703  7088 raft_consensus.cc:2272] T c71e0b12377f47aea4a28490469b0ceb P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.367416  7088 tablet_replica.cc:333] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.367897  7088 raft_consensus.cc:2243] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.368552  7088 raft_consensus.cc:2272] T a303edb58b594e0db3e6764d554d73a8 P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.370122  7088 tablet_replica.cc:333] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.370560  7088 raft_consensus.cc:2243] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.370915  7088 raft_consensus.cc:2272] T f47c7ea1bc4742a68285127be1fc87bb P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.372687  7088 tablet_replica.cc:333] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.373116  7088 raft_consensus.cc:2243] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.373481  7088 raft_consensus.cc:2272] T c4602fb7fa82436eb409097dcc26acc1 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.375070  7088 tablet_replica.cc:333] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.375487  7088 raft_consensus.cc:2243] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.375833  7088 raft_consensus.cc:2272] T b7cb2db3aa0c44358c3f69d74637b359 P 5c88e61aaf404e7094f2efd1e010c569 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.377800  7088 tablet_replica.cc:333] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.378255  7088 raft_consensus.cc:2243] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.378594  7088 raft_consensus.cc:2272] T 666a0cd8b4154f99becedaadc57a3cda P 5c88e61aaf404e7094f2efd1e010c569 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.380438  7088 tablet_replica.cc:333] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.380904  7088 raft_consensus.cc:2243] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.381480  7088 raft_consensus.cc:2272] T 95b3bfd3a58149d3ad6700c6041b37e1 P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.383565  7088 tablet_replica.cc:333] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.383970  7088 raft_consensus.cc:2243] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.384281  7088 raft_consensus.cc:2272] T cc9f0ce1685f4c16bbd45e973de27b27 P 5c88e61aaf404e7094f2efd1e010c569 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.386042  7088 tablet_replica.cc:333] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569: stopping tablet replica
I20260709 13:00:46.386482  7088 raft_consensus.cc:2243] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.387192  7088 raft_consensus.cc:2272] T ccda16172ee74fce911224858260829a P 5c88e61aaf404e7094f2efd1e010c569 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:46.398277  7337 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from unknown peer (error 108)
W20260709 13:00:46.403568  7337 consensus_peers.cc:597] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe -> Peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Couldn't send request to peer 5c88e61aaf404e7094f2efd1e010c569. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:40963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:46.413662  7088 tablet_server.cc:196] TabletServer@127.6.236.2:0 shutdown complete.
W20260709 13:00:46.427816  7338 consensus_peers.cc:597] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe -> Peer 926587bb15f743eeac9e5fc8e12427f0 (127.6.236.1:43053): Couldn't send request to peer 926587bb15f743eeac9e5fc8e12427f0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:43053: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:46.431901  7088 tablet_server.cc:179] TabletServer@127.6.236.3:0 shutting down...
W20260709 13:00:46.443416  7337 consensus_peers.cc:597] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe -> Peer 5c88e61aaf404e7094f2efd1e010c569 (127.6.236.2:40963): Couldn't send request to peer 5c88e61aaf404e7094f2efd1e010c569. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:40963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:46.454681  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:46.455318  7088 tablet_replica.cc:333] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.455936  7088 raft_consensus.cc:2243] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.456655  7088 raft_consensus.cc:2272] T cc9f0ce1685f4c16bbd45e973de27b27 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.458616  7088 tablet_replica.cc:333] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.459093  7088 raft_consensus.cc:2243] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.459463  7088 raft_consensus.cc:2272] T 95b3bfd3a58149d3ad6700c6041b37e1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.461323  7088 tablet_replica.cc:333] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.461791  7088 raft_consensus.cc:2243] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.462204  7088 raft_consensus.cc:2272] T c71e0b12377f47aea4a28490469b0ceb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.463693  7088 tablet_replica.cc:333] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.464136  7088 raft_consensus.cc:2243] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.464550  7088 raft_consensus.cc:2272] T ccda16172ee74fce911224858260829a P 671aa7cab27d4c8a8f8bf80d621b92fe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.466099  7088 tablet_replica.cc:333] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.466545  7088 raft_consensus.cc:2243] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.466910  7088 raft_consensus.cc:2272] T a303edb58b594e0db3e6764d554d73a8 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.468344  7088 tablet_replica.cc:333] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.468760  7088 raft_consensus.cc:2243] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.469115  7088 raft_consensus.cc:2272] T f47c7ea1bc4742a68285127be1fc87bb P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.470940  7088 tablet_replica.cc:333] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.471395  7088 raft_consensus.cc:2243] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.472043  7088 raft_consensus.cc:2272] T c4602fb7fa82436eb409097dcc26acc1 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.473533  7088 tablet_replica.cc:333] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.473946  7088 raft_consensus.cc:2243] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.474340  7088 raft_consensus.cc:2272] T b7cb2db3aa0c44358c3f69d74637b359 P 671aa7cab27d4c8a8f8bf80d621b92fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.476079  7088 tablet_replica.cc:333] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe: stopping tablet replica
I20260709 13:00:46.476485  7088 raft_consensus.cc:2243] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.477121  7088 raft_consensus.cc:2272] T 666a0cd8b4154f99becedaadc57a3cda P 671aa7cab27d4c8a8f8bf80d621b92fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.517912  7088 tablet_server.cc:196] TabletServer@127.6.236.3:0 shutdown complete.
I20260709 13:00:46.533473  7088 master.cc:562] Master@127.6.236.62:39463 shutting down...
I20260709 13:00:46.670990  7088 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:46.671485  7088 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.671761  7088 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9ceb25848caf43df80f7382829ac79b4: stopping tablet replica
I20260709 13:00:46.710224  7088 master.cc:584] Master@127.6.236.62:39463 shutdown complete.
5c88e61aaf404e7094f2efd1e010c569  4
671aa7cab27d4c8a8f8bf80d621b92fe  1
926587bb15f743eeac9e5fc8e12427f0  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13286 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:00:46.745086  7088 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.236.62:44735
I20260709 13:00:46.746152  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:46.751610  7610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:46.751616  7611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:46.752180  7613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:46.752817  7088 server_base.cc:1061] running on GCE node
I20260709 13:00:46.753594  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:46.753760  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:46.753903  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602046753886 us; error 0 us; skew 500 ppm
I20260709 13:00:46.754426  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:46.756690  7088 webserver.cc:533] Webserver started at http://127.6.236.62:44713/ using document root <none> and password file <none>
I20260709 13:00:46.757139  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:46.757308  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:46.757552  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:46.758647  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/master-0-root/instance:
uuid: "5844147c1cbb4ea08ce510facc65f685"
format_stamp: "Formatted at 2026-07-09 13:00:46 on dist-test-slave-j4mc"
I20260709 13:00:46.762632  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:46.765760  7618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:46.766408  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:46.766657  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/master-0-root
uuid: "5844147c1cbb4ea08ce510facc65f685"
format_stamp: "Formatted at 2026-07-09 13:00:46 on dist-test-slave-j4mc"
I20260709 13:00:46.766906  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:46.776651  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:46.777848  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:46.813261  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.62:44735
I20260709 13:00:46.813362  7669 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.62:44735 every 8 connection(s)
I20260709 13:00:46.816908  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.825806  7670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685: Bootstrap starting.
I20260709 13:00:46.830248  7670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.834131  7670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685: No bootstrap required, opened a new log
I20260709 13:00:46.836068  7670 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5844147c1cbb4ea08ce510facc65f685" member_type: VOTER }
I20260709 13:00:46.836437  7670 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.836613  7670 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5844147c1cbb4ea08ce510facc65f685, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.837108  7670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5844147c1cbb4ea08ce510facc65f685" member_type: VOTER }
I20260709 13:00:46.837530  7670 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:46.837718  7670 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:46.837915  7670 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.841800  7670 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5844147c1cbb4ea08ce510facc65f685" member_type: VOTER }
I20260709 13:00:46.842288  7670 leader_election.cc:304] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5844147c1cbb4ea08ce510facc65f685; no voters: 
I20260709 13:00:46.843286  7670 leader_election.cc:290] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:46.843634  7673 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.844980  7673 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 1 LEADER]: Becoming Leader. State: Replica: 5844147c1cbb4ea08ce510facc65f685, State: Running, Role: LEADER
I20260709 13:00:46.845620  7673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5844147c1cbb4ea08ce510facc65f685" member_type: VOTER }
I20260709 13:00:46.845947  7670 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:46.850128  7675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5844147c1cbb4ea08ce510facc65f685. Latest consensus state: current_term: 1 leader_uuid: "5844147c1cbb4ea08ce510facc65f685" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5844147c1cbb4ea08ce510facc65f685" member_type: VOTER } }
I20260709 13:00:46.850696  7675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:46.854405  7674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5844147c1cbb4ea08ce510facc65f685" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5844147c1cbb4ea08ce510facc65f685" member_type: VOTER } }
I20260709 13:00:46.855120  7674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:46.857616  7682 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:46.862608  7682 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:46.863507  7088 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:46.870390  7682 catalog_manager.cc:1383] Generated new cluster ID: 10a0ce272d2f47809cb50d661a6f88ea
I20260709 13:00:46.870659  7682 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:46.905154  7682 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:46.906330  7682 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:46.918391  7682 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685: Generated new TSK 0
I20260709 13:00:46.919004  7682 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:46.929601  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:46.935025  7691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:46.936334  7692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:46.936911  7694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:46.937207  7088 server_base.cc:1061] running on GCE node
I20260709 13:00:46.938135  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:46.938328  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:46.938491  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602046938472 us; error 0 us; skew 500 ppm
I20260709 13:00:46.938990  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:46.941063  7088 webserver.cc:533] Webserver started at http://127.6.236.1:42839/ using document root <none> and password file <none>
I20260709 13:00:46.941498  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:46.941658  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:46.941907  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:46.942916  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-0-root/instance:
uuid: "810a084c891e4aa3b4d400603a42fdb0"
format_stamp: "Formatted at 2026-07-09 13:00:46 on dist-test-slave-j4mc"
I20260709 13:00:46.947453  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:46.950618  7699 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:46.951303  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:46.951584  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "810a084c891e4aa3b4d400603a42fdb0"
format_stamp: "Formatted at 2026-07-09 13:00:46 on dist-test-slave-j4mc"
I20260709 13:00:46.951838  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:46.961702  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:46.962954  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:46.964341  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:46.966617  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:46.966812  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:46.967032  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:46.967190  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:47.004792  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:32907
I20260709 13:00:47.004887  7761 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:32907 every 8 connection(s)
I20260709 13:00:47.009722  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:47.015903  7766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:47.016794  7767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:47.019903  7769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:47.020213  7088 server_base.cc:1061] running on GCE node
I20260709 13:00:47.021435  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:47.021742  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:47.021939  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602047021918 us; error 0 us; skew 500 ppm
I20260709 13:00:47.022486  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:47.024938  7762 heartbeater.cc:344] Connected to a master server at 127.6.236.62:44735
I20260709 13:00:47.025347  7762 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:47.025462  7088 webserver.cc:533] Webserver started at http://127.6.236.2:36585/ using document root <none> and password file <none>
I20260709 13:00:47.026185  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:47.026199  7762 heartbeater.cc:507] Master 127.6.236.62:44735 requested a full tablet report, sending...
I20260709 13:00:47.026541  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:47.026877  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:47.028123  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-1-root/instance:
uuid: "3138faa4c28b4d87b97b294489f4504b"
format_stamp: "Formatted at 2026-07-09 13:00:47 on dist-test-slave-j4mc"
I20260709 13:00:47.028491  7635 ts_manager.cc:194] Registered new tserver with Master: 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907)
I20260709 13:00:47.030208  7635 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57178
I20260709 13:00:47.032958  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:00:47.036262  7774 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:47.036979  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:47.037246  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-1-root
uuid: "3138faa4c28b4d87b97b294489f4504b"
format_stamp: "Formatted at 2026-07-09 13:00:47 on dist-test-slave-j4mc"
I20260709 13:00:47.037498  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:47.062898  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:47.064066  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:47.065490  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:47.067688  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:47.067900  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:47.068136  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:47.068289  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:47.107960  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.2:45273
I20260709 13:00:47.108067  7836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.2:45273 every 8 connection(s)
I20260709 13:00:47.112443  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:47.118872  7840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:47.120500  7841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:47.122483  7843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:47.122468  7088 server_base.cc:1061] running on GCE node
I20260709 13:00:47.123430  7837 heartbeater.cc:344] Connected to a master server at 127.6.236.62:44735
I20260709 13:00:47.123811  7837 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:47.123757  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:47.124155  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:47.124353  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602047124335 us; error 0 us; skew 500 ppm
I20260709 13:00:47.124743  7837 heartbeater.cc:507] Master 127.6.236.62:44735 requested a full tablet report, sending...
I20260709 13:00:47.125057  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:47.126989  7635 ts_manager.cc:194] Registered new tserver with Master: 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:47.128293  7635 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57186
I20260709 13:00:47.129370  7088 webserver.cc:533] Webserver started at http://127.6.236.3:44739/ using document root <none> and password file <none>
I20260709 13:00:47.130019  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:47.130295  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:47.130611  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:47.131651  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-2-root/instance:
uuid: "7f4ad52824e949ec901a5fd45d492b04"
format_stamp: "Formatted at 2026-07-09 13:00:47 on dist-test-slave-j4mc"
I20260709 13:00:47.135944  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:47.139030  7848 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:47.139875  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:47.140146  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-2-root
uuid: "7f4ad52824e949ec901a5fd45d492b04"
format_stamp: "Formatted at 2026-07-09 13:00:47 on dist-test-slave-j4mc"
I20260709 13:00:47.140412  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602033297011-7088-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:47.167948  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:47.169181  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:47.170711  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:47.172960  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:47.173156  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:47.173395  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:47.173573  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:47.214643  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.3:33089
I20260709 13:00:47.214744  7910 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.3:33089 every 8 connection(s)
I20260709 13:00:47.228988  7911 heartbeater.cc:344] Connected to a master server at 127.6.236.62:44735
I20260709 13:00:47.229372  7911 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:47.230105  7911 heartbeater.cc:507] Master 127.6.236.62:44735 requested a full tablet report, sending...
I20260709 13:00:47.231935  7635 ts_manager.cc:194] Registered new tserver with Master: 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:47.232738  7088 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015049701s
I20260709 13:00:47.233259  7635 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57188
I20260709 13:00:47.258555  7635 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57192:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:47.261427  7635 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:47.333527  7727 tablet_service.cc:1511] Processing CreateTablet for tablet 299428603ce04ae395d447e24b364ed8 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:47.335124  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299428603ce04ae395d447e24b364ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.343195  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 22551b3ae67e4d3faaee2b1ce7ead8be (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:47.344653  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22551b3ae67e4d3faaee2b1ce7ead8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.347085  7725 tablet_service.cc:1511] Processing CreateTablet for tablet a917af24717e4247ad9152579a0fa31b (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:47.348631  7725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a917af24717e4247ad9152579a0fa31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.350339  7720 tablet_service.cc:1511] Processing CreateTablet for tablet a6aad5ed32dc464a925f7dd1d61f2a5b (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:47.351681  7720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6aad5ed32dc464a925f7dd1d61f2a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.352077  7876 tablet_service.cc:1511] Processing CreateTablet for tablet 299428603ce04ae395d447e24b364ed8 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:47.353359  7876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299428603ce04ae395d447e24b364ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.353307  7875 tablet_service.cc:1511] Processing CreateTablet for tablet 22551b3ae67e4d3faaee2b1ce7ead8be (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:47.353892  7874 tablet_service.cc:1511] Processing CreateTablet for tablet a917af24717e4247ad9152579a0fa31b (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:47.354825  7875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22551b3ae67e4d3faaee2b1ce7ead8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.354504  7724 tablet_service.cc:1511] Processing CreateTablet for tablet 18b9ce871e134981a87217b740e8eb30 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:47.355449  7874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a917af24717e4247ad9152579a0fa31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.355813  7724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b9ce871e134981a87217b740e8eb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.356007  7719 tablet_service.cc:1511] Processing CreateTablet for tablet c926a96c4ccf428f866c4d67aac46f77 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:47.357224  7719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c926a96c4ccf428f866c4d67aac46f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.359781  7722 tablet_service.cc:1511] Processing CreateTablet for tablet bbffd0353bac4cc6969287a2b84afcbc (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:47.361174  7722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbffd0353bac4cc6969287a2b84afcbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.362967  7723 tablet_service.cc:1511] Processing CreateTablet for tablet 29c9f4728f854a66bca480535f1f4b46 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:47.346997  7721 tablet_service.cc:1511] Processing CreateTablet for tablet b9bfc35b39fb4199b80f8eb1c28dcc37 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:47.367496  7873 tablet_service.cc:1511] Processing CreateTablet for tablet 18b9ce871e134981a87217b740e8eb30 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:47.368903  7873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b9ce871e134981a87217b740e8eb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.371152  7872 tablet_service.cc:1511] Processing CreateTablet for tablet 29c9f4728f854a66bca480535f1f4b46 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:47.372502  7872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c9f4728f854a66bca480535f1f4b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.374747  7721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bfc35b39fb4199b80f8eb1c28dcc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.379663  7723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c9f4728f854a66bca480535f1f4b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.396801  7871 tablet_service.cc:1511] Processing CreateTablet for tablet bbffd0353bac4cc6969287a2b84afcbc (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:47.398485  7871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbffd0353bac4cc6969287a2b84afcbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.406129  7870 tablet_service.cc:1511] Processing CreateTablet for tablet b9bfc35b39fb4199b80f8eb1c28dcc37 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:47.407511  7870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bfc35b39fb4199b80f8eb1c28dcc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.411294  7869 tablet_service.cc:1511] Processing CreateTablet for tablet a6aad5ed32dc464a925f7dd1d61f2a5b (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:47.412616  7869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6aad5ed32dc464a925f7dd1d61f2a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.416710  7925 tablet_bootstrap.cc:492] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.428979  7926 tablet_bootstrap.cc:492] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:47.433157  7802 tablet_service.cc:1511] Processing CreateTablet for tablet 299428603ce04ae395d447e24b364ed8 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:47.434633  7802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299428603ce04ae395d447e24b364ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.435811  7721 tablet_service.cc:1511] Processing CreateTablet for tablet 4713bda975a8458eaa97c17121f6360c (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:47.436507  7868 tablet_service.cc:1511] Processing CreateTablet for tablet 4713bda975a8458eaa97c17121f6360c (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:47.437074  7721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4713bda975a8458eaa97c17121f6360c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.437788  7868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4713bda975a8458eaa97c17121f6360c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.439287  7801 tablet_service.cc:1511] Processing CreateTablet for tablet 22551b3ae67e4d3faaee2b1ce7ead8be (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:47.441170  7800 tablet_service.cc:1511] Processing CreateTablet for tablet a917af24717e4247ad9152579a0fa31b (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:47.442037  7872 tablet_service.cc:1511] Processing CreateTablet for tablet c926a96c4ccf428f866c4d67aac46f77 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:47.449780  7872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c926a96c4ccf428f866c4d67aac46f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.445780  7799 tablet_service.cc:1511] Processing CreateTablet for tablet 18b9ce871e134981a87217b740e8eb30 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:47.448189  7797 tablet_service.cc:1511] Processing CreateTablet for tablet bbffd0353bac4cc6969287a2b84afcbc (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:47.455845  7926 tablet_bootstrap.cc:654] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.447033  7798 tablet_service.cc:1511] Processing CreateTablet for tablet 29c9f4728f854a66bca480535f1f4b46 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:47.455315  7796 tablet_service.cc:1511] Processing CreateTablet for tablet b9bfc35b39fb4199b80f8eb1c28dcc37 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:47.458177  7794 tablet_service.cc:1511] Processing CreateTablet for tablet c926a96c4ccf428f866c4d67aac46f77 (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:47.458550  7793 tablet_service.cc:1511] Processing CreateTablet for tablet 4713bda975a8458eaa97c17121f6360c (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:47.455034  7795 tablet_service.cc:1511] Processing CreateTablet for tablet a6aad5ed32dc464a925f7dd1d61f2a5b (DEFAULT_TABLE table=test-workload [id=ca7c024ded704df99c9d936f814ddfcb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:47.446914  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22551b3ae67e4d3faaee2b1ce7ead8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.468592  7797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbffd0353bac4cc6969287a2b84afcbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.469228  7795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6aad5ed32dc464a925f7dd1d61f2a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.469864  7799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b9ce871e134981a87217b740e8eb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.472800  7925 tablet_bootstrap.cc:654] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.474539  7793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4713bda975a8458eaa97c17121f6360c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.476219  7794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c926a96c4ccf428f866c4d67aac46f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.482522  7800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a917af24717e4247ad9152579a0fa31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.486486  7798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c9f4728f854a66bca480535f1f4b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.492326  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bfc35b39fb4199b80f8eb1c28dcc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.525569  7929 tablet_bootstrap.cc:492] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.533739  7926 tablet_bootstrap.cc:492] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:47.537187  7926 ts_tablet_manager.cc:1403] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.000s
I20260709 13:00:47.540074  7926 raft_consensus.cc:359] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.540786  7926 raft_consensus.cc:385] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.541064  7926 raft_consensus.cc:740] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.541265  7929 tablet_bootstrap.cc:654] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.544029  7925 tablet_bootstrap.cc:492] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.544513  7925 ts_tablet_manager.cc:1403] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.128s	user 0.029s	sys 0.018s
I20260709 13:00:47.541813  7926 consensus_queue.cc:260] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.547930  7925 raft_consensus.cc:359] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.548722  7925 raft_consensus.cc:385] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.549027  7925 raft_consensus.cc:740] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.549799  7925 consensus_queue.cc:260] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.551918  7929 tablet_bootstrap.cc:492] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:47.552292  7929 ts_tablet_manager.cc:1403] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.004s
I20260709 13:00:47.554672  7929 raft_consensus.cc:359] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.555084  7911 heartbeater.cc:499] Master 127.6.236.62:44735 was elected leader, sending a full tablet report...
I20260709 13:00:47.555399  7929 raft_consensus.cc:385] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.555686  7926 ts_tablet_manager.cc:1434] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:00:47.555682  7929 raft_consensus.cc:740] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.557102  7926 tablet_bootstrap.cc:492] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:47.556727  7929 consensus_queue.cc:260] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.561637  7762 heartbeater.cc:499] Master 127.6.236.62:44735 was elected leader, sending a full tablet report...
I20260709 13:00:47.562062  7925 ts_tablet_manager.cc:1434] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:00:47.563064  7925 tablet_bootstrap.cc:492] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.569423  7925 tablet_bootstrap.cc:654] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.573273  7837 heartbeater.cc:499] Master 127.6.236.62:44735 was elected leader, sending a full tablet report...
I20260709 13:00:47.573832  7929 ts_tablet_manager.cc:1434] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.013s
I20260709 13:00:47.575013  7929 tablet_bootstrap.cc:492] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.575515  7926 tablet_bootstrap.cc:654] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.581566  7929 tablet_bootstrap.cc:654] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.591768  7925 tablet_bootstrap.cc:492] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.592358  7925 ts_tablet_manager.cc:1403] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.012s
I20260709 13:00:47.592545  7929 tablet_bootstrap.cc:492] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:47.593065  7929 ts_tablet_manager.cc:1403] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.008s
I20260709 13:00:47.595155  7925 raft_consensus.cc:359] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.595943  7925 raft_consensus.cc:385] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.595844  7929 raft_consensus.cc:359] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.596406  7925 raft_consensus.cc:740] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.596638  7929 raft_consensus.cc:385] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.596927  7926 tablet_bootstrap.cc:492] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:47.597033  7929 raft_consensus.cc:740] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.597437  7926 ts_tablet_manager.cc:1403] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.041s	user 0.004s	sys 0.007s
I20260709 13:00:47.597466  7925 consensus_queue.cc:260] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.597851  7929 consensus_queue.cc:260] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.599997  7929 ts_tablet_manager.cc:1434] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:47.600349  7925 ts_tablet_manager.cc:1434] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:47.600452  7926 raft_consensus.cc:359] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.600930  7929 tablet_bootstrap.cc:492] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.601212  7926 raft_consensus.cc:385] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.601392  7925 tablet_bootstrap.cc:492] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.601585  7926 raft_consensus.cc:740] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.602682  7926 consensus_queue.cc:260] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.605123  7926 ts_tablet_manager.cc:1434] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:47.606225  7926 tablet_bootstrap.cc:492] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:47.607614  7929 tablet_bootstrap.cc:654] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.608371  7925 tablet_bootstrap.cc:654] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.612649  7926 tablet_bootstrap.cc:654] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.645344  7929 tablet_bootstrap.cc:492] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:47.645927  7929 ts_tablet_manager.cc:1403] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.017s
I20260709 13:00:47.647740  7926 tablet_bootstrap.cc:492] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:47.648119  7925 tablet_bootstrap.cc:492] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.648211  7926 ts_tablet_manager.cc:1403] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.015s
I20260709 13:00:47.648552  7925 ts_tablet_manager.cc:1403] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.017s
I20260709 13:00:47.648927  7929 raft_consensus.cc:359] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:47.649650  7929 raft_consensus.cc:385] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.649967  7929 raft_consensus.cc:740] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.650756  7925 raft_consensus.cc:359] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.650702  7929 consensus_queue.cc:260] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:47.651085  7926 raft_consensus.cc:359] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.651417  7925 raft_consensus.cc:385] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.651726  7926 raft_consensus.cc:385] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.651834  7925 raft_consensus.cc:740] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.652133  7926 raft_consensus.cc:740] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.652949  7929 ts_tablet_manager.cc:1434] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:47.652832  7925 consensus_queue.cc:260] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.653101  7926 consensus_queue.cc:260] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.653954  7929 tablet_bootstrap.cc:492] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.659283  7926 ts_tablet_manager.cc:1434] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:00:47.660297  7929 tablet_bootstrap.cc:654] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.661966  7925 ts_tablet_manager.cc:1434] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:00:47.663214  7925 tablet_bootstrap.cc:492] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.660311  7926 tablet_bootstrap.cc:492] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:47.669688  7926 tablet_bootstrap.cc:654] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.669690  7925 tablet_bootstrap.cc:654] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.672468  7929 tablet_bootstrap.cc:492] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:47.672889  7929 ts_tablet_manager.cc:1403] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 13:00:47.675495  7926 tablet_bootstrap.cc:492] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:47.675869  7925 tablet_bootstrap.cc:492] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.675631  7929 raft_consensus.cc:359] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.675982  7926 ts_tablet_manager.cc:1403] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:00:47.676276  7929 raft_consensus.cc:385] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.676323  7925 ts_tablet_manager.cc:1403] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:00:47.676596  7929 raft_consensus.cc:740] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.677263  7929 consensus_queue.cc:260] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.679119  7929 ts_tablet_manager.cc:1434] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:47.678963  7926 raft_consensus.cc:359] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.679095  7925 raft_consensus.cc:359] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.680204  7929 tablet_bootstrap.cc:492] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.680172  7926 raft_consensus.cc:385] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.680356  7925 raft_consensus.cc:385] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.680758  7926 raft_consensus.cc:740] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.680824  7925 raft_consensus.cc:740] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.681746  7925 consensus_queue.cc:260] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.681751  7926 consensus_queue.cc:260] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.686489  7925 ts_tablet_manager.cc:1434] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:00:47.686856  7926 ts_tablet_manager.cc:1434] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:00:47.687592  7925 tablet_bootstrap.cc:492] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.687829  7926 tablet_bootstrap.cc:492] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:47.688788  7929 tablet_bootstrap.cc:654] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.694478  7925 tablet_bootstrap.cc:654] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.704010  7933 raft_consensus.cc:493] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.704610  7933 raft_consensus.cc:515] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:47.706193  7926 tablet_bootstrap.cc:654] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.707808  7929 tablet_bootstrap.cc:492] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:47.708350  7929 ts_tablet_manager.cc:1403] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.012s
I20260709 13:00:47.710217  7933 leader_election.cc:290] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:47.711220  7929 raft_consensus.cc:359] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.712167  7929 raft_consensus.cc:385] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.712500  7929 raft_consensus.cc:740] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.713521  7929 consensus_queue.cc:260] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.716032  7929 ts_tablet_manager.cc:1434] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:47.719623  7929 tablet_bootstrap.cc:492] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.732010  7931 raft_consensus.cc:493] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.732820  7929 tablet_bootstrap.cc:654] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.732555  7931 raft_consensus.cc:515] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.736058  7925 tablet_bootstrap.cc:492] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.736644  7925 ts_tablet_manager.cc:1403] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.024s
I20260709 13:00:47.741535  7925 raft_consensus.cc:359] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.746235  7925 raft_consensus.cc:385] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.742844  7931 leader_election.cc:290] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:47.746690  7925 raft_consensus.cc:740] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.748633  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04" is_pre_election: true
I20260709 13:00:47.742915  7929 tablet_bootstrap.cc:492] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
W20260709 13:00:47.750187  7778 leader_election.cc:343] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.750833  7929 ts_tablet_manager.cc:1403] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.002s
I20260709 13:00:47.747555  7925 consensus_queue.cc:260] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.753669  7925 ts_tablet_manager.cc:1434] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:00:47.754760  7929 raft_consensus.cc:359] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.755493  7929 raft_consensus.cc:385] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.756014  7925 tablet_bootstrap.cc:492] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.755923  7929 raft_consensus.cc:740] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.756711  7929 consensus_queue.cc:260] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.759123  7929 ts_tablet_manager.cc:1434] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:47.760058  7929 tablet_bootstrap.cc:492] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.755930  7926 tablet_bootstrap.cc:492] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:47.761539  7926 ts_tablet_manager.cc:1403] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.011s
I20260709 13:00:47.762406  7925 tablet_bootstrap.cc:654] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.762737  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
W20260709 13:00:47.764292  7778 leader_election.cc:343] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.764743  7778 leader_election.cc:304] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b; no voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:47.765913  7929 tablet_bootstrap.cc:654] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.765828  7933 raft_consensus.cc:2749] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.766944  7932 raft_consensus.cc:493] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.767402  7932 raft_consensus.cc:515] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.769650  7926 raft_consensus.cc:359] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.780903  7925 tablet_bootstrap.cc:492] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.781764  7933 raft_consensus.cc:493] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.776527  7931 raft_consensus.cc:493] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.786397  7925 ts_tablet_manager.cc:1403] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.011s
I20260709 13:00:47.786594  7931 raft_consensus.cc:515] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.786468  7933 raft_consensus.cc:515] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.788605  7931 leader_election.cc:290] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:47.788846  7933 leader_election.cc:290] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:47.769980  7932 leader_election.cc:290] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:47.789258  7925 raft_consensus.cc:359] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:47.789984  7925 raft_consensus.cc:385] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.790309  7925 raft_consensus.cc:740] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.791010  7925 consensus_queue.cc:260] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:47.793169  7925 ts_tablet_manager.cc:1434] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:00:47.794098  7925 tablet_bootstrap.cc:492] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.794030  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
I20260709 13:00:47.795545  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b9ce871e134981a87217b740e8eb30" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
W20260709 13:00:47.797075  7852 leader_election.cc:343] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:47.797892  7852 leader_election.cc:343] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.798687  7926 raft_consensus.cc:385] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.799014  7926 raft_consensus.cc:740] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.799752  7926 consensus_queue.cc:260] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.802932  7926 ts_tablet_manager.cc:1434] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:00:47.803898  7926 tablet_bootstrap.cc:492] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:47.820087  7926 tablet_bootstrap.cc:654] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.822695  7929 tablet_bootstrap.cc:492] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:47.822783  7925 tablet_bootstrap.cc:654] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.823251  7929 ts_tablet_manager.cc:1403] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.037s
I20260709 13:00:47.826241  7929 raft_consensus.cc:359] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.826977  7929 raft_consensus.cc:385] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.827301  7929 raft_consensus.cc:740] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.827987  7929 consensus_queue.cc:260] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.831861  7926 tablet_bootstrap.cc:492] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:47.831867  7925 tablet_bootstrap.cc:492] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.832335  7929 ts_tablet_manager.cc:1434] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:00:47.832455  7926 ts_tablet_manager.cc:1403] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.001s
I20260709 13:00:47.832455  7925 ts_tablet_manager.cc:1403] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.012s
I20260709 13:00:47.833375  7929 tablet_bootstrap.cc:492] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.835410  7925 raft_consensus.cc:359] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.835574  7926 raft_consensus.cc:359] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:47.836133  7925 raft_consensus.cc:385] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.836222  7926 raft_consensus.cc:385] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.836472  7925 raft_consensus.cc:740] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.836548  7926 raft_consensus.cc:740] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.837286  7925 consensus_queue.cc:260] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.837248  7926 consensus_queue.cc:260] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:47.839614  7925 ts_tablet_manager.cc:1434] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:00:47.840466  7925 tablet_bootstrap.cc:492] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.842796  7929 tablet_bootstrap.cc:654] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.843595  7926 ts_tablet_manager.cc:1434] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:00:47.844550  7926 tablet_bootstrap.cc:492] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:47.846416  7925 tablet_bootstrap.cc:654] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.850409  7931 raft_consensus.cc:493] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.850909  7931 raft_consensus.cc:515] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.852988  7931 leader_election.cc:290] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:47.854700  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
I20260709 13:00:47.855338  7737 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 0.
I20260709 13:00:47.856350  7852 leader_election.cc:304] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:47.857340  7931 raft_consensus.cc:2804] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.857709  7931 raft_consensus.cc:493] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:47.857944  7683 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:47.858039  7931 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.868134  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c926a96c4ccf428f866c4d67aac46f77" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
I20260709 13:00:47.868889  7737 raft_consensus.cc:2468] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 0.
I20260709 13:00:47.869490  7926 tablet_bootstrap.cc:654] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.871284  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c926a96c4ccf428f866c4d67aac46f77" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04" is_pre_election: true
I20260709 13:00:47.875787  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04" is_pre_election: true
I20260709 13:00:47.872766  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:47.876706  7812 raft_consensus.cc:2468] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 0.
I20260709 13:00:47.877640  7809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:47.878407  7809 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 0.
I20260709 13:00:47.879930  7703 leader_election.cc:304] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:47.878513  7931 raft_consensus.cc:515] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.880860  7932 raft_consensus.cc:2804] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.881314  7932 raft_consensus.cc:493] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.881681  7932 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.884940  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:47.886049  7885 raft_consensus.cc:2393] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 810a084c891e4aa3b4d400603a42fdb0 in current term 1: Already voted for candidate 7f4ad52824e949ec901a5fd45d492b04 in this term.
I20260709 13:00:47.886431  7931 leader_election.cc:290] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:47.873728  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b9ce871e134981a87217b740e8eb30" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:47.888435  7811 raft_consensus.cc:2468] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 0.
I20260709 13:00:47.874642  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:47.889519  7810 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 0.
I20260709 13:00:47.873348  7778 leader_election.cc:304] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:47.890895  7933 raft_consensus.cc:2804] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.891254  7933 raft_consensus.cc:493] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.891619  7933 raft_consensus.cc:3060] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:47.892570  7778 leader_election.cc:343] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.894219  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:47.894847  7810 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.895931  7932 raft_consensus.cc:515] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.897069  7737 raft_consensus.cc:2393] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f4ad52824e949ec901a5fd45d492b04 in current term 1: Already voted for candidate 810a084c891e4aa3b4d400603a42fdb0 in this term.
I20260709 13:00:47.891263  7852 leader_election.cc:304] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:47.899632  7852 leader_election.cc:304] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:47.901221  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:47.901908  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:47.902681  7885 raft_consensus.cc:2393] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 810a084c891e4aa3b4d400603a42fdb0 in current term 1: Already voted for candidate 7f4ad52824e949ec901a5fd45d492b04 in this term.
I20260709 13:00:47.902336  7933 raft_consensus.cc:515] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.904610  7810 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:47.905181  7933 leader_election.cc:290] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:47.906052  7931 raft_consensus.cc:2804] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.906493  7931 raft_consensus.cc:493] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.906405  7703 leader_election.cc:304] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 810a084c891e4aa3b4d400603a42fdb0; no voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:47.906630  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c926a96c4ccf428f866c4d67aac46f77" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:47.899807  7932 leader_election.cc:290] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:47.907297  7737 raft_consensus.cc:3060] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.908773  7931 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.908818  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c926a96c4ccf428f866c4d67aac46f77" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
W20260709 13:00:47.911085  7778 leader_election.cc:343] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.912503  7926 tablet_bootstrap.cc:492] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:47.913820  7925 tablet_bootstrap.cc:492] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.913280  7962 raft_consensus.cc:2804] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.914239  7925 ts_tablet_manager.cc:1403] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.074s	user 0.028s	sys 0.042s
I20260709 13:00:47.914179  7737 raft_consensus.cc:2468] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 1.
I20260709 13:00:47.914548  7962 raft_consensus.cc:493] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.915076  7962 raft_consensus.cc:3060] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.915443  7932 raft_consensus.cc:2749] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.916281  7778 leader_election.cc:304] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:47.914220  7926 ts_tablet_manager.cc:1403] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.070s	user 0.003s	sys 0.009s
I20260709 13:00:47.916970  7925 raft_consensus.cc:359] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.917603  7925 raft_consensus.cc:385] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.913829  7852 leader_election.cc:304] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:47.918985  7931 raft_consensus.cc:515] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.917745  7933 raft_consensus.cc:493] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.919853  7933 raft_consensus.cc:515] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.920742  7925 raft_consensus.cc:740] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.920940  7931 leader_election.cc:290] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:47.921479  7931 raft_consensus.cc:2804] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.921702  7933 leader_election.cc:290] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:47.922268  7933 raft_consensus.cc:2804] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.922179  7925 consensus_queue.cc:260] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.922762  7933 raft_consensus.cc:697] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Becoming Leader. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:47.925534  7925 ts_tablet_manager.cc:1434] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:00:47.921928  7926 raft_consensus.cc:359] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.926424  7925 tablet_bootstrap.cc:492] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:47.926482  7926 raft_consensus.cc:385] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.926944  7926 raft_consensus.cc:740] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.927758  7926 consensus_queue.cc:260] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.921967  7931 raft_consensus.cc:697] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:47.930564  7931 consensus_queue.cc:237] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.931419  7962 raft_consensus.cc:515] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.934544  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:47.936641  7962 leader_election.cc:290] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:47.936213  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b9ce871e134981a87217b740e8eb30" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
W20260709 13:00:47.937572  7852 leader_election.cc:343] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.937992  7736 raft_consensus.cc:3060] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.944304  7736 raft_consensus.cc:2468] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:47.944960  7926 ts_tablet_manager.cc:1434] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:00:47.945531  7852 leader_election.cc:304] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:47.945972  7926 tablet_bootstrap.cc:492] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:47.935182  7925 tablet_bootstrap.cc:654] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.946333  7931 raft_consensus.cc:2804] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.946847  7931 raft_consensus.cc:697] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:47.947207  7632 catalog_manager.cc:5697] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.948350  7931 consensus_queue.cc:237] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.952625  7926 tablet_bootstrap.cc:654] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.923784  7933 consensus_queue.cc:237] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
W20260709 13:00:47.967692  7778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:32907, user_credentials={real_user=slave}} blocked reactor thread for 51494us
W20260709 13:00:47.968719  7703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:45273, user_credentials={real_user=slave}} blocked reactor thread for 62378.2us
I20260709 13:00:47.970758  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6aad5ed32dc464a925f7dd1d61f2a5b" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
I20260709 13:00:47.971995  7925 tablet_bootstrap.cc:492] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:47.972326  7925 ts_tablet_manager.cc:1403] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.007s
I20260709 13:00:47.972805  7736 raft_consensus.cc:2468] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 0.
I20260709 13:00:47.974579  7926 tablet_bootstrap.cc:492] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:47.974869  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:47.975108  7926 ts_tablet_manager.cc:1403] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.004s
I20260709 13:00:47.975458  7810 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.976178  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b9ce871e134981a87217b740e8eb30" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:47.976795  7811 raft_consensus.cc:3060] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.982925  7931 raft_consensus.cc:493] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.983165  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6aad5ed32dc464a925f7dd1d61f2a5b" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04" is_pre_election: true
I20260709 13:00:47.983784  7885 raft_consensus.cc:2468] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 0.
I20260709 13:00:47.983515  7931 raft_consensus.cc:515] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:47.985693  7931 leader_election.cc:290] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:47.985828  7929 tablet_bootstrap.cc:492] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:47.986455  7929 ts_tablet_manager.cc:1403] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.153s	user 0.027s	sys 0.036s
I20260709 13:00:47.986966  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
I20260709 13:00:47.987661  7736 raft_consensus.cc:2468] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 0.
I20260709 13:00:47.989061  7852 leader_election.cc:304] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:47.989012  7929 raft_consensus.cc:359] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.989797  7929 raft_consensus.cc:385] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.990108  7931 raft_consensus.cc:2804] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.990124  7929 raft_consensus.cc:740] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.990674  7931 raft_consensus.cc:493] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.991071  7931 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.991194  7929 consensus_queue.cc:260] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:47.993458  7929 ts_tablet_manager.cc:1434] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:00:47.994376  7929 tablet_bootstrap.cc:492] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:47.997416  7810 raft_consensus.cc:2468] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:47.998562  7931 raft_consensus.cc:515] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:48.001366  7929 tablet_bootstrap.cc:654] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.001833  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:48.002471  7736 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.002833  7926 raft_consensus.cc:359] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.003552  7926 raft_consensus.cc:385] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.003819  7926 raft_consensus.cc:740] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.004514  7926 consensus_queue.cc:260] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.001562  7925 raft_consensus.cc:359] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.012245  7925 raft_consensus.cc:385] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.012576  7925 raft_consensus.cc:740] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.013684  7926 ts_tablet_manager.cc:1434] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:00:48.008560  7811 raft_consensus.cc:2468] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:48.014719  7926 tablet_bootstrap.cc:492] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:48.014190  7778 leader_election.cc:304] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.015683  7963 raft_consensus.cc:2804] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.016031  7963 raft_consensus.cc:493] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.015973  7852 leader_election.cc:304] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:48.016470  7963 raft_consensus.cc:3060] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.018777  7966 raft_consensus.cc:2804] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.019323  7966 raft_consensus.cc:697] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.019963  7925 consensus_queue.cc:260] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.021090  7964 raft_consensus.cc:493] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.021349  7966 consensus_queue.cc:237] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.021590  7964 raft_consensus.cc:515] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.013109  7931 leader_election.cc:290] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:48.024454  7964 leader_election.cc:290] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.025458  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04" is_pre_election: true
I20260709 13:00:48.025465  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:48.031279  7925 ts_tablet_manager.cc:1434] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 13:00:48.032238  7925 tablet_bootstrap.cc:492] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0: Bootstrap starting.
I20260709 13:00:48.023593  7736 raft_consensus.cc:2468] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:48.033792  7963 raft_consensus.cc:515] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
W20260709 13:00:48.034379  7703 leader_election.cc:343] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:48.035751  7703 leader_election.cc:343] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.036136  7703 leader_election.cc:304] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 810a084c891e4aa3b4d400603a42fdb0; no voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:48.037760  7964 raft_consensus.cc:2749] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.039253  7852 leader_election.cc:304] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.039505  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.040094  7926 tablet_bootstrap.cc:654] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.039876  7931 raft_consensus.cc:2804] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.040122  7810 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.041301  7931 raft_consensus.cc:697] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.042181  7931 consensus_queue.cc:237] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:48.039899  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:48.048202  7810 raft_consensus.cc:2468] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:48.051108  7964 raft_consensus.cc:493] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.054212  7964 raft_consensus.cc:515] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.055819  7964 leader_election.cc:290] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.056365  7634 catalog_manager.cc:5697] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3138faa4c28b4d87b97b294489f4504b (127.6.236.2). New cstate: current_term: 1 leader_uuid: "3138faa4c28b4d87b97b294489f4504b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.057910  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04" is_pre_election: true
I20260709 13:00:48.058559  7885 raft_consensus.cc:2468] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 0.
I20260709 13:00:48.059916  7703 leader_election.cc:304] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.060931  7964 raft_consensus.cc:2804] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.061277  7964 raft_consensus.cc:493] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.061589  7964 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.050957  7963 leader_election.cc:290] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.058902  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:48.065322  7929 tablet_bootstrap.cc:492] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:48.065688  7929 ts_tablet_manager.cc:1403] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.002s
I20260709 13:00:48.064759  7931 raft_consensus.cc:493] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.067127  7810 raft_consensus.cc:2468] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 0.
I20260709 13:00:48.067497  7931 raft_consensus.cc:515] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.073789  7931 leader_election.cc:290] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:48.075091  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
I20260709 13:00:48.075794  7736 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 0.
I20260709 13:00:48.076713  7852 leader_election.cc:304] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.077358  7931 raft_consensus.cc:2804] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.077772  7931 raft_consensus.cc:493] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.078147  7931 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.079249  7964 raft_consensus.cc:515] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.080847  7964 leader_election.cc:290] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.082412  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.083164  7885 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.084583  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6aad5ed32dc464a925f7dd1d61f2a5b" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.085160  7886 raft_consensus.cc:3060] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.086396  7632 catalog_manager.cc:5697] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.088593  7632 catalog_manager.cc:5697] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.091413  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6aad5ed32dc464a925f7dd1d61f2a5b" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:48.092219  7736 raft_consensus.cc:3060] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.094662  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:48.095293  7886 raft_consensus.cc:2468] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 1.
W20260709 13:00:48.095877  7852 leader_election.cc:343] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.095875  7929 raft_consensus.cc:359] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.096724  7929 raft_consensus.cc:385] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.097003  7929 raft_consensus.cc:740] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.097097  7778 leader_election.cc:304] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:48.097697  7929 consensus_queue.cc:260] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.097772  7963 raft_consensus.cc:2804] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.090473  7632 catalog_manager.cc:5697] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.098925  7963 raft_consensus.cc:697] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Becoming Leader. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:48.100118  7929 ts_tablet_manager.cc:1434] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:00:48.099725  7963 consensus_queue.cc:237] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.102272  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.103161  7736 raft_consensus.cc:2468] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 1.
I20260709 13:00:48.103543  7810 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.104768  7929 tablet_bootstrap.cc:492] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b: Bootstrap starting.
I20260709 13:00:48.103204  7931 raft_consensus.cc:515] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.107013  7885 raft_consensus.cc:2468] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 1.
I20260709 13:00:48.108182  7703 leader_election.cc:304] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.108976  7964 raft_consensus.cc:2804] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.109413  7964 raft_consensus.cc:697] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:48.109980  7810 raft_consensus.cc:2468] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 1.
I20260709 13:00:48.110630  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:48.111269  7736 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.112746  7925 tablet_bootstrap.cc:654] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.110281  7964 consensus_queue.cc:237] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.120563  7926 tablet_bootstrap.cc:492] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:48.121104  7926 ts_tablet_manager.cc:1403] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.020s
I20260709 13:00:48.113570  7931 leader_election.cc:290] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:48.126241  7926 raft_consensus.cc:359] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.123153  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.130062  7926 raft_consensus.cc:385] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.131215  7926 raft_consensus.cc:740] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.133502  7926 consensus_queue.cc:260] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.130461  7810 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.135288  7632 catalog_manager.cc:5697] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.137111  7633 catalog_manager.cc:5697] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3138faa4c28b4d87b97b294489f4504b (127.6.236.2). New cstate: current_term: 1 leader_uuid: "3138faa4c28b4d87b97b294489f4504b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.128403  7736 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:48.142421  7852 leader_election.cc:304] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.142990  7926 ts_tablet_manager.cc:1434] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:00:48.143273  7931 raft_consensus.cc:2804] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.144062  7925 tablet_bootstrap.cc:492] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0: No bootstrap required, opened a new log
I20260709 13:00:48.144019  7931 raft_consensus.cc:697] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.144614  7925 ts_tablet_manager.cc:1403] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0: Time spent bootstrapping tablet: real 0.113s	user 0.019s	sys 0.014s
I20260709 13:00:48.145172  7931 consensus_queue.cc:237] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.147348  7926 tablet_bootstrap.cc:492] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04: Bootstrap starting.
I20260709 13:00:48.147382  7925 raft_consensus.cc:359] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.149838  7925 raft_consensus.cc:385] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.150132  7925 raft_consensus.cc:740] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.148267  7810 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:48.151731  7925 consensus_queue.cc:260] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.154253  7925 ts_tablet_manager.cc:1434] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:00:48.154671  7929 tablet_bootstrap.cc:654] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.159010  7926 tablet_bootstrap.cc:654] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.163340  7929 tablet_bootstrap.cc:492] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b: No bootstrap required, opened a new log
I20260709 13:00:48.163689  7929 ts_tablet_manager.cc:1403] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.001s
I20260709 13:00:48.164659  7632 catalog_manager.cc:5697] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.165866  7929 raft_consensus.cc:359] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.166579  7929 raft_consensus.cc:385] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.166796  7929 raft_consensus.cc:740] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.167439  7929 consensus_queue.cc:260] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.169342  7929 ts_tablet_manager.cc:1434] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:48.171165  7926 tablet_bootstrap.cc:492] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04: No bootstrap required, opened a new log
I20260709 13:00:48.172123  7926 ts_tablet_manager.cc:1403] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:00:48.175266  7926 raft_consensus.cc:359] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.175930  7926 raft_consensus.cc:385] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.176131  7926 raft_consensus.cc:740] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.176607  7926 consensus_queue.cc:260] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.178401  7926 ts_tablet_manager.cc:1434] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:48.228789  7963 raft_consensus.cc:493] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.229244  7963 raft_consensus.cc:515] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.231295  7963 leader_election.cc:290] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.231940  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4713bda975a8458eaa97c17121f6360c" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
I20260709 13:00:48.232578  7736 raft_consensus.cc:2468] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 0.
I20260709 13:00:48.232867  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4713bda975a8458eaa97c17121f6360c" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04" is_pre_election: true
I20260709 13:00:48.233443  7885 raft_consensus.cc:2468] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 0.
I20260709 13:00:48.233565  7778 leader_election.cc:304] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.234457  7963 raft_consensus.cc:2804] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.234797  7963 raft_consensus.cc:493] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.235092  7963 raft_consensus.cc:3060] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.239598  7963 raft_consensus.cc:515] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.241156  7963 leader_election.cc:290] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.241847  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4713bda975a8458eaa97c17121f6360c" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:48.242193  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4713bda975a8458eaa97c17121f6360c" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.242436  7736 raft_consensus.cc:3060] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.242699  7885 raft_consensus.cc:3060] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.249011  7736 raft_consensus.cc:2468] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 1.
I20260709 13:00:48.249011  7885 raft_consensus.cc:2468] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 1.
I20260709 13:00:48.250285  7778 leader_election.cc:304] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:48.250952  7963 raft_consensus.cc:2804] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.251394  7963 raft_consensus.cc:697] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Becoming Leader. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:48.252053  7963 consensus_queue.cc:237] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.258876  7632 catalog_manager.cc:5697] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3138faa4c28b4d87b97b294489f4504b (127.6.236.2). New cstate: current_term: 1 leader_uuid: "3138faa4c28b4d87b97b294489f4504b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.315174  7931 raft_consensus.cc:493] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.315989  7931 raft_consensus.cc:515] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.317615  7931 leader_election.cc:290] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:48.318442  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0" is_pre_election: true
I20260709 13:00:48.318595  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:48.318938  7736 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 0.
I20260709 13:00:48.319115  7810 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 0.
I20260709 13:00:48.319872  7852 leader_election.cc:304] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.320639  7931 raft_consensus.cc:2804] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.320926  7931 raft_consensus.cc:493] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.321177  7931 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.325937  7931 raft_consensus.cc:515] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.327590  7931 leader_election.cc:290] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:48.328392  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:48.328678  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.328892  7736 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.329171  7810 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.333777  7736 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:48.333858  7810 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 1.
I20260709 13:00:48.334815  7852 leader_election.cc:304] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.335752  7931 raft_consensus.cc:2804] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.336175  7931 raft_consensus.cc:697] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.336839  7931 consensus_queue.cc:237] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.344055  7632 catalog_manager.cc:5697] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.373154  7963 consensus_queue.cc:1048] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.382349  7885 raft_consensus.cc:3060] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.390019  7963 consensus_queue.cc:1048] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.392824  7966 consensus_queue.cc:1048] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.405357  7962 consensus_queue.cc:1048] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.431471  7964 raft_consensus.cc:493] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.431902  7964 raft_consensus.cc:515] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.433487  7964 leader_election.cc:290] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.434435  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3138faa4c28b4d87b97b294489f4504b" is_pre_election: true
I20260709 13:00:48.434600  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4ad52824e949ec901a5fd45d492b04" is_pre_election: true
I20260709 13:00:48.435093  7810 raft_consensus.cc:2393] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 810a084c891e4aa3b4d400603a42fdb0 in current term 1: Already voted for candidate 7f4ad52824e949ec901a5fd45d492b04 in this term.
I20260709 13:00:48.436065  7703 leader_election.cc:304] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 810a084c891e4aa3b4d400603a42fdb0; no voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:48.436687  7964 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.441779  7964 raft_consensus.cc:2749] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.461719  7885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "299428603ce04ae395d447e24b364ed8"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:32972
I20260709 13:00:48.462345  7885 raft_consensus.cc:606] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:48.462440  7962 consensus_queue.cc:1048] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.468503  7885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:32972
I20260709 13:00:48.469118  7885 raft_consensus.cc:606] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:48.476182  7885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:32972
I20260709 13:00:48.476876  7885 raft_consensus.cc:606] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:48.477138  7965 consensus_queue.cc:1048] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:48.483059  7885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18b9ce871e134981a87217b740e8eb30"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:32972
I20260709 13:00:48.483752  7885 raft_consensus.cc:606] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:48.485301  7965 consensus_queue.cc:1048] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.488191  7965 consensus_queue.cc:1048] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.490839  7885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:32972
I20260709 13:00:48.491423  7885 raft_consensus.cc:606] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:48.497337  7885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
mode: GRACEFUL
new_leader_uuid: "3138faa4c28b4d87b97b294489f4504b"
 from {username='slave'} at 127.0.0.1:32972
I20260709 13:00:48.497923  7885 raft_consensus.cc:606] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Received request to transfer leadership to TS 3138faa4c28b4d87b97b294489f4504b
I20260709 13:00:48.498003  7965 raft_consensus.cc:993] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.503816  7962 raft_consensus.cc:1081] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.508867  7966 raft_consensus.cc:993] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.509306  7966 raft_consensus.cc:1081] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.511999  7737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60052
I20260709 13:00:48.512063  7736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "299428603ce04ae395d447e24b364ed8"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60052
I20260709 13:00:48.512594  7737 raft_consensus.cc:493] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.512696  7736 raft_consensus.cc:493] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.513104  7736 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.515409  7962 consensus_queue.cc:1048] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.519553  7931 consensus_queue.cc:1048] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.520326  7736 raft_consensus.cc:515] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:48.523144  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.523762  7885 raft_consensus.cc:3055] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.524057  7885 raft_consensus.cc:740] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.524861  7885 consensus_queue.cc:260] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:48.525271  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.525911  7811 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.523147  7736 leader_election.cc:290] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Requested vote from peers 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:48.526899  7737 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.525924  7885 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.533589  7737 raft_consensus.cc:515] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.537914  7737 leader_election.cc:290] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.539713  7811 raft_consensus.cc:2468] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.540249  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.541342  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.544441  7886 raft_consensus.cc:3055] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.543816  7885 raft_consensus.cc:2468] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.544732  7810 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.544773  7886 raft_consensus.cc:740] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.545195  7962 raft_consensus.cc:993] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.548643  7703 leader_election.cc:304] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.548847  7886 consensus_queue.cc:260] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.548861  7962 raft_consensus.cc:1081] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.549979  7964 raft_consensus.cc:2804] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.551656  7964 raft_consensus.cc:697] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:48.552512  7964 consensus_queue.cc:237] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:48.553347  7886 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.554526  7810 raft_consensus.cc:2468] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.555967  7703 leader_election.cc:304] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.557042  7964 raft_consensus.cc:2804] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.557683  7964 raft_consensus.cc:697] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:48.558341  7737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18b9ce871e134981a87217b740e8eb30"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60052
I20260709 13:00:48.558528  7735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
mode: GRACEFUL
new_leader_uuid: "3138faa4c28b4d87b97b294489f4504b"
 from {username='slave'} at 127.0.0.1:60066
I20260709 13:00:48.558488  7964 consensus_queue.cc:237] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.558976  7737 raft_consensus.cc:493] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.559162  7735 raft_consensus.cc:606] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 LEADER]: Received request to transfer leadership to TS 3138faa4c28b4d87b97b294489f4504b
I20260709 13:00:48.559381  7737 raft_consensus.cc:3060] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.560103  7886 raft_consensus.cc:2468] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.565747  7737 raft_consensus.cc:515] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.565943  7632 catalog_manager.cc:5697] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 1 to 2, leader changed from 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.567734  7737 leader_election.cc:290] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.568632  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b9ce871e134981a87217b740e8eb30" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.569154  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b9ce871e134981a87217b740e8eb30" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.569783  7886 raft_consensus.cc:3055] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.570150  7886 raft_consensus.cc:740] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.570901  7886 consensus_queue.cc:260] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.571930  7886 raft_consensus.cc:3060] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.569176  7810 raft_consensus.cc:3060] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.578394  7886 raft_consensus.cc:2468] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.580052  7703 leader_election.cc:304] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.580725  7964 raft_consensus.cc:2804] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.581192  7964 raft_consensus.cc:697] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:48.581707  7810 raft_consensus.cc:2468] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.581950  7964 consensus_queue.cc:237] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.583266  7632 catalog_manager.cc:5697] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 1 to 2, leader changed from 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.596927  7810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4713bda975a8458eaa97c17121f6360c"
dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
mode: GRACEFUL
new_leader_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:51782
I20260709 13:00:48.597424  7810 raft_consensus.cc:606] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Received request to transfer leadership to TS 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:48.597281  7632 catalog_manager.cc:5697] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 1 to 2, leader changed from 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.621058  7963 consensus_queue.cc:1048] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.621618  7962 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.629146  7931 raft_consensus.cc:993] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.629633  7966 raft_consensus.cc:1081] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.635876  7735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60052
I20260709 13:00:48.636559  7735 raft_consensus.cc:493] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.636948  7735 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.638912  7962 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.637840  7963 consensus_queue.cc:1048] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:48.647146  7735 raft_consensus.cc:515] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.651105  7735 leader_election.cc:290] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.651994  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.652132  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.652594  7810 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.652761  7886 raft_consensus.cc:3055] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.653143  7886 raft_consensus.cc:740] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.654135  7886 consensus_queue.cc:260] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.655365  7886 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.659490  7810 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.662218  7886 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.662968  7703 leader_election.cc:304] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.663758  7964 raft_consensus.cc:2804] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.664223  7964 raft_consensus.cc:697] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:48.664986  7964 consensus_queue.cc:237] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.671346  7632 catalog_manager.cc:5697] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 1 to 2, leader changed from 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.681721  7964 consensus_queue.cc:1048] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.689044  7932 raft_consensus.cc:993] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0: : Instructing follower 3138faa4c28b4d87b97b294489f4504b to start an election
I20260709 13:00:48.689576  7964 raft_consensus.cc:1081] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 LEADER]: Signalling peer 3138faa4c28b4d87b97b294489f4504b to start an election
I20260709 13:00:48.691896  7811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37"
dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
 from {username='slave'} at 127.0.0.1:51760
I20260709 13:00:48.692791  7932 consensus_queue.cc:1048] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.692976  7811 raft_consensus.cc:493] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.693459  7811 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.700284  7811 raft_consensus.cc:515] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.702198  7811 leader_election.cc:290] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 2 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.703318  7735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:48.703827  7735 raft_consensus.cc:3055] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.704175  7735 raft_consensus.cc:740] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:48.704664  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.705255  7886 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.704941  7735 consensus_queue.cc:260] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.706358  7735 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.710626  7886 raft_consensus.cc:2468] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 2.
I20260709 13:00:48.711843  7778 leader_election.cc:304] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:48.712482  7933 raft_consensus.cc:2804] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.712575  7735 raft_consensus.cc:2468] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 2.
I20260709 13:00:48.713018  7933 raft_consensus.cc:697] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Becoming Leader. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:48.713809  7933 consensus_queue.cc:237] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.719566  7635 catalog_manager.cc:5697] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b reported cstate change: term changed from 1 to 2, leader changed from 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1) to 3138faa4c28b4d87b97b294489f4504b (127.6.236.2). New cstate: current_term: 2 leader_uuid: "3138faa4c28b4d87b97b294489f4504b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.793821  7933 consensus_queue.cc:1048] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.803332  7963 consensus_queue.cc:1048] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.815691  8013 raft_consensus.cc:993] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b: : Instructing follower 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:48.816174  7963 raft_consensus.cc:1081] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Signalling peer 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:48.817695  7886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4713bda975a8458eaa97c17121f6360c"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:32952
I20260709 13:00:48.818190  7886 raft_consensus.cc:493] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.818480  7886 raft_consensus.cc:3060] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.822806  7886 raft_consensus.cc:515] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.824465  7886 leader_election.cc:290] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 2 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:48.825503  7735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4713bda975a8458eaa97c17121f6360c" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:48.826107  7735 raft_consensus.cc:3060] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.826171  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4713bda975a8458eaa97c17121f6360c" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.826802  7811 raft_consensus.cc:3055] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.827131  7811 raft_consensus.cc:740] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:48.827885  7811 consensus_queue.cc:260] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.828883  7962 raft_consensus.cc:993] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.829135  7811 raft_consensus.cc:3060] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.829290  7962 raft_consensus.cc:1081] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:48.831455  7737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60052
I20260709 13:00:48.832017  7737 raft_consensus.cc:493] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.832401  7737 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.832582  7735 raft_consensus.cc:2468] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 2.
I20260709 13:00:48.833752  7852 leader_election.cc:304] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.834474  7962 raft_consensus.cc:2804] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.834874  7962 raft_consensus.cc:697] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 2 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.835829  7811 raft_consensus.cc:2468] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 2.
I20260709 13:00:48.835687  7962 consensus_queue.cc:237] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.838737  7737 raft_consensus.cc:515] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.840711  7737 leader_election.cc:290] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.841615  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:48.841849  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.842213  7811 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.842412  7886 raft_consensus.cc:3055] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.842811  7886 raft_consensus.cc:740] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.843484  7886 consensus_queue.cc:260] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.844354  7886 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.843689  7635 catalog_manager.cc:5697] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 1 to 2, leader changed from 3138faa4c28b4d87b97b294489f4504b (127.6.236.2) to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.848251  7811 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.849171  7703 leader_election.cc:304] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.849792  7964 raft_consensus.cc:2804] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.850344  7964 raft_consensus.cc:697] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:48.850595  7886 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:48.851145  7964 consensus_queue.cc:237] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.857626  7635 catalog_manager.cc:5697] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 1 to 2, leader changed from 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.888216  7962 consensus_queue.cc:1048] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.899248  7965 consensus_queue.cc:1048] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.906222  7966 raft_consensus.cc:993] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04: : Instructing follower 3138faa4c28b4d87b97b294489f4504b to start an election
I20260709 13:00:48.906649  7965 raft_consensus.cc:1081] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Signalling peer 3138faa4c28b4d87b97b294489f4504b to start an election
I20260709 13:00:48.908088  7811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc"
dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
 from {username='slave'} at 127.0.0.1:51770
I20260709 13:00:48.908617  7811 raft_consensus.cc:493] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.908910  7811 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.913364  7811 raft_consensus.cc:515] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.915165  7811 leader_election.cc:290] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 2 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:48.915982  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:48.916149  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:48.916586  7737 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.916661  7886 raft_consensus.cc:3055] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.917060  7886 raft_consensus.cc:740] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:48.917809  7886 consensus_queue.cc:260] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.919008  7886 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.923363  7737 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 2.
I20260709 13:00:48.924516  7778 leader_election.cc:304] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:48.925171  7963 raft_consensus.cc:2804] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.925160  7886 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 2.
I20260709 13:00:48.925789  7963 raft_consensus.cc:697] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Becoming Leader. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:48.926681  7963 consensus_queue.cc:237] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:48.932320  7632 catalog_manager.cc:5697] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b reported cstate change: term changed from 1 to 2, leader changed from 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3) to 3138faa4c28b4d87b97b294489f4504b (127.6.236.2). New cstate: current_term: 2 leader_uuid: "3138faa4c28b4d87b97b294489f4504b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.977074  7886 raft_consensus.cc:1275] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.978420  7964 consensus_queue.cc:1048] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.986213  7811 raft_consensus.cc:1275] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.988483  7810 raft_consensus.cc:1275] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.990696  7964 consensus_queue.cc:1048] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:48.990986  8010 consensus_queue.cc:1048] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.002267  7886 raft_consensus.cc:1275] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.003512  7964 consensus_queue.cc:1048] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.054597  7886 raft_consensus.cc:1275] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.055694  7964 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.061810  7810 raft_consensus.cc:1275] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.064028  7932 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.149609  7886 raft_consensus.cc:1275] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.151026  7932 consensus_queue.cc:1048] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.159860  7810 raft_consensus.cc:1275] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.161223  7964 consensus_queue.cc:1048] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.223419  7810 raft_consensus.cc:1275] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.224759  7965 consensus_queue.cc:1048] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.232445  7737 raft_consensus.cc:1275] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.234090  7962 consensus_queue.cc:1048] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.301674  7886 raft_consensus.cc:1275] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Refusing update from remote peer 3138faa4c28b4d87b97b294489f4504b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.302819  7963 consensus_queue.cc:1048] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.310139  7737 raft_consensus.cc:1275] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Refusing update from remote peer 3138faa4c28b4d87b97b294489f4504b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.311698  7963 consensus_queue.cc:1048] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.383561  7737 raft_consensus.cc:1275] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Refusing update from remote peer 3138faa4c28b4d87b97b294489f4504b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.384902  7963 consensus_queue.cc:1048] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.391894  7886 raft_consensus.cc:1275] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Refusing update from remote peer 3138faa4c28b4d87b97b294489f4504b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.393743  7963 consensus_queue.cc:1048] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.433512  7810 raft_consensus.cc:1275] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.434762  7964 consensus_queue.cc:1048] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.447197  7886 raft_consensus.cc:1275] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.448669  7964 consensus_queue.cc:1048] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:51.630112  7088 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:00:51.630810  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:51.647264  7737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
mode: GRACEFUL
new_leader_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:00:51.647827  7737 raft_consensus.cc:606] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Received request to transfer leadership to TS 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:51.650156  7737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
mode: GRACEFUL
new_leader_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:00:51.650628  7737 raft_consensus.cc:606] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Received request to transfer leadership to TS 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:51.651593  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:51.652047  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:51.888443  8024 raft_consensus.cc:993] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0: : Instructing follower 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:51.888883  8021 raft_consensus.cc:1081] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Signalling peer 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:51.890288  7886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:32968
I20260709 13:00:51.890736  7886 raft_consensus.cc:493] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.891026  7886 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.895995  7886 raft_consensus.cc:515] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:51.897550  7886 leader_election.cc:290] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 3 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:51.898659  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:51.898763  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:51.899262  7810 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.899421  7737 raft_consensus.cc:3055] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:51.899788  7737 raft_consensus.cc:740] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:51.900556  7737 consensus_queue.cc:260] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:51.901754  7737 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.903278  7810 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 3.
I20260709 13:00:51.904238  7852 leader_election.cc:304] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:51.904894  8022 raft_consensus.cc:2804] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.905866  8022 raft_consensus.cc:697] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:51.906670  8022 consensus_queue.cc:237] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:51.908382  7737 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 3.
I20260709 13:00:51.914067  7632 catalog_manager.cc:5697] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 2 to 3, leader changed from 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1) to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.133024  8024 raft_consensus.cc:993] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0: : Instructing follower 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:52.133399  8021 raft_consensus.cc:1081] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Signalling peer 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:52.134696  7886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:32968
I20260709 13:00:52.135088  7886 raft_consensus.cc:493] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.135371  7886 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.139729  7886 raft_consensus.cc:515] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.141137  7886 leader_election.cc:290] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 3 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:52.141917  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:52.142176  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:52.142469  7737 raft_consensus.cc:3055] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.142684  7810 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.142822  7737 raft_consensus.cc:740] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:52.143510  7737 consensus_queue.cc:260] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.144356  7737 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.147193  7810 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 3.
I20260709 13:00:52.148705  7852 leader_election.cc:304] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:52.149580  8022 raft_consensus.cc:2804] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.150100  8022 raft_consensus.cc:697] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:52.150370  7737 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 3.
I20260709 13:00:52.150918  8022 consensus_queue.cc:237] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.157371  7632 catalog_manager.cc:5697] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 2 to 3, leader changed from 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1) to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.362562  7737 raft_consensus.cc:1275] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.363727  8022 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.372782  7810 raft_consensus.cc:1275] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.374316  8022 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.652842  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:52.658864  7810 raft_consensus.cc:1275] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.660256  8022 consensus_queue.cc:1048] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.668643  7737 raft_consensus.cc:1275] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.670321  8027 consensus_queue.cc:1048] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.672173  7886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:32972
I20260709 13:00:52.672727  7886 raft_consensus.cc:606] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:52.678570  8022 raft_consensus.cc:993] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.678977  8027 raft_consensus.cc:1081] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.680665  7737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60052
I20260709 13:00:52.681213  7737 raft_consensus.cc:493] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.681485  7737 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.684319  7886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:32972
I20260709 13:00:52.684789  7886 raft_consensus.cc:606] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:52.686746  7737 raft_consensus.cc:515] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.688242  7737 leader_election.cc:290] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 4 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:52.688973  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:52.689529  7810 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.689610  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a917af24717e4247ad9152579a0fa31b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:52.690130  7886 raft_consensus.cc:3055] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:52.690351  7886 raft_consensus.cc:740] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:52.690965  7886 consensus_queue.cc:260] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.691738  7886 raft_consensus.cc:3060] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.694815  7810 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 4.
I20260709 13:00:52.695724  7703 leader_election.cc:304] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:52.695963  7886 raft_consensus.cc:2468] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 4.
I20260709 13:00:52.696466  8024 raft_consensus.cc:2804] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:52.696864  8024 raft_consensus.cc:697] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 4 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:52.697540  8024 consensus_queue.cc:237] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.698169  7810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc"
dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:51782
I20260709 13:00:52.698685  7810 raft_consensus.cc:606] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:52.704304  7634 catalog_manager.cc:5697] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 3 to 4, leader changed from 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 4 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.705183  7810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37"
dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:51782
I20260709 13:00:52.705667  7810 raft_consensus.cc:606] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:52.711347  7810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6aad5ed32dc464a925f7dd1d61f2a5b"
dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
mode: GRACEFUL
new_leader_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:51782
I20260709 13:00:52.711944  7810 raft_consensus.cc:606] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Received request to transfer leadership to TS 810a084c891e4aa3b4d400603a42fdb0
I20260709 13:00:52.718969  8045 raft_consensus.cc:993] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.719425  7963 raft_consensus.cc:1081] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.720786  7737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:00:52.721262  7737 raft_consensus.cc:493] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.721546  7737 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.725898  7737 raft_consensus.cc:515] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.727353  7737 leader_election.cc:290] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 3 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:52.728008  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:52.728507  7810 raft_consensus.cc:3055] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.728396  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfc35b39fb4199b80f8eb1c28dcc37" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:52.728818  7810 raft_consensus.cc:740] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:52.728989  7886 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.729537  7810 consensus_queue.cc:260] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.730801  7810 raft_consensus.cc:3060] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.735106  7886 raft_consensus.cc:2468] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 3.
I20260709 13:00:52.736198  7703 leader_election.cc:304] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:52.736686  7810 raft_consensus.cc:2468] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 3.
I20260709 13:00:52.736999  8024 raft_consensus.cc:2804] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.737469  8024 raft_consensus.cc:697] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:52.738250  8024 consensus_queue.cc:237] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.739631  8045 raft_consensus.cc:993] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.740061  7963 raft_consensus.cc:1081] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.742026  7737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6aad5ed32dc464a925f7dd1d61f2a5b"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:00:52.742647  7737 raft_consensus.cc:493] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.742990  7737 raft_consensus.cc:3060] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.746501  7634 catalog_manager.cc:5697] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 2 to 3, leader changed from 3138faa4c28b4d87b97b294489f4504b (127.6.236.2) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 3 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.749003  7737 raft_consensus.cc:515] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.750736  7737 leader_election.cc:290] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:52.751385  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6aad5ed32dc464a925f7dd1d61f2a5b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:52.751647  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6aad5ed32dc464a925f7dd1d61f2a5b" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:52.751947  7810 raft_consensus.cc:3055] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:52.752118  7886 raft_consensus.cc:3060] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.752688  7810 raft_consensus.cc:740] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:52.753448  7810 consensus_queue.cc:260] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.754640  7810 raft_consensus.cc:3060] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.757632  7886 raft_consensus.cc:2468] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:52.758533  7703 leader_election.cc:304] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:52.759168  7810 raft_consensus.cc:2468] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 2.
I20260709 13:00:52.759238  8024 raft_consensus.cc:2804] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:52.759855  8024 raft_consensus.cc:697] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:52.760804  8024 consensus_queue.cc:237] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.766997  7634 catalog_manager.cc:5697] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 1 to 2, leader changed from 3138faa4c28b4d87b97b294489f4504b (127.6.236.2) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.783258  8045 raft_consensus.cc:993] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.783636  7963 raft_consensus.cc:1081] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.784986  7737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:00:52.785414  7737 raft_consensus.cc:493] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.785696  7737 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.790014  7737 raft_consensus.cc:515] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.791395  7737 leader_election.cc:290] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 3 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:52.792341  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:52.792492  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:52.792773  7810 raft_consensus.cc:3055] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.793251  7810 raft_consensus.cc:740] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:52.793293  7886 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.793854  7810 consensus_queue.cc:260] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.794683  7810 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.797410  7886 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 3.
I20260709 13:00:52.798368  7703 leader_election.cc:304] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4ad52824e949ec901a5fd45d492b04, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:52.799149  7810 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 3.
I20260709 13:00:52.799312  8024 raft_consensus.cc:2804] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.800087  8024 raft_consensus.cc:697] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 3 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:52.800880  8024 consensus_queue.cc:237] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.807142  7634 catalog_manager.cc:5697] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 2 to 3, leader changed from 3138faa4c28b4d87b97b294489f4504b (127.6.236.2) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 3 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.933954  8022 raft_consensus.cc:993] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04: : Instructing follower 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.934391  8027 raft_consensus.cc:1081] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Signalling peer 810a084c891e4aa3b4d400603a42fdb0 to start an election
I20260709 13:00:52.935653  7737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
 from {username='slave'} at 127.0.0.1:60052
I20260709 13:00:52.936048  7737 raft_consensus.cc:493] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.936288  7737 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.940176  7737 raft_consensus.cc:515] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.941506  7737 leader_election.cc:290] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 4 election: Requested vote from peers 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:52.942268  7810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:52.942576  7886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "810a084c891e4aa3b4d400603a42fdb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:52.942811  7810 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.943054  7886 raft_consensus.cc:3055] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:52.943329  7886 raft_consensus.cc:740] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:52.943994  7886 consensus_queue.cc:260] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.945027  7886 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.948630  7810 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 4.
I20260709 13:00:52.949739  7703 leader_election.cc:304] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 810a084c891e4aa3b4d400603a42fdb0; no voters: 
I20260709 13:00:52.950410  8024 raft_consensus.cc:2804] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:52.950443  7886 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810a084c891e4aa3b4d400603a42fdb0 in term 4.
I20260709 13:00:52.950922  8024 raft_consensus.cc:697] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 4 LEADER]: Becoming Leader. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:52.951747  8024 consensus_queue.cc:237] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:52.957661  7634 catalog_manager.cc:5697] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 reported cstate change: term changed from 3 to 4, leader changed from 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3) to 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1). New cstate: current_term: 4 leader_uuid: "810a084c891e4aa3b4d400603a42fdb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.173194  7886 raft_consensus.cc:1275] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:53.174435  8024 consensus_queue.cc:1048] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.186800  7810 raft_consensus.cc:1275] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:53.187947  7811 raft_consensus.cc:1275] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:53.189453  8024 consensus_queue.cc:1048] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.189535  8052 consensus_queue.cc:1048] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.189833  7811 raft_consensus.cc:1275] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:53.191642  8052 consensus_queue.cc:1048] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.202050  7886 raft_consensus.cc:1275] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:53.204180  7812 raft_consensus.cc:1275] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:53.204461  7886 raft_consensus.cc:1275] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:53.207393  8051 consensus_queue.cc:1048] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.208117  8021 consensus_queue.cc:1048] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.207787  8052 consensus_queue.cc:1048] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:00:53.229801  7885 raft_consensus.cc:1275] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:53.231195  8021 consensus_queue.cc:1048] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.400152  7886 raft_consensus.cc:1275] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:53.401175  8021 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.410051  7810 raft_consensus.cc:1275] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Refusing update from remote peer 810a084c891e4aa3b4d400603a42fdb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:53.411399  8024 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:55.720752  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:55.728996  7737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
mode: GRACEFUL
new_leader_uuid: "3138faa4c28b4d87b97b294489f4504b"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:00:55.729601  7737 raft_consensus.cc:606] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Received request to transfer leadership to TS 3138faa4c28b4d87b97b294489f4504b
I20260709 13:00:55.732170  7737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "299428603ce04ae395d447e24b364ed8"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
mode: GRACEFUL
new_leader_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:00:55.732573  7737 raft_consensus.cc:606] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Received request to transfer leadership to TS 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:55.734647  7737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
mode: GRACEFUL
new_leader_uuid: "3138faa4c28b4d87b97b294489f4504b"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:00:55.735037  7737 raft_consensus.cc:606] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 4 LEADER]: Received request to transfer leadership to TS 3138faa4c28b4d87b97b294489f4504b
I20260709 13:00:55.737031  7737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc"
dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
mode: GRACEFUL
new_leader_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:00:55.737422  7737 raft_consensus.cc:606] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 3 LEADER]: Received request to transfer leadership to TS 7f4ad52824e949ec901a5fd45d492b04
I20260709 13:00:55.738401  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:55.738807  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:55.838853  8051 raft_consensus.cc:993] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0: : Instructing follower 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:55.839411  8063 raft_consensus.cc:1081] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Signalling peer 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:55.840850  7885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "299428603ce04ae395d447e24b364ed8"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:32968
I20260709 13:00:55.841303  7885 raft_consensus.cc:493] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:55.841605  7885 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.847189  7885 raft_consensus.cc:515] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:55.848912  7885 leader_election.cc:290] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 3 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:55.849857  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:55.850605  7737 raft_consensus.cc:3055] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:55.850572  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299428603ce04ae395d447e24b364ed8" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:55.851075  7737 raft_consensus.cc:740] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:55.851322  7811 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.851861  7737 consensus_queue.cc:260] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:55.852873  7737 raft_consensus.cc:3060] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.858384  7811 raft_consensus.cc:2468] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 3.
I20260709 13:00:55.858724  7737 raft_consensus.cc:2468] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 3.
I20260709 13:00:55.859827  7852 leader_election.cc:304] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:55.860731  8022 raft_consensus.cc:2804] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:55.861675  8022 raft_consensus.cc:697] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:55.862535  8022 consensus_queue.cc:237] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } }
I20260709 13:00:55.871023  7634 catalog_manager.cc:5697] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 2 to 3, leader changed from 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1) to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.978845  8063 raft_consensus.cc:993] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0: : Instructing follower 3138faa4c28b4d87b97b294489f4504b to start an election
I20260709 13:00:55.979269  8051 raft_consensus.cc:1081] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Signalling peer 3138faa4c28b4d87b97b294489f4504b to start an election
I20260709 13:00:55.980685  7811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be"
dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
 from {username='slave'} at 127.0.0.1:51760
I20260709 13:00:55.981158  7811 raft_consensus.cc:493] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:55.981429  7811 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.985816  7811 raft_consensus.cc:515] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:55.987506  7811 leader_election.cc:290] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 3 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:55.988329  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:55.988579  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22551b3ae67e4d3faaee2b1ce7ead8be" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:55.988837  7737 raft_consensus.cc:3055] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:55.989043  7885 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.989097  7737 raft_consensus.cc:740] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:55.989871  7737 consensus_queue.cc:260] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:55.991032  7737 raft_consensus.cc:3060] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.993865  7885 raft_consensus.cc:2468] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 3.
I20260709 13:00:55.995040  7778 leader_election.cc:304] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:55.995424  7737 raft_consensus.cc:2468] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 3.
I20260709 13:00:55.995967  8064 raft_consensus.cc:2804] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:55.997061  8064 raft_consensus.cc:697] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 3 LEADER]: Becoming Leader. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:55.997788  8064 consensus_queue.cc:237] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:56.004516  7634 catalog_manager.cc:5697] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b reported cstate change: term changed from 2 to 3, leader changed from 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1) to 3138faa4c28b4d87b97b294489f4504b (127.6.236.2). New cstate: current_term: 3 leader_uuid: "3138faa4c28b4d87b97b294489f4504b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.115574  8063 raft_consensus.cc:993] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0: : Instructing follower 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:56.116050  8051 raft_consensus.cc:1081] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 3 LEADER]: Signalling peer 7f4ad52824e949ec901a5fd45d492b04 to start an election
I20260709 13:00:56.117376  7885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc"
dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
 from {username='slave'} at 127.0.0.1:32968
I20260709 13:00:56.117820  7885 raft_consensus.cc:493] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:56.118108  7885 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:56.122640  7885 raft_consensus.cc:515] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:56.124202  7885 leader_election.cc:290] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 4 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 3138faa4c28b4d87b97b294489f4504b (127.6.236.2:45273)
I20260709 13:00:56.125097  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:56.125308  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbffd0353bac4cc6969287a2b84afcbc" candidate_uuid: "7f4ad52824e949ec901a5fd45d492b04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
I20260709 13:00:56.125666  7737 raft_consensus.cc:3055] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:56.125811  7811 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:56.126000  7737 raft_consensus.cc:740] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:56.126924  7737 consensus_queue.cc:260] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:56.128057  7737 raft_consensus.cc:3060] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:56.132676  7811 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 4.
I20260709 13:00:56.134016  7737 raft_consensus.cc:2468] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4ad52824e949ec901a5fd45d492b04 in term 4.
I20260709 13:00:56.133970  7852 leader_election.cc:304] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:56.134958  8022 raft_consensus.cc:2804] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:56.135330  8022 raft_consensus.cc:697] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 4 LEADER]: Becoming Leader. State: Replica: 7f4ad52824e949ec901a5fd45d492b04, State: Running, Role: LEADER
I20260709 13:00:56.136004  8022 consensus_queue.cc:237] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:56.143357  7634 catalog_manager.cc:5697] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 reported cstate change: term changed from 3 to 4, leader changed from 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1) to 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3). New cstate: current_term: 4 leader_uuid: "7f4ad52824e949ec901a5fd45d492b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.151113  8051 raft_consensus.cc:993] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0: : Instructing follower 3138faa4c28b4d87b97b294489f4504b to start an election
I20260709 13:00:56.151535  8063 raft_consensus.cc:1081] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 4 LEADER]: Signalling peer 3138faa4c28b4d87b97b294489f4504b to start an election
I20260709 13:00:56.153303  7811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46"
dest_uuid: "3138faa4c28b4d87b97b294489f4504b"
 from {username='slave'} at 127.0.0.1:51760
I20260709 13:00:56.154305  7811 raft_consensus.cc:493] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:56.154709  7811 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.159323  7811 raft_consensus.cc:515] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:56.160864  7811 leader_election.cc:290] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 5 election: Requested vote from peers 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907), 7f4ad52824e949ec901a5fd45d492b04 (127.6.236.3:33089)
I20260709 13:00:56.161720  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "810a084c891e4aa3b4d400603a42fdb0"
I20260709 13:00:56.162218  7737 raft_consensus.cc:3055] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:56.162153  7885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c9f4728f854a66bca480535f1f4b46" candidate_uuid: "3138faa4c28b4d87b97b294489f4504b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7f4ad52824e949ec901a5fd45d492b04"
I20260709 13:00:56.162487  7737 raft_consensus.cc:740] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 810a084c891e4aa3b4d400603a42fdb0, State: Running, Role: LEADER
I20260709 13:00:56.162647  7885 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.163096  7737 consensus_queue.cc:260] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:56.163892  7737 raft_consensus.cc:3060] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.167901  7885 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 5.
I20260709 13:00:56.168215  7737 raft_consensus.cc:2468] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3138faa4c28b4d87b97b294489f4504b in term 5.
I20260709 13:00:56.169063  7778 leader_election.cc:304] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3138faa4c28b4d87b97b294489f4504b, 7f4ad52824e949ec901a5fd45d492b04; no voters: 
I20260709 13:00:56.169682  8064 raft_consensus.cc:2804] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:56.170120  8064 raft_consensus.cc:697] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 5 LEADER]: Becoming Leader. State: Replica: 3138faa4c28b4d87b97b294489f4504b, State: Running, Role: LEADER
I20260709 13:00:56.170902  8064 consensus_queue.cc:237] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } }
I20260709 13:00:56.177064  7634 catalog_manager.cc:5697] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b reported cstate change: term changed from 4 to 5, leader changed from 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1) to 3138faa4c28b4d87b97b294489f4504b (127.6.236.2). New cstate: current_term: 5 leader_uuid: "3138faa4c28b4d87b97b294489f4504b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.243500  7811 raft_consensus.cc:1275] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:56.244832  8022 consensus_queue.cc:1048] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:56.254252  7737 raft_consensus.cc:1275] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:56.255908  8065 consensus_queue.cc:1048] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:56.456911  7885 raft_consensus.cc:1275] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Refusing update from remote peer 3138faa4c28b4d87b97b294489f4504b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:56.458226  8064 consensus_queue.cc:1048] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:56.467939  7737 raft_consensus.cc:1275] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Refusing update from remote peer 3138faa4c28b4d87b97b294489f4504b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:56.469476  8064 consensus_queue.cc:1048] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:56.646900  7737 raft_consensus.cc:1275] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:56.648227  8077 consensus_queue.cc:1048] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:56.656687  7811 raft_consensus.cc:1275] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Refusing update from remote peer 7f4ad52824e949ec901a5fd45d492b04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:56.659065  8065 consensus_queue.cc:1048] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3138faa4c28b4d87b97b294489f4504b" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:56.700523  7885 raft_consensus.cc:1275] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 5 FOLLOWER]: Refusing update from remote peer 3138faa4c28b4d87b97b294489f4504b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:56.701737  8064 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4ad52824e949ec901a5fd45d492b04" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:56.709591  7737 raft_consensus.cc:1275] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 5 FOLLOWER]: Refusing update from remote peer 3138faa4c28b4d87b97b294489f4504b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:56.711220  8082 consensus_queue.cc:1048] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [LEADER]: Connected to new peer: Peer: permanent_uuid: "810a084c891e4aa3b4d400603a42fdb0" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:56.739609  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:56.745297  7088 tablet_server.cc:179] TabletServer@127.6.236.1:0 shutting down...
I20260709 13:00:56.766052  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:56.766851  7088 tablet_replica.cc:333] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.767510  7088 raft_consensus.cc:2243] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.768011  7088 raft_consensus.cc:2272] T 22551b3ae67e4d3faaee2b1ce7ead8be P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.771358  7088 tablet_replica.cc:333] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.772009  7088 raft_consensus.cc:2243] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.772691  7088 raft_consensus.cc:2272] T a6aad5ed32dc464a925f7dd1d61f2a5b P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.774670  7088 tablet_replica.cc:333] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.775209  7088 raft_consensus.cc:2243] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.776039  7088 raft_consensus.cc:2272] T a917af24717e4247ad9152579a0fa31b P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.778021  7088 tablet_replica.cc:333] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.778753  7088 raft_consensus.cc:2243] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:00:56.779201  7778 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 13:00:56.779624  7088 raft_consensus.cc:2272] T 18b9ce871e134981a87217b740e8eb30 P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.781775  7088 tablet_replica.cc:333] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
W20260709 13:00:56.782011  7778 consensus_peers.cc:597] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b -> Peer 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907): Couldn't send request to peer 810a084c891e4aa3b4d400603a42fdb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:56.782387  7088 raft_consensus.cc:2243] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.782792  7088 raft_consensus.cc:2272] T 299428603ce04ae395d447e24b364ed8 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.785041  7088 tablet_replica.cc:333] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.785512  7088 raft_consensus.cc:2243] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.785867  7088 raft_consensus.cc:2272] T bbffd0353bac4cc6969287a2b84afcbc P 810a084c891e4aa3b4d400603a42fdb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.787907  7088 tablet_replica.cc:333] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.788373  7088 raft_consensus.cc:2243] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.789004  7088 raft_consensus.cc:2272] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 810a084c891e4aa3b4d400603a42fdb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.790627  7088 tablet_replica.cc:333] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.791080  7088 raft_consensus.cc:2243] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.791460  7088 raft_consensus.cc:2272] T 4713bda975a8458eaa97c17121f6360c P 810a084c891e4aa3b4d400603a42fdb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.793001  7088 tablet_replica.cc:333] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.793429  7088 raft_consensus.cc:2243] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.793771  7088 raft_consensus.cc:2272] T c926a96c4ccf428f866c4d67aac46f77 P 810a084c891e4aa3b4d400603a42fdb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.795356  7088 tablet_replica.cc:333] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0: stopping tablet replica
I20260709 13:00:56.795768  7088 raft_consensus.cc:2243] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.796120  7088 raft_consensus.cc:2272] T 29c9f4728f854a66bca480535f1f4b46 P 810a084c891e4aa3b4d400603a42fdb0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.825119  7088 tablet_server.cc:196] TabletServer@127.6.236.1:0 shutdown complete.
I20260709 13:00:56.849699  7088 tablet_server.cc:179] TabletServer@127.6.236.2:0 shutting down...
W20260709 13:00:56.850123  7852 consensus_peers.cc:597] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 -> Peer 810a084c891e4aa3b4d400603a42fdb0 (127.6.236.1:32907): Couldn't send request to peer 810a084c891e4aa3b4d400603a42fdb0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:32907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:56.870451  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:56.871184  7088 tablet_replica.cc:333] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.871739  7088 raft_consensus.cc:2243] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.872500  7088 raft_consensus.cc:2272] T 29c9f4728f854a66bca480535f1f4b46 P 3138faa4c28b4d87b97b294489f4504b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.874887  7088 tablet_replica.cc:333] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.875383  7088 raft_consensus.cc:2243] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.876081  7088 raft_consensus.cc:2272] T 22551b3ae67e4d3faaee2b1ce7ead8be P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.877964  7088 tablet_replica.cc:333] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.878578  7088 raft_consensus.cc:2243] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.879009  7088 raft_consensus.cc:2272] T a917af24717e4247ad9152579a0fa31b P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.880600  7088 tablet_replica.cc:333] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.881069  7088 raft_consensus.cc:2243] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.881464  7088 raft_consensus.cc:2272] T 4713bda975a8458eaa97c17121f6360c P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.883147  7088 tablet_replica.cc:333] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.883626  7088 raft_consensus.cc:2243] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.884339  7088 raft_consensus.cc:2272] T c926a96c4ccf428f866c4d67aac46f77 P 3138faa4c28b4d87b97b294489f4504b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.886023  7088 tablet_replica.cc:333] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.886530  7088 raft_consensus.cc:2243] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.887034  7088 raft_consensus.cc:2272] T bbffd0353bac4cc6969287a2b84afcbc P 3138faa4c28b4d87b97b294489f4504b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.888999  7088 tablet_replica.cc:333] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.889474  7088 raft_consensus.cc:2243] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.889835  7088 raft_consensus.cc:2272] T 18b9ce871e134981a87217b740e8eb30 P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.891455  7088 tablet_replica.cc:333] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.891885  7088 raft_consensus.cc:2243] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.892263  7088 raft_consensus.cc:2272] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.893759  7088 tablet_replica.cc:333] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.894217  7088 raft_consensus.cc:2243] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.894589  7088 raft_consensus.cc:2272] T 299428603ce04ae395d447e24b364ed8 P 3138faa4c28b4d87b97b294489f4504b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.896414  7088 tablet_replica.cc:333] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b: stopping tablet replica
I20260709 13:00:56.896835  7088 raft_consensus.cc:2243] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.897212  7088 raft_consensus.cc:2272] T a6aad5ed32dc464a925f7dd1d61f2a5b P 3138faa4c28b4d87b97b294489f4504b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.924431  7088 tablet_server.cc:196] TabletServer@127.6.236.2:0 shutdown complete.
I20260709 13:00:56.942344  7088 tablet_server.cc:179] TabletServer@127.6.236.3:0 shutting down...
I20260709 13:00:56.972148  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:56.973172  7088 tablet_replica.cc:333] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.973965  7088 raft_consensus.cc:2243] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.974555  7088 raft_consensus.cc:2272] T c926a96c4ccf428f866c4d67aac46f77 P 7f4ad52824e949ec901a5fd45d492b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.976580  7088 tablet_replica.cc:333] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.977134  7088 raft_consensus.cc:2243] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.977911  7088 raft_consensus.cc:2272] T 4713bda975a8458eaa97c17121f6360c P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.979699  7088 tablet_replica.cc:333] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.980239  7088 raft_consensus.cc:2243] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.980610  7088 raft_consensus.cc:2272] T a6aad5ed32dc464a925f7dd1d61f2a5b P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.982247  7088 tablet_replica.cc:333] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.982704  7088 raft_consensus.cc:2243] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.983109  7088 raft_consensus.cc:2272] T a917af24717e4247ad9152579a0fa31b P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.984805  7088 tablet_replica.cc:333] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.985278  7088 raft_consensus.cc:2243] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.985944  7088 raft_consensus.cc:2272] T bbffd0353bac4cc6969287a2b84afcbc P 7f4ad52824e949ec901a5fd45d492b04 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.987793  7088 tablet_replica.cc:333] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.988260  7088 raft_consensus.cc:2243] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.988919  7088 raft_consensus.cc:2272] T 299428603ce04ae395d447e24b364ed8 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.990813  7088 tablet_replica.cc:333] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.991274  7088 raft_consensus.cc:2243] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.991624  7088 raft_consensus.cc:2272] T b9bfc35b39fb4199b80f8eb1c28dcc37 P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.993198  7088 tablet_replica.cc:333] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.993631  7088 raft_consensus.cc:2243] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.994000  7088 raft_consensus.cc:2272] T 18b9ce871e134981a87217b740e8eb30 P 7f4ad52824e949ec901a5fd45d492b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.995836  7088 tablet_replica.cc:333] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.996332  7088 raft_consensus.cc:2243] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.996721  7088 raft_consensus.cc:2272] T 29c9f4728f854a66bca480535f1f4b46 P 7f4ad52824e949ec901a5fd45d492b04 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.998785  7088 tablet_replica.cc:333] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04: stopping tablet replica
I20260709 13:00:56.999226  7088 raft_consensus.cc:2243] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.999603  7088 raft_consensus.cc:2272] T 22551b3ae67e4d3faaee2b1ce7ead8be P 7f4ad52824e949ec901a5fd45d492b04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:57.026835  7088 tablet_server.cc:196] TabletServer@127.6.236.3:0 shutdown complete.
I20260709 13:00:57.044812  7088 master.cc:562] Master@127.6.236.62:44735 shutting down...
I20260709 13:00:57.062532  7088 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:57.063068  7088 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:57.063377  7088 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5844147c1cbb4ea08ce510facc65f685: stopping tablet replica
I20260709 13:00:57.082686  7088 master.cc:584] Master@127.6.236.62:44735 shutdown complete.
3138faa4c28b4d87b97b294489f4504b  4
7f4ad52824e949ec901a5fd45d492b04  1
810a084c891e4aa3b4d400603a42fdb0  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10372 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:00:57.118741  7088 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.236.62:39147
I20260709 13:00:57.119963  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:57.125540  8091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:57.125856  8092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:57.126300  8094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.126741  7088 server_base.cc:1061] running on GCE node
I20260709 13:00:57.127501  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:57.127673  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:57.127812  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602057127794 us; error 0 us; skew 500 ppm
I20260709 13:00:57.128310  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:57.130676  7088 webserver.cc:533] Webserver started at http://127.6.236.62:40103/ using document root <none> and password file <none>
I20260709 13:00:57.131150  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:57.131314  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:57.131567  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:57.132670  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/master-0-root/instance:
uuid: "49ab8a0cd4ae4427b46500594085b384"
format_stamp: "Formatted at 2026-07-09 13:00:57 on dist-test-slave-j4mc"
I20260709 13:00:57.136910  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:00:57.140187  8099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.140919  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:00:57.141201  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/master-0-root
uuid: "49ab8a0cd4ae4427b46500594085b384"
format_stamp: "Formatted at 2026-07-09 13:00:57 on dist-test-slave-j4mc"
I20260709 13:00:57.141459  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:57.155035  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:57.156252  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:57.195837  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.62:39147
I20260709 13:00:57.195945  8150 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.62:39147 every 8 connection(s)
I20260709 13:00:57.199961  8151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.209566  8151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Bootstrap starting.
I20260709 13:00:57.214144  8151 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.218446  8151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: No bootstrap required, opened a new log
I20260709 13:00:57.220479  8151 raft_consensus.cc:359] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ab8a0cd4ae4427b46500594085b384" member_type: VOTER }
I20260709 13:00:57.220969  8151 raft_consensus.cc:385] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.221215  8151 raft_consensus.cc:740] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ab8a0cd4ae4427b46500594085b384, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.221755  8151 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ab8a0cd4ae4427b46500594085b384" member_type: VOTER }
I20260709 13:00:57.222242  8151 raft_consensus.cc:399] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:57.222465  8151 raft_consensus.cc:493] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:57.222698  8151 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.227109  8151 raft_consensus.cc:515] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ab8a0cd4ae4427b46500594085b384" member_type: VOTER }
I20260709 13:00:57.227630  8151 leader_election.cc:304] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49ab8a0cd4ae4427b46500594085b384; no voters: 
I20260709 13:00:57.228747  8151 leader_election.cc:290] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:57.229161  8154 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.230340  8154 raft_consensus.cc:697] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 1 LEADER]: Becoming Leader. State: Replica: 49ab8a0cd4ae4427b46500594085b384, State: Running, Role: LEADER
I20260709 13:00:57.230996  8154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ab8a0cd4ae4427b46500594085b384" member_type: VOTER }
I20260709 13:00:57.231478  8151 sys_catalog.cc:565] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:57.235643  8156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49ab8a0cd4ae4427b46500594085b384. Latest consensus state: current_term: 1 leader_uuid: "49ab8a0cd4ae4427b46500594085b384" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ab8a0cd4ae4427b46500594085b384" member_type: VOTER } }
I20260709 13:00:57.236258  8156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:57.235589  8155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49ab8a0cd4ae4427b46500594085b384" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ab8a0cd4ae4427b46500594085b384" member_type: VOTER } }
I20260709 13:00:57.236797  8155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:57.238286  8162 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:57.243170  8162 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:57.245779  7088 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:57.251277  8162 catalog_manager.cc:1383] Generated new cluster ID: 48dba0e7232349a9ae8907a83f8bd7ab
I20260709 13:00:57.251556  8162 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:57.264173  8162 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:57.265377  8162 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:57.277266  8162 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Generated new TSK 0
I20260709 13:00:57.277880  8162 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:57.312489  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:57.318384  8172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:57.319032  8173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.321519  7088 server_base.cc:1061] running on GCE node
W20260709 13:00:57.321626  8175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.322705  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:57.322899  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:57.323112  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602057323094 us; error 0 us; skew 500 ppm
I20260709 13:00:57.323621  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:57.326020  7088 webserver.cc:533] Webserver started at http://127.6.236.1:34193/ using document root <none> and password file <none>
I20260709 13:00:57.326556  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:57.326741  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:57.326996  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:57.328043  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/instance:
uuid: "ca43983edda443fa9d74c1f80252f1fc"
format_stamp: "Formatted at 2026-07-09 13:00:57 on dist-test-slave-j4mc"
I20260709 13:00:57.332399  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:00:57.335618  8180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.336295  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:00:57.336544  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "ca43983edda443fa9d74c1f80252f1fc"
format_stamp: "Formatted at 2026-07-09 13:00:57 on dist-test-slave-j4mc"
I20260709 13:00:57.336804  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:57.354447  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:57.355664  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:57.357115  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:57.359320  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:57.359532  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.359750  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:57.359912  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.399569  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:41893
I20260709 13:00:57.399967  8242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:41893 every 8 connection(s)
I20260709 13:00:57.405220  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:57.411643  8247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:57.413096  8248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.417407  7088 server_base.cc:1061] running on GCE node
W20260709 13:00:57.417611  8250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.418671  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:57.418881  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:57.419049  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602057419031 us; error 0 us; skew 500 ppm
I20260709 13:00:57.419703  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:57.420768  8243 heartbeater.cc:344] Connected to a master server at 127.6.236.62:39147
I20260709 13:00:57.421149  8243 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:57.422116  8243 heartbeater.cc:507] Master 127.6.236.62:39147 requested a full tablet report, sending...
I20260709 13:00:57.423017  7088 webserver.cc:533] Webserver started at http://127.6.236.2:38805/ using document root <none> and password file <none>
I20260709 13:00:57.424079  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:57.424396  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:57.424669  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:57.424999  8116 ts_manager.cc:194] Registered new tserver with Master: ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:00:57.425928  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/instance:
uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
format_stamp: "Formatted at 2026-07-09 13:00:57 on dist-test-slave-j4mc"
I20260709 13:00:57.426740  8116 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35666
I20260709 13:00:57.431119  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:57.434530  8255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.435403  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:00:57.435753  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root
uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
format_stamp: "Formatted at 2026-07-09 13:00:57 on dist-test-slave-j4mc"
I20260709 13:00:57.436030  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:57.479398  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:57.480515  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:57.481884  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:57.484164  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:57.484359  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.484582  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:57.484733  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.521548  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.2:39859
I20260709 13:00:57.521639  8317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.2:39859 every 8 connection(s)
I20260709 13:00:57.526087  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:57.532169  8321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:57.533906  8322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.535892  7088 server_base.cc:1061] running on GCE node
W20260709 13:00:57.536631  8324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.537483  8318 heartbeater.cc:344] Connected to a master server at 127.6.236.62:39147
I20260709 13:00:57.537582  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:57.537832  8318 heartbeater.cc:461] Registering TS with master...
W20260709 13:00:57.537880  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:57.538229  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602057538200 us; error 0 us; skew 500 ppm
I20260709 13:00:57.538796  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:57.538758  8318 heartbeater.cc:507] Master 127.6.236.62:39147 requested a full tablet report, sending...
I20260709 13:00:57.541029  8116 ts_manager.cc:194] Registered new tserver with Master: ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:57.541541  7088 webserver.cc:533] Webserver started at http://127.6.236.3:35627/ using document root <none> and password file <none>
I20260709 13:00:57.542011  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:57.542232  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:57.542469  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:57.542495  8116 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35680
I20260709 13:00:57.543778  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/instance:
uuid: "ee13752324154b1293a47c9dcd8d6ba5"
format_stamp: "Formatted at 2026-07-09 13:00:57 on dist-test-slave-j4mc"
I20260709 13:00:57.548033  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:57.551204  8329 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.551862  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:57.552129  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root
uuid: "ee13752324154b1293a47c9dcd8d6ba5"
format_stamp: "Formatted at 2026-07-09 13:00:57 on dist-test-slave-j4mc"
I20260709 13:00:57.552386  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:57.570323  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:57.571545  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:57.572944  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:57.575366  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:57.575644  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.576061  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:57.576283  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.614926  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.3:37337
I20260709 13:00:57.615034  8391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.3:37337 every 8 connection(s)
I20260709 13:00:57.628222  8392 heartbeater.cc:344] Connected to a master server at 127.6.236.62:39147
I20260709 13:00:57.628572  8392 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:57.629292  8392 heartbeater.cc:507] Master 127.6.236.62:39147 requested a full tablet report, sending...
I20260709 13:00:57.631124  8116 ts_manager.cc:194] Registered new tserver with Master: ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:57.631352  7088 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013364827s
I20260709 13:00:57.632416  8116 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35686
I20260709 13:00:57.657670  8116 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:57.663623  8116 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:57.855854  8208 tablet_service.cc:1511] Processing CreateTablet for tablet aee8a45d39bb4537bebf44a3d479ebd4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:57.857940  8204 tablet_service.cc:1511] Processing CreateTablet for tablet a41c46760f54470bb49d3fd515fb4414 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:57.859083  8203 tablet_service.cc:1511] Processing CreateTablet for tablet f92a5d6830044936958a95556af24660 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:57.860169  8205 tablet_service.cc:1511] Processing CreateTablet for tablet 30a1960353b84e25a3e3faea11a1f4fb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:57.861891  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 37fc7732f1124e04b9a47402ad544464 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:57.862282  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:57.863284  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee8a45d39bb4537bebf44a3d479ebd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.864331  8207 tablet_service.cc:1511] Processing CreateTablet for tablet b44a898a39ca4aef88c7fc182072ddac (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:57.865506  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b44a898a39ca4aef88c7fc182072ddac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.866442  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a1960353b84e25a3e3faea11a1f4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.867128  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fc7732f1124e04b9a47402ad544464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.867893  8201 tablet_service.cc:1511] Processing CreateTablet for tablet 94f8a1b635cb4638922cb1dcf37e6e5b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:57.868803  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.870128  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f8a1b635cb4638922cb1dcf37e6e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.870895  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92a5d6830044936958a95556af24660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.874392  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c46760f54470bb49d3fd515fb4414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.874528  8200 tablet_service.cc:1511] Processing CreateTablet for tablet 0356bb50f97540f48a0cb08e1407eb57 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:57.875906  8200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0356bb50f97540f48a0cb08e1407eb57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.879830  8199 tablet_service.cc:1511] Processing CreateTablet for tablet 0e16f2ade8444f2c95d17cae4d4654c2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:57.881191  8199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e16f2ade8444f2c95d17cae4d4654c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.910778  8283 tablet_service.cc:1511] Processing CreateTablet for tablet aee8a45d39bb4537bebf44a3d479ebd4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:57.912145  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee8a45d39bb4537bebf44a3d479ebd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.912808  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 52604c43ccee4ddca5408d7cc08e134a (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:57.913179  8199 tablet_service.cc:1511] Processing CreateTablet for tablet b3069684e0be469dba5b83137f0c4e62 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:57.916949  8282 tablet_service.cc:1511] Processing CreateTablet for tablet b44a898a39ca4aef88c7fc182072ddac (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:57.918437  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b44a898a39ca4aef88c7fc182072ddac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.914037  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52604c43ccee4ddca5408d7cc08e134a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.922991  8199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3069684e0be469dba5b83137f0c4e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.931838  8281 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:57.933192  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.932915  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:57.934300  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.934180  8357 tablet_service.cc:1511] Processing CreateTablet for tablet aee8a45d39bb4537bebf44a3d479ebd4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:57.935461  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee8a45d39bb4537bebf44a3d479ebd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.936151  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 30a1960353b84e25a3e3faea11a1f4fb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:57.937425  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a1960353b84e25a3e3faea11a1f4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.939389  8353 tablet_service.cc:1511] Processing CreateTablet for tablet a41c46760f54470bb49d3fd515fb4414 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:57.940690  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c46760f54470bb49d3fd515fb4414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.942065  8348 tablet_service.cc:1511] Processing CreateTablet for tablet 0e16f2ade8444f2c95d17cae4d4654c2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:57.943532  8348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e16f2ade8444f2c95d17cae4d4654c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.943205  8280 tablet_service.cc:1511] Processing CreateTablet for tablet 30a1960353b84e25a3e3faea11a1f4fb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:57.944525  8280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a1960353b84e25a3e3faea11a1f4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.944370  8351 tablet_service.cc:1511] Processing CreateTablet for tablet 37fc7732f1124e04b9a47402ad544464 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:57.945618  8351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fc7732f1124e04b9a47402ad544464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.947364  8350 tablet_service.cc:1511] Processing CreateTablet for tablet 94f8a1b635cb4638922cb1dcf37e6e5b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:57.948630  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f8a1b635cb4638922cb1dcf37e6e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.951213  8349 tablet_service.cc:1511] Processing CreateTablet for tablet 0356bb50f97540f48a0cb08e1407eb57 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:57.952461  8349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0356bb50f97540f48a0cb08e1407eb57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.947803  8279 tablet_service.cc:1511] Processing CreateTablet for tablet a41c46760f54470bb49d3fd515fb4414 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:57.943226  8352 tablet_service.cc:1511] Processing CreateTablet for tablet f92a5d6830044936958a95556af24660 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:57.955416  8352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92a5d6830044936958a95556af24660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.956373  8278 tablet_service.cc:1511] Processing CreateTablet for tablet f92a5d6830044936958a95556af24660 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:57.954537  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c46760f54470bb49d3fd515fb4414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.959421  8277 tablet_service.cc:1511] Processing CreateTablet for tablet 37fc7732f1124e04b9a47402ad544464 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:57.960927  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92a5d6830044936958a95556af24660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.962436  8277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fc7732f1124e04b9a47402ad544464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.931766  8356 tablet_service.cc:1511] Processing CreateTablet for tablet b44a898a39ca4aef88c7fc182072ddac (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:57.963878  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b44a898a39ca4aef88c7fc182072ddac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.971676  8276 tablet_service.cc:1511] Processing CreateTablet for tablet 94f8a1b635cb4638922cb1dcf37e6e5b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:57.972535  8275 tablet_service.cc:1511] Processing CreateTablet for tablet 0356bb50f97540f48a0cb08e1407eb57 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:57.973099  8276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f8a1b635cb4638922cb1dcf37e6e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.974633  8275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0356bb50f97540f48a0cb08e1407eb57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.977607  8274 tablet_service.cc:1511] Processing CreateTablet for tablet 0e16f2ade8444f2c95d17cae4d4654c2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:57.978914  8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e16f2ade8444f2c95d17cae4d4654c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.987933  8200 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3ae0ec4e2b4f60b8666dc0d97b4c1b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:57.989264  8200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3ae0ec4e2b4f60b8666dc0d97b4c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.033823  8204 tablet_service.cc:1511] Processing CreateTablet for tablet b139f81eea56438e9aba32ed1941dedb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:58.035125  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b139f81eea56438e9aba32ed1941dedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.041705  8409 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:58.042488  8283 tablet_service.cc:1511] Processing CreateTablet for tablet c8c00c17016841839312c823fcffaf82 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:58.044093  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c00c17016841839312c823fcffaf82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.049407  8407 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:58.065280  8208 tablet_service.cc:1511] Processing CreateTablet for tablet be07a93f3c5547ebbcf1319de3133c06 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:58.070159  8203 tablet_service.cc:1511] Processing CreateTablet for tablet e437f18bf26d472eba0aa8ed4b920b7e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:58.076160  8353 tablet_service.cc:1511] Processing CreateTablet for tablet b3069684e0be469dba5b83137f0c4e62 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:58.072036  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 9f17336652094c69a7e70a69b68a335d (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:58.078848  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f17336652094c69a7e70a69b68a335d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.070990  8205 tablet_service.cc:1511] Processing CreateTablet for tablet 2384ae06cadc456cb351a6dbe8483639 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:58.082791  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2384ae06cadc456cb351a6dbe8483639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.083526  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 893302ae4fac4d73945a8ad0a674a1e5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:58.084740  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893302ae4fac4d73945a8ad0a674a1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.086561  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be07a93f3c5547ebbcf1319de3133c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.088485  8280 tablet_service.cc:1511] Processing CreateTablet for tablet e437f18bf26d472eba0aa8ed4b920b7e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:58.089444  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e437f18bf26d472eba0aa8ed4b920b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.101150  8201 tablet_service.cc:1511] Processing CreateTablet for tablet 864d288163824eac975181159a2708d9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:58.091295  8407 tablet_bootstrap.cc:654] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.093086  8409 tablet_bootstrap.cc:654] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.104455  8408 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:58.097587  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 52604c43ccee4ddca5408d7cc08e134a (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:58.106065  8280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e437f18bf26d472eba0aa8ed4b920b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.107928  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3069684e0be469dba5b83137f0c4e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.108742  8281 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3ae0ec4e2b4f60b8666dc0d97b4c1b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:58.109946  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3ae0ec4e2b4f60b8666dc0d97b4c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.111397  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 52604c43ccee4ddca5408d7cc08e134a (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:58.112787  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52604c43ccee4ddca5408d7cc08e134a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.114423  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52604c43ccee4ddca5408d7cc08e134a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.113934  8350 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3ae0ec4e2b4f60b8666dc0d97b4c1b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:58.115489  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3ae0ec4e2b4f60b8666dc0d97b4c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.117444  8351 tablet_service.cc:1511] Processing CreateTablet for tablet b139f81eea56438e9aba32ed1941dedb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:58.119948  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 2384ae06cadc456cb351a6dbe8483639 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:58.137408  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2384ae06cadc456cb351a6dbe8483639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.097590  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe31b6ada204d4fab7c4cbe1912fff6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:58.126242  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864d288163824eac975181159a2708d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.131414  8199 tablet_service.cc:1511] Processing CreateTablet for tablet 931eba945dfb4e34aae782648072e6ea (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:58.094143  8275 tablet_service.cc:1511] Processing CreateTablet for tablet b3069684e0be469dba5b83137f0c4e62 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:58.157073  8275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3069684e0be469dba5b83137f0c4e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.173607  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe31b6ada204d4fab7c4cbe1912fff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.174885  8351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b139f81eea56438e9aba32ed1941dedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.177919  8352 tablet_service.cc:1511] Processing CreateTablet for tablet 9f17336652094c69a7e70a69b68a335d (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:58.179772  8352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f17336652094c69a7e70a69b68a335d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.187655  8205 tablet_service.cc:1511] Processing CreateTablet for tablet d19654c841264233b661225cdb0ef14b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:58.188951  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19654c841264233b661225cdb0ef14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.189528  8348 tablet_service.cc:1511] Processing CreateTablet for tablet 893302ae4fac4d73945a8ad0a674a1e5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:58.190972  8348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893302ae4fac4d73945a8ad0a674a1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.192683  8407 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:58.193172  8407 ts_tablet_manager.cc:1403] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.144s	user 0.021s	sys 0.009s
I20260709 13:00:58.142045  8204 tablet_service.cc:1511] Processing CreateTablet for tablet 60372205e52244a299cc381c5212f23b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:58.195338  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60372205e52244a299cc381c5212f23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.196384  8407 raft_consensus.cc:359] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.197082  8407 raft_consensus.cc:385] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.197355  8407 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.198741  8279 tablet_service.cc:1511] Processing CreateTablet for tablet 9f17336652094c69a7e70a69b68a335d (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:58.201130  8277 tablet_service.cc:1511] Processing CreateTablet for tablet 893302ae4fac4d73945a8ad0a674a1e5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:58.165367  8349 tablet_service.cc:1511] Processing CreateTablet for tablet be07a93f3c5547ebbcf1319de3133c06 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:58.202724  8349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be07a93f3c5547ebbcf1319de3133c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.179380  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 2384ae06cadc456cb351a6dbe8483639 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:58.190603  8200 tablet_service.cc:1511] Processing CreateTablet for tablet c8c00c17016841839312c823fcffaf82 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:58.206204  8200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c00c17016841839312c823fcffaf82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.199443  8356 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe31b6ada204d4fab7c4cbe1912fff6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:58.209328  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe31b6ada204d4fab7c4cbe1912fff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.211254  8199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931eba945dfb4e34aae782648072e6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.220888  8408 tablet_bootstrap.cc:654] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.150233  8276 tablet_service.cc:1511] Processing CreateTablet for tablet b139f81eea56438e9aba32ed1941dedb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:58.222607  8277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893302ae4fac4d73945a8ad0a674a1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.236413  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f17336652094c69a7e70a69b68a335d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.238655  8276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b139f81eea56438e9aba32ed1941dedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.222304  8355 tablet_service.cc:1511] Processing CreateTablet for tablet e437f18bf26d472eba0aa8ed4b920b7e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:58.240499  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e437f18bf26d472eba0aa8ed4b920b7e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:58.241448  8164 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:58.224344  8409 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:58.246469  8409 ts_tablet_manager.cc:1403] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.205s	user 0.008s	sys 0.013s
I20260709 13:00:58.249388  8409 raft_consensus.cc:359] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.226799  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe31b6ada204d4fab7c4cbe1912fff6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:58.254745  8409 raft_consensus.cc:385] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.255251  8203 tablet_service.cc:1511] Processing CreateTablet for tablet dd433d0931a84d969a77a1cd54cd32b5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:58.256513  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd433d0931a84d969a77a1cd54cd32b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.255285  8409 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.259882  8275 tablet_service.cc:1511] Processing CreateTablet for tablet 931eba945dfb4e34aae782648072e6ea (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:58.261130  8280 tablet_service.cc:1511] Processing CreateTablet for tablet 60372205e52244a299cc381c5212f23b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:58.232599  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 864d288163824eac975181159a2708d9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:58.232925  8407 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.240522  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2384ae06cadc456cb351a6dbe8483639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.263224  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe31b6ada204d4fab7c4cbe1912fff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.185027  8274 tablet_service.cc:1511] Processing CreateTablet for tablet be07a93f3c5547ebbcf1319de3133c06 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:58.264320  8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be07a93f3c5547ebbcf1319de3133c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.222436  8353 tablet_service.cc:1511] Processing CreateTablet for tablet 864d288163824eac975181159a2708d9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:58.266806  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864d288163824eac975181159a2708d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.266377  8409 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.268234  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 931eba945dfb4e34aae782648072e6ea (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:58.269526  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931eba945dfb4e34aae782648072e6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.274398  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864d288163824eac975181159a2708d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.275005  8275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931eba945dfb4e34aae782648072e6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.278971  8281 tablet_service.cc:1511] Processing CreateTablet for tablet d19654c841264233b661225cdb0ef14b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:58.280263  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19654c841264233b661225cdb0ef14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.280417  8204 tablet_service.cc:1511] Processing CreateTablet for tablet c38bdb3838dd476fb824170ffe3fe5e2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:58.289593  8280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60372205e52244a299cc381c5212f23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.294967  8201 tablet_service.cc:1511] Processing CreateTablet for tablet c1b1759fd5564511bf32b2e51ed1404c (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:58.296193  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b1759fd5564511bf32b2e51ed1404c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.261866  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 410fe3c36e834265b4c3b139e453a76e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:58.297096  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410fe3c36e834265b4c3b139e453a76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.298224  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 73508a52a1594a38badce805866b753e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:58.312868  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73508a52a1594a38badce805866b753e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.318776  8350 tablet_service.cc:1511] Processing CreateTablet for tablet c8c00c17016841839312c823fcffaf82 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:58.320513  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 60372205e52244a299cc381c5212f23b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:58.320963  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c00c17016841839312c823fcffaf82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.327018  8318 heartbeater.cc:499] Master 127.6.236.62:39147 was elected leader, sending a full tablet report...
I20260709 13:00:58.321907  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60372205e52244a299cc381c5212f23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.343318  8351 tablet_service.cc:1511] Processing CreateTablet for tablet 73508a52a1594a38badce805866b753e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:58.344697  8200 tablet_service.cc:1511] Processing CreateTablet for tablet f676e8a33e184058b1fda69dd2836ce6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:58.345649  8279 tablet_service.cc:1511] Processing CreateTablet for tablet 73508a52a1594a38badce805866b753e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:58.347018  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73508a52a1594a38badce805866b753e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.347512  8409 ts_tablet_manager.cc:1434] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.006s
I20260709 13:00:58.348660  8409 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:58.350175  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38bdb3838dd476fb824170ffe3fe5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.365751  8274 tablet_service.cc:1511] Processing CreateTablet for tablet dd433d0931a84d969a77a1cd54cd32b5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:58.339289  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 410fe3c36e834265b4c3b139e453a76e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:58.365420  8352 tablet_service.cc:1511] Processing CreateTablet for tablet dd433d0931a84d969a77a1cd54cd32b5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:58.367244  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410fe3c36e834265b4c3b139e453a76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.358412  8200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f676e8a33e184058b1fda69dd2836ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.358927  8408 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:58.380151  8408 ts_tablet_manager.cc:1403] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.276s	user 0.016s	sys 0.000s
I20260709 13:00:58.382103  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 410fe3c36e834265b4c3b139e453a76e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:58.382889  8408 raft_consensus.cc:359] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
I20260709 13:00:58.383658  8408 raft_consensus.cc:385] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.383944  8408 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.384647  8408 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
I20260709 13:00:58.376152  8199 tablet_service.cc:1511] Processing CreateTablet for tablet 457d66c5ca7c4163a642765639bc4f3d (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:58.386232  8243 heartbeater.cc:499] Master 127.6.236.62:39147 was elected leader, sending a full tablet report...
I20260709 13:00:58.376911  8351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73508a52a1594a38badce805866b753e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.356751  8356 tablet_service.cc:1511] Processing CreateTablet for tablet d19654c841264233b661225cdb0ef14b (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:58.388847  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19654c841264233b661225cdb0ef14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.389403  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410fe3c36e834265b4c3b139e453a76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.390290  8199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457d66c5ca7c4163a642765639bc4f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.392401  8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd433d0931a84d969a77a1cd54cd32b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.394327  8407 ts_tablet_manager.cc:1434] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.201s	user 0.025s	sys 0.015s
I20260709 13:00:58.394232  8349 tablet_service.cc:1511] Processing CreateTablet for tablet c38bdb3838dd476fb824170ffe3fe5e2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:58.395368  8407 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:58.395458  8349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38bdb3838dd476fb824170ffe3fe5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.396409  8352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd433d0931a84d969a77a1cd54cd32b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.402943  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 3b137d34f34145b18037845635e297eb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:58.404233  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b137d34f34145b18037845635e297eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.407219  8413 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.409221  8413 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.418447  8413 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:58.426482  8205 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab0986fac1e49b59f2c51d4cd50f2b8 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:58.449793  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab0986fac1e49b59f2c51d4cd50f2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.455920  8278 tablet_service.cc:1511] Processing CreateTablet for tablet c38bdb3838dd476fb824170ffe3fe5e2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:58.460774  8409 tablet_bootstrap.cc:654] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.499490  8407 tablet_bootstrap.cc:654] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.462412  8348 tablet_service.cc:1511] Processing CreateTablet for tablet c1b1759fd5564511bf32b2e51ed1404c (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:58.463434  8202 tablet_service.cc:1511] Processing CreateTablet for tablet d8e2862cbf8e4bfdb5395396ea06c348 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:58.465473  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 3161be69a5b64eea9d078c61741b3db0 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:58.505749  8392 heartbeater.cc:499] Master 127.6.236.62:39147 was elected leader, sending a full tablet report...
I20260709 13:00:58.539511  8353 tablet_service.cc:1511] Processing CreateTablet for tablet 3b137d34f34145b18037845635e297eb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:58.556583  8348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b1759fd5564511bf32b2e51ed1404c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.477259  8355 tablet_service.cc:1511] Processing CreateTablet for tablet f676e8a33e184058b1fda69dd2836ce6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:58.505870  8415 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.567088  8415 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
I20260709 13:00:58.569263  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e2862cbf8e4bfdb5395396ea06c348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.572849  8280 tablet_service.cc:1511] Processing CreateTablet for tablet c1b1759fd5564511bf32b2e51ed1404c (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:58.599653  8412 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.600191  8412 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.607481  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f676e8a33e184058b1fda69dd2836ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.608799  8280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b1759fd5564511bf32b2e51ed1404c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.612066  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38bdb3838dd476fb824170ffe3fe5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.611464  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3161be69a5b64eea9d078c61741b3db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.611563  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 3b137d34f34145b18037845635e297eb (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:58.616827  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 5b726723bee647ec82d162a5cf1a6515 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:58.618130  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b726723bee647ec82d162a5cf1a6515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.618737  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b137d34f34145b18037845635e297eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.614884  8206 tablet_service.cc:1511] Processing CreateTablet for tablet fe403af31f9840f3b20788181ba23576 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:58.620183  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe403af31f9840f3b20788181ba23576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.620592  8412 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:58.621213  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b137d34f34145b18037845635e297eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.616267  8277 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab0986fac1e49b59f2c51d4cd50f2b8 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:58.622229  8277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab0986fac1e49b59f2c51d4cd50f2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.624990  8415 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:58.609743  8201 tablet_service.cc:1511] Processing CreateTablet for tablet d7d3b2e6d3394d178e2db304c3767659 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:58.654964  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d3b2e6d3394d178e2db304c3767659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.659626  8408 ts_tablet_manager.cc:1434] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.279s	user 0.013s	sys 0.031s
I20260709 13:00:58.619189  8276 tablet_service.cc:1511] Processing CreateTablet for tablet 457d66c5ca7c4163a642765639bc4f3d (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:58.614892  8350 tablet_service.cc:1511] Processing CreateTablet for tablet 457d66c5ca7c4163a642765639bc4f3d (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:58.657867  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 0545ed3bf21c4b3489c11d21d7796f22 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:58.692988  8408 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:58.693315  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:58.693799  8407 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:58.698621  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457d66c5ca7c4163a642765639bc4f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.703788  8409 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:58.708048  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab0986fac1e49b59f2c51d4cd50f2b8 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:58.712875  8199 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6a07d8346e4fd5a54166e1cb3b1660 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:58.665621  8275 tablet_service.cc:1511] Processing CreateTablet for tablet d8e2862cbf8e4bfdb5395396ea06c348 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:58.716173  8281 tablet_service.cc:1511] Processing CreateTablet for tablet f676e8a33e184058b1fda69dd2836ce6 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:58.728215  8407 ts_tablet_manager.cc:1403] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.333s	user 0.010s	sys 0.016s
I20260709 13:00:58.744781  8409 ts_tablet_manager.cc:1403] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.396s	user 0.019s	sys 0.033s
I20260709 13:00:58.732378  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:00:58.747820  8183 leader_election.cc:343] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:58.733915  8257 leader_election.cc:343] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.734935  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:58.733489  8276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457d66c5ca7c4163a642765639bc4f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.749166  8407 raft_consensus.cc:359] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.755187  8407 raft_consensus.cc:385] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.755553  8407 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.756232  8407 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.755227  8275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e2862cbf8e4bfdb5395396ea06c348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.757625  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f676e8a33e184058b1fda69dd2836ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.747490  8409 raft_consensus.cc:359] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
I20260709 13:00:58.760352  8409 raft_consensus.cc:385] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.760645  8409 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.761317  8409 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
W20260709 13:00:58.765291  8259 leader_election.cc:343] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.765744  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:58.768646  8274 tablet_service.cc:1511] Processing CreateTablet for tablet d7d3b2e6d3394d178e2db304c3767659 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:58.770458  8279 tablet_service.cc:1511] Processing CreateTablet for tablet 3161be69a5b64eea9d078c61741b3db0 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:58.772329  8407 ts_tablet_manager.cc:1434] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.005s
I20260709 13:00:58.772756  8205 tablet_service.cc:1511] Processing CreateTablet for tablet 028a77b252d249a6bef6c5f1f87a39e9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:58.776409  8281 tablet_service.cc:1511] Processing CreateTablet for tablet fe403af31f9840f3b20788181ba23576 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:58.777786  8409 ts_tablet_manager.cc:1434] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:00:58.778188  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 3161be69a5b64eea9d078c61741b3db0 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:58.778752  8409 tablet_bootstrap.cc:492] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:58.781257  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 5b726723bee647ec82d162a5cf1a6515 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:58.780390  8351 tablet_service.cc:1511] Processing CreateTablet for tablet d7d3b2e6d3394d178e2db304c3767659 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:58.785557  8413 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.798345  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab0986fac1e49b59f2c51d4cd50f2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.799230  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:58.797435  8356 tablet_service.cc:1511] Processing CreateTablet for tablet fe403af31f9840f3b20788181ba23576 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:58.769956  8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d3b2e6d3394d178e2db304c3767659. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:58.804955  8331 leader_election.cc:343] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.805164  8199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6a07d8346e4fd5a54166e1cb3b1660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.805425  8407 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:58.811553  8407 tablet_bootstrap.cc:654] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.816717  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3161be69a5b64eea9d078c61741b3db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.777487  8354 tablet_service.cc:1511] Processing CreateTablet for tablet d8e2862cbf8e4bfdb5395396ea06c348 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:58.825971  8412 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.826547  8412 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.828696  8412 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:58.830247  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:58.831086  8352 tablet_service.cc:1511] Processing CreateTablet for tablet 5b726723bee647ec82d162a5cf1a6515 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:00:58.831594  8183 leader_election.cc:343] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.835516  8204 tablet_service.cc:1511] Processing CreateTablet for tablet 7d553c54f49c4cd1a7737e4136f02960 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:58.837208  8277 tablet_service.cc:1511] Processing CreateTablet for tablet 44115d987e9746a3b4f158acec40ce8f (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:58.837759  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0545ed3bf21c4b3489c11d21d7796f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.839059  8349 tablet_service.cc:1511] Processing CreateTablet for tablet 0545ed3bf21c4b3489c11d21d7796f22 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:58.842350  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b726723bee647ec82d162a5cf1a6515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.845214  8200 tablet_service.cc:1511] Processing CreateTablet for tablet 44115d987e9746a3b4f158acec40ce8f (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:58.843294  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028a77b252d249a6bef6c5f1f87a39e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.846463  8200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44115d987e9746a3b4f158acec40ce8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.847203  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 54b37780d9694d53a9aa75ce1f7515b4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:58.848641  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b37780d9694d53a9aa75ce1f7515b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.850307  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d553c54f49c4cd1a7737e4136f02960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.852903  8199 tablet_service.cc:1511] Processing CreateTablet for tablet 6a377c652f93483693fc4684f03ffac4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:58.853746  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe403af31f9840f3b20788181ba23576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.861559  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 0545ed3bf21c4b3489c11d21d7796f22 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:58.880075  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0545ed3bf21c4b3489c11d21d7796f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.877890  8353 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6a07d8346e4fd5a54166e1cb3b1660 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:58.882874  8201 tablet_service.cc:1511] Processing CreateTablet for tablet d01b1e9908444e55b2b779bb7a18324a (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:58.884099  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01b1e9908444e55b2b779bb7a18324a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.886524  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:58.887552  8277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44115d987e9746a3b4f158acec40ce8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.888192  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:00:58.890187  8184 leader_election.cc:343] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.890663  8184 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:58.891402  8206 tablet_service.cc:1511] Processing CreateTablet for tablet fe6af4737faf47919cb8e012e72bb44e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:00:58.891835  8184 leader_election.cc:343] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.892300  8184 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:58.893744  8409 tablet_bootstrap.cc:654] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.894500  8350 tablet_service.cc:1511] Processing CreateTablet for tablet 7d553c54f49c4cd1a7737e4136f02960 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:58.895651  8412 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.896291  8412 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.874933  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:58.876178  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 84f1d898d0e9492bbd25195dba3e62d4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:58.897326  8293 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:00:58.897867  8408 tablet_bootstrap.cc:654] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.899205  8332 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:00:58.900017  8415 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.900368  8415 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.900691  8415 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.903614  8407 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:58.904120  8407 ts_tablet_manager.cc:1403] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.099s	user 0.017s	sys 0.043s
I20260709 13:00:58.904186  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 7effd0faf2d846cea5b8e82ac737b7e5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:58.886591  8199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a377c652f93483693fc4684f03ffac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.910753  8348 tablet_service.cc:1511] Processing CreateTablet for tablet 028a77b252d249a6bef6c5f1f87a39e9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:58.911011  8415 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
I20260709 13:00:58.911978  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f1d898d0e9492bbd25195dba3e62d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.913698  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:00:58.912976  8275 tablet_service.cc:1511] Processing CreateTablet for tablet 028a77b252d249a6bef6c5f1f87a39e9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:58.915275  8275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028a77b252d249a6bef6c5f1f87a39e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.876889  8351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d3b2e6d3394d178e2db304c3767659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.916005  8352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b726723bee647ec82d162a5cf1a6515. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:58.915160  8331 leader_election.cc:343] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.917080  8348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028a77b252d249a6bef6c5f1f87a39e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.918293  8349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0545ed3bf21c4b3489c11d21d7796f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.918948  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6a07d8346e4fd5a54166e1cb3b1660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.920125  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3161be69a5b64eea9d078c61741b3db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.921461  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d553c54f49c4cd1a7737e4136f02960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.923600  8276 tablet_service.cc:1511] Processing CreateTablet for tablet 6a377c652f93483693fc4684f03ffac4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:58.924451  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6af4737faf47919cb8e012e72bb44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.924866  8276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a377c652f93483693fc4684f03ffac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.868961  8280 tablet_service.cc:1511] Processing CreateTablet for tablet 84f1d898d0e9492bbd25195dba3e62d4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:58.930696  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e2862cbf8e4bfdb5395396ea06c348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.931048  8280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f1d898d0e9492bbd25195dba3e62d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.934376  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe403af31f9840f3b20788181ba23576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.895413  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6a07d8346e4fd5a54166e1cb3b1660 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:58.938851  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6a07d8346e4fd5a54166e1cb3b1660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.941092  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:00:58.941674  8293 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.942742  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7effd0faf2d846cea5b8e82ac737b7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.948772  8293 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:00:58.950268  8332 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:00:58.951277  8416 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.966800  8348 tablet_service.cc:1511] Processing CreateTablet for tablet 44115d987e9746a3b4f158acec40ce8f (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:58.968106  8348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44115d987e9746a3b4f158acec40ce8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.984352  8275 tablet_service.cc:1511] Processing CreateTablet for tablet 7d553c54f49c4cd1a7737e4136f02960 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:58.985615  8275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d553c54f49c4cd1a7737e4136f02960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.987964  8279 tablet_service.cc:1511] Processing CreateTablet for tablet 54b37780d9694d53a9aa75ce1f7515b4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:58.989212  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b37780d9694d53a9aa75ce1f7515b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.993702  8407 raft_consensus.cc:359] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.969816  8205 tablet_service.cc:1511] Processing CreateTablet for tablet ffe3e60c735644e380589d65b7850fd2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:58.994546  8407 raft_consensus.cc:385] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.994872  8407 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.995352  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe3e60c735644e380589d65b7850fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.995568  8407 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:58.978549  8415 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:58.996667  8276 tablet_service.cc:1511] Processing CreateTablet for tablet d01b1e9908444e55b2b779bb7a18324a (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:58.997838  8276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01b1e9908444e55b2b779bb7a18324a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.998157  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 54b37780d9694d53a9aa75ce1f7515b4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:58.999329  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b37780d9694d53a9aa75ce1f7515b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.004004  8274 tablet_service.cc:1511] Processing CreateTablet for tablet fe6af4737faf47919cb8e012e72bb44e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:59.005182  8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6af4737faf47919cb8e012e72bb44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.006651  8204 tablet_service.cc:1511] Processing CreateTablet for tablet 768b3b358c7c4b1fbbf348a322e1e144 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:59.007802  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768b3b358c7c4b1fbbf348a322e1e144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.017248  8200 tablet_service.cc:1511] Processing CreateTablet for tablet 13996684f22f4504bbd9a98a387657e7 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:59.018576  8200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13996684f22f4504bbd9a98a387657e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.021389  8407 ts_tablet_manager.cc:1434] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 13:00:59.021234  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 7effd0faf2d846cea5b8e82ac737b7e5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:59.022456  8407 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:59.022570  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7effd0faf2d846cea5b8e82ac737b7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.028264  8352 tablet_service.cc:1511] Processing CreateTablet for tablet 6a377c652f93483693fc4684f03ffac4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:59.029544  8352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a377c652f93483693fc4684f03ffac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.046315  8416 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:00:59.047245  8416 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
I20260709 13:00:59.059252  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 768b3b358c7c4b1fbbf348a322e1e144 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:59.060554  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768b3b358c7c4b1fbbf348a322e1e144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.049659  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 84f1d898d0e9492bbd25195dba3e62d4 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:59.062911  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f1d898d0e9492bbd25195dba3e62d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.066573  8350 tablet_service.cc:1511] Processing CreateTablet for tablet d01b1e9908444e55b2b779bb7a18324a (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:59.067399  8281 tablet_service.cc:1511] Processing CreateTablet for tablet ffe3e60c735644e380589d65b7850fd2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:59.068145  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01b1e9908444e55b2b779bb7a18324a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.068789  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe3e60c735644e380589d65b7850fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.070559  8412 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.071009  8412 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.072934  8412 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.074616  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.074985  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 768b3b358c7c4b1fbbf348a322e1e144 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:00:59.076056  8183 leader_election.cc:343] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.076213  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768b3b358c7c4b1fbbf348a322e1e144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.077494  8280 tablet_service.cc:1511] Processing CreateTablet for tablet 13996684f22f4504bbd9a98a387657e7 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:59.078691  8280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13996684f22f4504bbd9a98a387657e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.082969  8351 tablet_service.cc:1511] Processing CreateTablet for tablet 7effd0faf2d846cea5b8e82ac737b7e5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:59.084252  8351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7effd0faf2d846cea5b8e82ac737b7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.085029  8353 tablet_service.cc:1511] Processing CreateTablet for tablet ffe3e60c735644e380589d65b7850fd2 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:00:59.093052  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 200535us
I20260709 13:00:59.103132  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe3e60c735644e380589d65b7850fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.106458  8349 tablet_service.cc:1511] Processing CreateTablet for tablet fe6af4737faf47919cb8e012e72bb44e (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:59.107717  8349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6af4737faf47919cb8e012e72bb44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.108199  8408 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.108733  8408 ts_tablet_manager.cc:1403] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.416s	user 0.024s	sys 0.015s
I20260709 13:00:59.111649  8408 raft_consensus.cc:359] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.108232  8356 tablet_service.cc:1511] Processing CreateTablet for tablet 13996684f22f4504bbd9a98a387657e7 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:59.148440  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13996684f22f4504bbd9a98a387657e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.118728  8279 tablet_service.cc:1511] Processing CreateTablet for tablet cc7fa1d719554be2a7a068962b4672d8 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:59.150848  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7fa1d719554be2a7a068962b4672d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.151104  8274 tablet_service.cc:1511] Processing CreateTablet for tablet 58573b7fd6d5467ea27aa5185d42aed7 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:59.152280  8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58573b7fd6d5467ea27aa5185d42aed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.141827  8357 tablet_service.cc:1511] Processing CreateTablet for tablet cc7fa1d719554be2a7a068962b4672d8 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:59.156340  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7fa1d719554be2a7a068962b4672d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.157109  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 58573b7fd6d5467ea27aa5185d42aed7 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:59.158273  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58573b7fd6d5467ea27aa5185d42aed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.160436  8204 tablet_service.cc:1511] Processing CreateTablet for tablet c253a65d080e4e3f8185f6278cc7b6f9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:59.161679  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c253a65d080e4e3f8185f6278cc7b6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.162472  8276 tablet_service.cc:1511] Processing CreateTablet for tablet c253a65d080e4e3f8185f6278cc7b6f9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:59.163674  8276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c253a65d080e4e3f8185f6278cc7b6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.166127  8408 raft_consensus.cc:385] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.166528  8408 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.167441  8408 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.130877  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:59.133093  8205 tablet_service.cc:1511] Processing CreateTablet for tablet cc7fa1d719554be2a7a068962b4672d8 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:59.133236  8203 tablet_service.cc:1511] Processing CreateTablet for tablet c777a0028400426e8927312e58b8d1c5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:59.134598  8352 tablet_service.cc:1511] Processing CreateTablet for tablet f6d613c8b7844e67ad3e2aa415a57d42 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:59.184028  8352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d613c8b7844e67ad3e2aa415a57d42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:59.184309  8184 leader_election.cc:343] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.184857  8184 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:59.187085  8429 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.189143  8353 tablet_service.cc:1511] Processing CreateTablet for tablet c253a65d080e4e3f8185f6278cc7b6f9 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:59.189380  8204 tablet_service.cc:1511] Processing CreateTablet for tablet a28b8f6279ab44fcb0de6caac309a961 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:59.190495  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c253a65d080e4e3f8185f6278cc7b6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.191583  8408 ts_tablet_manager.cc:1434] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:00:59.134970  8202 tablet_service.cc:1511] Processing CreateTablet for tablet f6d613c8b7844e67ad3e2aa415a57d42 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:59.137986  8409 tablet_bootstrap.cc:492] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.136318  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 58573b7fd6d5467ea27aa5185d42aed7 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:59.142699  8348 tablet_service.cc:1511] Processing CreateTablet for tablet c777a0028400426e8927312e58b8d1c5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:59.194060  8409 ts_tablet_manager.cc:1403] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.416s	user 0.018s	sys 0.002s
I20260709 13:00:59.194386  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7fa1d719554be2a7a068962b4672d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.197060  8409 raft_consensus.cc:359] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.197770  8409 raft_consensus.cc:385] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.198310  8409 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.199219  8409 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.143827  8283 tablet_service.cc:1511] Processing CreateTablet for tablet f6d613c8b7844e67ad3e2aa415a57d42 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:59.125352  8277 tablet_service.cc:1511] Processing CreateTablet for tablet c777a0028400426e8927312e58b8d1c5 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:59.202701  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58573b7fd6d5467ea27aa5185d42aed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.203591  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28b8f6279ab44fcb0de6caac309a961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.203933  8409 ts_tablet_manager.cc:1434] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:59.206151  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d613c8b7844e67ad3e2aa415a57d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.206351  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c777a0028400426e8927312e58b8d1c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.210120  8409 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.210397  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d613c8b7844e67ad3e2aa415a57d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.135123  8407 tablet_bootstrap.cc:654] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.214612  8277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c777a0028400426e8927312e58b8d1c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.219117  8278 tablet_service.cc:1511] Processing CreateTablet for tablet a28b8f6279ab44fcb0de6caac309a961 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:59.220402  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28b8f6279ab44fcb0de6caac309a961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.227880  8348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c777a0028400426e8927312e58b8d1c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.242713  8351 tablet_service.cc:1511] Processing CreateTablet for tablet a28b8f6279ab44fcb0de6caac309a961 (DEFAULT_TABLE table=test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:00:59.243721  8164 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:59.240876  8408 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.258311  8351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28b8f6279ab44fcb0de6caac309a961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:59.259800  8114 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.268222  8409 tablet_bootstrap.cc:654] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.293579  8407 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:59.294091  8407 ts_tablet_manager.cc:1403] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.272s	user 0.021s	sys 0.000s
I20260709 13:00:59.296727  8407 raft_consensus.cc:359] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.297394  8407 raft_consensus.cc:385] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.297685  8407 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.298367  8408 tablet_bootstrap.cc:654] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.308799  8409 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.309670  8409 ts_tablet_manager.cc:1403] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.100s	user 0.021s	sys 0.000s
I20260709 13:00:59.303529  8407 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.312327  8407 ts_tablet_manager.cc:1434] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:00:59.312831  8409 raft_consensus.cc:359] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.313510  8407 tablet_bootstrap.cc:492] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:59.313568  8409 raft_consensus.cc:385] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.316370  8409 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.317369  8409 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.320524  8407 tablet_bootstrap.cc:654] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.325949  8408 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.326416  8408 ts_tablet_manager.cc:1403] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.012s
I20260709 13:00:59.328037  8409 ts_tablet_manager.cc:1434] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:00:59.329200  8409 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.329296  8408 raft_consensus.cc:359] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.330029  8408 raft_consensus.cc:385] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.330331  8408 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.331130  8408 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.333634  8408 ts_tablet_manager.cc:1434] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:59.334583  8408 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.338701  8409 tablet_bootstrap.cc:654] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.341148  8408 tablet_bootstrap.cc:654] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.341712  8407 tablet_bootstrap.cc:492] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:59.342211  8407 ts_tablet_manager.cc:1403] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.005s
I20260709 13:00:59.345157  8407 raft_consensus.cc:359] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.345849  8407 raft_consensus.cc:385] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.346158  8407 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.346925  8407 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.349795  8408 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.350333  8408 ts_tablet_manager.cc:1403] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:00:59.351707  8407 ts_tablet_manager.cc:1434] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.005s
I20260709 13:00:59.352675  8407 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:59.353354  8408 raft_consensus.cc:359] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.355283  8408 raft_consensus.cc:385] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.355559  8408 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.356379  8408 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.357926  8409 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.358470  8409 ts_tablet_manager.cc:1403] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 13:00:59.359427  8407 tablet_bootstrap.cc:654] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.361096  8408 ts_tablet_manager.cc:1434] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:00:59.361491  8409 raft_consensus.cc:359] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.362108  8408 tablet_bootstrap.cc:492] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.362278  8409 raft_consensus.cc:385] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.362653  8409 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.363494  8409 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.365429  8416 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.365875  8416 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.368324  8416 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:59.369815  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:00:59.371107  8332 leader_election.cc:343] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.372184  8409 ts_tablet_manager.cc:1434] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:00:59.372668  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.373304  8409 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
W20260709 13:00:59.374540  8331 leader_election.cc:343] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.375044  8331 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:00:59.375289  8408 tablet_bootstrap.cc:654] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.375874  8416 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.380456  8409 tablet_bootstrap.cc:654] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.387540  8408 tablet_bootstrap.cc:492] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.388044  8408 ts_tablet_manager.cc:1403] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.008s
I20260709 13:00:59.391036  8408 raft_consensus.cc:359] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.391819  8408 raft_consensus.cc:385] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.392117  8408 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.393051  8408 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.396525  8409 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.397027  8409 ts_tablet_manager.cc:1403] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:00:59.398404  8407 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:59.398819  8408 ts_tablet_manager.cc:1434] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:00:59.398854  8407 ts_tablet_manager.cc:1403] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.024s
I20260709 13:00:59.399887  8408 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.399765  8409 raft_consensus.cc:359] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.400502  8409 raft_consensus.cc:385] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.400784  8409 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.401572  8409 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.401846  8407 raft_consensus.cc:359] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.402570  8407 raft_consensus.cc:385] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.402858  8407 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.403627  8407 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.406404  8408 tablet_bootstrap.cc:654] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.408928  8409 ts_tablet_manager.cc:1434] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:00:59.409097  8407 ts_tablet_manager.cc:1434] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.004s
I20260709 13:00:59.409950  8407 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:59.410856  8409 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.414089  8429 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.414585  8429 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.416733  8429 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.417423  8409 tablet_bootstrap.cc:654] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.417610  8408 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.418031  8408 ts_tablet_manager.cc:1403] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:00:59.421676  8408 raft_consensus.cc:359] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.422477  8408 raft_consensus.cc:385] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.422780  8408 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.423828  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:59.423642  8408 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:00:59.425662  8184 leader_election.cc:343] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.426033  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.426661  8293 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:00:59.427886  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:59.429184  8429 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.429625  8429 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.430027  8429 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.432490  8408 ts_tablet_manager.cc:1434] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:00:59.433480  8408 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.435252  8413 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.436031  8407 tablet_bootstrap.cc:654] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.435703  8413 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.437767  8413 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.439678  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:59.440861  8409 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.441254  8409 ts_tablet_manager.cc:1403] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.017s
I20260709 13:00:59.439785  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.438987  8429 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:00:59.441504  8259 leader_election.cc:343] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.442063  8218 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:00:59.443864  8257 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:59.444082  8409 raft_consensus.cc:359] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.444785  8409 raft_consensus.cc:385] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.445050  8413 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.445055  8409 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.445612  8413 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.445978  8413 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.446005  8409 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.455673  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:00:59.456408  8293 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.457583  8413 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.468581  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:00:59.469354  8218 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.470912  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:00:59.472697  8184 leader_election.cc:343] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.473376  8429 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.468672  8293 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:00:59.475216  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:59.476775  8429 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.477632  8218 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:00:59.478271  8429 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:00:59.479018  8257 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:00:59.479363  8429 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.485652  8409 ts_tablet_manager.cc:1434] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.044s	user 0.019s	sys 0.023s
I20260709 13:00:59.486414  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:00:59.486775  8409 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.488713  8407 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:59.489317  8407 ts_tablet_manager.cc:1403] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.035s
I20260709 13:00:59.489413  8450 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.489951  8450 raft_consensus.cc:697] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:00:59.492120  8450 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.492689  8407 raft_consensus.cc:359] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
I20260709 13:00:59.493516  8409 tablet_bootstrap.cc:654] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.493585  8407 raft_consensus.cc:385] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.494127  8407 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.496884  8413 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.497761  8407 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } }
I20260709 13:00:59.498039  8413 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.499575  8413 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.500710  8407 ts_tablet_manager.cc:1434] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:00:59.501741  8407 tablet_bootstrap.cc:492] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:59.504117  8408 tablet_bootstrap.cc:654] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.508766  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:00:59.509114  8259 leader_election.cc:343] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.509445  8367 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:00:59.501657  8413 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.510833  8259 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.508730  8407 tablet_bootstrap.cc:654] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.513983  8409 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.514501  8409 ts_tablet_manager.cc:1403] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.006s
I20260709 13:00:59.517781  8409 raft_consensus.cc:359] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.518532  8409 raft_consensus.cc:385] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.518810  8409 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.522744  8409 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.524969  8409 ts_tablet_manager.cc:1434] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:59.526027  8412 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.526542  8412 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.526835  8116 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.528857  8412 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.526031  8409 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.530160  8416 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.530637  8416 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.532711  8416 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:59.534899  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.535971  8409 tablet_bootstrap.cc:654] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.536507  8293 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:00:59.538420  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:59.539040  8367 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:00:59.541075  8451 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.541671  8451 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.542093  8451 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.542797  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.544377  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.545719  8217 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:00:59.547610  8416 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.548075  8416 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.548501  8416 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.549484  8409 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.549963  8409 ts_tablet_manager.cc:1403] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.003s
I20260709 13:00:59.545450  8184 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.552115  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.552830  8412 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.552691  8409 raft_consensus.cc:359] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.553335  8409 raft_consensus.cc:385] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.553277  8412 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.553653  8409 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.518366  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.554472  8218 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:00:59.554399  8409 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.557510  8409 ts_tablet_manager.cc:1434] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:59.558462  8409 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.558190  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.558898  8412 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.559394  8412 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.559442  8292 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:00:59.559783  8412 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.560151  8412 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.561079  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:00:59.564361  8409 tablet_bootstrap.cc:654] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.568746  8430 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:59.577399  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:59.578063  8367 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:00:59.578428  8409 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.578860  8409 ts_tablet_manager.cc:1403] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:00:59.580574  8459 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.580991  8459 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.581305  8459 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.582172  8409 raft_consensus.cc:359] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.582834  8409 raft_consensus.cc:385] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.583088  8409 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.583731  8409 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.586001  8409 ts_tablet_manager.cc:1434] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:59.586915  8409 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.592247  8409 tablet_bootstrap.cc:654] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.597435  8408 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.600610  8114 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.604555  8409 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.605020  8409 ts_tablet_manager.cc:1403] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:00:59.602525  8408 ts_tablet_manager.cc:1403] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.000s
I20260709 13:00:59.607661  8409 raft_consensus.cc:359] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.620153  8409 raft_consensus.cc:385] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.620462  8409 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.613934  8459 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.591993  8412 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.619831  8416 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.623350  8412 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.619704  8218 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.625078  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:00:59.625751  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:00:59.628921  8459 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.628021  8451 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.629523  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:00:59.629595  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:00:59.633668  8367 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.624717  8409 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.623953  8408 raft_consensus.cc:359] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.636659  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:00:59.638903  8291 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.647949  8217 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.648067  8367 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:00:59.639299  8366 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.649325  8184 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:00:59.650473  8459 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.651688  8459 raft_consensus.cc:697] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:00:59.652516  8459 consensus_queue.cc:237] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.640836  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:00:59.654332  8292 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.655272  8217 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:00:59.656255  8408 raft_consensus.cc:385] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.642381  8293 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 1: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:00:59.662168  8331 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.663576  8465 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.664095  8465 raft_consensus.cc:697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:00:59.644104  8451 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.645159  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:00:59.645509  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:00:59.647149  8409 ts_tablet_manager.cc:1434] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:00:59.641520  8416 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:59.669875  8409 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.670849  8365 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 1: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:00:59.669066  8408 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.674437  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:59.675235  8451 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.665723  8465 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.677747  8116 catalog_manager.cc:5697] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.674412  8366 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:00:59.685849  8408 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.687997  8409 tablet_bootstrap.cc:654] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.689215  8408 ts_tablet_manager.cc:1434] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:00:59.690727  8408 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.669945  8292 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:00:59.695659  8184 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.697175  8407 tablet_bootstrap.cc:492] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:59.697779  8407 ts_tablet_manager.cc:1403] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.196s	user 0.043s	sys 0.063s
I20260709 13:00:59.698406  8459 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.699640  8459 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:00:59.700577  8459 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.704820  8291 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:00:59.704223  8114 catalog_manager.cc:5697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.707842  8451 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.708395  8451 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.711043  8451 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.710816  8465 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:59.713917  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:59.714584  8366 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:00:59.715838  8259 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.716459  8409 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.716986  8409 ts_tablet_manager.cc:1403] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.000s
I20260709 13:00:59.717648  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.719918  8409 raft_consensus.cc:359] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.720503  8407 raft_consensus.cc:359] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.720829  8409 raft_consensus.cc:385] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.721161  8407 raft_consensus.cc:385] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.721500  8409 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.721735  8407 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.724298  8451 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.722518  8407 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.722514  8409 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.733600  8451 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.734652  8451 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:59.723445  8257 leader_election.cc:343] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.739801  8408 tablet_bootstrap.cc:654] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.741362  8409 ts_tablet_manager.cc:1434] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.011s
I20260709 13:00:59.745152  8451 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.748106  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:00:59.735073  8407 ts_tablet_manager.cc:1434] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.004s
I20260709 13:00:59.749871  8407 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
W20260709 13:00:59.750648  8257 leader_election.cc:343] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.745689  8409 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.762355  8407 tablet_bootstrap.cc:654] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.762776  8451 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.763423  8409 tablet_bootstrap.cc:654] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.763198  8116 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.766968  8407 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:59.766916  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:00:59.767566  8407 ts_tablet_manager.cc:1403] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:00:59.768852  8409 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.769272  8409 ts_tablet_manager.cc:1403] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.005s
I20260709 13:00:59.769726  8407 raft_consensus.cc:359] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.770280  8407 raft_consensus.cc:385] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.770500  8407 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.771076  8407 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.771874  8409 raft_consensus.cc:359] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.772526  8407 ts_tablet_manager.cc:1434] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:00:59.772533  8409 raft_consensus.cc:385] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.772933  8409 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.773377  8407 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:59.767552  8366 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.773561  8409 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.779162  8407 tablet_bootstrap.cc:654] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.780704  8408 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.780999  8366 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:00:59.781162  8408 ts_tablet_manager.cc:1403] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.005s
I20260709 13:00:59.783735  8408 raft_consensus.cc:359] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.784396  8408 raft_consensus.cc:385] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.784654  8408 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.785223  8408 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.785873  8409 ts_tablet_manager.cc:1434] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:00:59.787912  8408 ts_tablet_manager.cc:1434] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:59.788830  8408 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.791608  8451 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.792069  8451 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.793063  8409 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.794178  8451 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.795369  8259 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:00:59.795701  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:00:59.796294  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.794219  8408 tablet_bootstrap.cc:654] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:59.797425  8257 leader_election.cc:343] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.803617  8407 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:59.804195  8409 tablet_bootstrap.cc:654] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.804167  8407 ts_tablet_manager.cc:1403] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.002s
W20260709 13:00:59.804744  8259 leader_election.cc:343] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.805195  8259 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:59.805985  8413 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.806320  8465 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.806387  8451 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.806877  8465 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.806505  8413 raft_consensus.cc:697] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:00:59.808250  8413 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.813405  8465 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:59.813560  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.814234  8218 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:00:59.814589  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.815198  8291 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:00:59.815282  8331 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.815407  8407 raft_consensus.cc:359] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.817293  8408 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.817770  8407 raft_consensus.cc:385] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.818243  8465 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.818842  8465 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.819275  8465 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.817821  8408 ts_tablet_manager.cc:1403] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.007s
I20260709 13:00:59.818365  8407 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.822685  8407 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.825325  8114 catalog_manager.cc:5697] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.825968  8408 raft_consensus.cc:359] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.827769  8462 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.833429  8408 raft_consensus.cc:385] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.833745  8408 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.833621  8462 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.834582  8408 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.835847  8462 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:59.828320  8407 ts_tablet_manager.cc:1434] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:00:59.837340  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.837791  8407 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:59.838753  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.839644  8218 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:00:59.841370  8331 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.842764  8466 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.832798  8465 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.843127  8466 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.843487  8466 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.844098  8407 tablet_bootstrap.cc:654] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.845839  8409 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.846791  8409 ts_tablet_manager.cc:1403] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.017s
I20260709 13:00:59.847630  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:00:59.848220  8292 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.849787  8409 raft_consensus.cc:359] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.850549  8409 raft_consensus.cc:385] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.850812  8409 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.851547  8409 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.853966  8409 ts_tablet_manager.cc:1434] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:59.854889  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:00:59.855516  8218 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.855958  8409 tablet_bootstrap.cc:492] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.862950  8409 tablet_bootstrap.cc:654] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.874218  8291 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:00:59.875244  8409 tablet_bootstrap.cc:492] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.875809  8409 ts_tablet_manager.cc:1403] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:00:59.879392  8409 raft_consensus.cc:359] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.880455  8409 raft_consensus.cc:385] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.880609  8465 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:59.880350  8292 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:00:59.880861  8409 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.882350  8332 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.882310  8409 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.883519  8465 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.885423  8409 ts_tablet_manager.cc:1434] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:00:59.843127  8408 ts_tablet_manager.cc:1434] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:00:59.886983  8409 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.891341  8465 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:00:59.892518  8218 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:00:59.891381  8408 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.893477  8409 tablet_bootstrap.cc:654] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.893344  8466 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.892236  8465 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.908540  8409 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.908485  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:00:59.909431  8409 ts_tablet_manager.cc:1403] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260709 13:00:59.909543  8292 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.906383  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:00:59.912537  8409 raft_consensus.cc:359] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.913235  8409 raft_consensus.cc:385] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.913552  8409 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.913018  8218 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.915273  8459 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.917258  8409 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.908583  8466 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:00:59.917109  8407 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:00:59.919373  8409 ts_tablet_manager.cc:1434] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:59.922201  8407 ts_tablet_manager.cc:1403] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.055s
I20260709 13:00:59.922668  8409 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:00:59.924755  8407 raft_consensus.cc:359] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.925420  8407 raft_consensus.cc:385] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.925694  8407 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.926455  8407 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.928380  8409 tablet_bootstrap.cc:654] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.929308  8292 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:00:59.933204  8332 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:00:59.934165  8466 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.934685  8466 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:00:59.935650  8466 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.930941  8407 ts_tablet_manager.cc:1434] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:59.936956  8366 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.937227  8407 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:00:59.921046  8114 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.944160  8407 tablet_bootstrap.cc:654] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.949240  8429 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.949896  8429 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.903318  8408 tablet_bootstrap.cc:654] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.952214  8429 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.954161  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:00:59.956712  8184 leader_election.cc:343] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.957661  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.958420  8292 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:00:59.959758  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:59.960856  8429 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.961216  8429 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.961344  8408 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:00:59.961572  8429 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.962253  8408 ts_tablet_manager.cc:1403] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 13:00:59.963853  8412 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.964883  8408 raft_consensus.cc:359] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.965528  8408 raft_consensus.cc:385] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.965782  8408 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.966451  8408 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.961366  8218 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:00:59.969820  8413 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.970407  8413 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.972487  8413 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.973421  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.974154  8408 ts_tablet_manager.cc:1434] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:59.973978  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:00:59.975320  8259 leader_election.cc:343] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:59.975994  8257 leader_election.cc:343] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.976431  8257 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:00:59.977496  8408 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:00:59.977375  8429 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.977782  8413 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.979485  8429 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:00:59.980662  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:00:59.981103  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:00:59.981362  8291 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:59.982613  8184 leader_election.cc:343] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.982605  8465 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.983616  8465 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.986567  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:00:59.986781  8409 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:00:59.987351  8409 ts_tablet_manager.cc:1403] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.018s
I20260709 13:00:59.988873  8465 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:00:59.990154  8331 leader_election.cc:343] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.989997  8409 raft_consensus.cc:359] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.990778  8409 raft_consensus.cc:385] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.991065  8409 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.991190  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:00:59.991870  8292 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:00:59.992167  8408 tablet_bootstrap.cc:654] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.993039  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:00:59.994323  8465 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.994684  8465 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.994616  8409 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:00:59.995122  8465 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.996699  8409 ts_tablet_manager.cc:1434] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:00:59.998694  8409 tablet_bootstrap.cc:492] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:00.004179  8409 tablet_bootstrap.cc:654] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.004540  8407 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.005013  8407 ts_tablet_manager.cc:1403] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.068s	user 0.006s	sys 0.018s
I20260709 13:01:00.016362  8291 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:00.017828  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:00.018849  8413 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.023763  8429 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.024895  8429 raft_consensus.cc:697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:00.025758  8429 consensus_queue.cc:237] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.021263  8116 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.029335  8465 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.032717  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:00.033353  8292 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.034797  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:01:00.036448  8331 leader_election.cc:343] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.039408  8408 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.039896  8408 ts_tablet_manager.cc:1403] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 13:01:00.037156  8407 raft_consensus.cc:359] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.042039  8407 raft_consensus.cc:385] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.042347  8407 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.042551  8408 raft_consensus.cc:359] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.042727  8465 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.043186  8408 raft_consensus.cc:385] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.043537  8408 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.043905  8292 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:00.044100  8407 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.044373  8408 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.046705  8408 ts_tablet_manager.cc:1434] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:00.047760  8407 ts_tablet_manager.cc:1434] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.004s
I20260709 13:01:00.047605  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:00.048661  8407 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.027427  8366 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.047716  8408 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.054500  8409 tablet_bootstrap.cc:492] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:00.054824  8407 tablet_bootstrap.cc:654] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.054999  8409 ts_tablet_manager.cc:1403] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.002s
I20260709 13:01:00.055420  8466 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.056156  8466 raft_consensus.cc:697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:00.057134  8466 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.060312  8462 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:00.066099  8116 catalog_manager.cc:5697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.073575  8409 raft_consensus.cc:359] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.074591  8409 raft_consensus.cc:385] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.075071  8409 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.075841  8409 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.078109  8409 ts_tablet_manager.cc:1434] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 13:01:00.079090  8409 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:00.074303  8453 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.083778  8466 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:00.091677  8408 tablet_bootstrap.cc:654] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.092360  8412 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.094894  8413 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.095386  8413 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.097561  8413 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.099017  8412 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.103147  8453 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.103574  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.103619  8453 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.107071  8453 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.112478  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.113215  8367 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:00.115664  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:00.115970  8409 tablet_bootstrap.cc:654] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.115887  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:00.117929  8257 leader_election.cc:343] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.117851  8459 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:00.118860  8257 leader_election.cc:343] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:00.121271  8259 leader_election.cc:343] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.121783  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:00.122328  8407 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.122848  8407 ts_tablet_manager.cc:1403] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.074s	user 0.033s	sys 0.009s
I20260709 13:01:00.123648  8451 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.127013  8408 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.127501  8408 ts_tablet_manager.cc:1403] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.000s
I20260709 13:01:00.128217  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:00.128558  8407 raft_consensus.cc:359] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.129258  8407 raft_consensus.cc:385] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.129546  8407 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.129746  8413 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.130201  8413 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.130548  8413 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.131851  8407 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.134948  8407 ts_tablet_manager.cc:1434] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:00.135946  8407 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.140081  8408 raft_consensus.cc:359] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.143978  8408 raft_consensus.cc:385] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.144281  8408 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.145169  8407 tablet_bootstrap.cc:654] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.146610  8409 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:00.147068  8409 ts_tablet_manager.cc:1403] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.004s
I20260709 13:01:00.151271  8408 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.154373  8453 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.154875  8453 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.156347  8408 ts_tablet_manager.cc:1434] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:01:00.156935  8453 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.157291  8408 tablet_bootstrap.cc:492] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.159091  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:00.160442  8257 leader_election.cc:343] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.149871  8409 raft_consensus.cc:359] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.160983  8409 raft_consensus.cc:385] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.161270  8409 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.162842  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.163043  8412 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.163281  8409 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.165625  8409 ts_tablet_manager.cc:1434] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
W20260709 13:01:00.168907  8259 leader_election.cc:343] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.169559  8259 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:00.170370  8453 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.170403  8413 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.172425  8408 tablet_bootstrap.cc:654] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.173480  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:00.174166  8216 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.175557  8407 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.176164  8407 ts_tablet_manager.cc:1403] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.006s
I20260709 13:01:00.179339  8407 raft_consensus.cc:359] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.180524  8407 raft_consensus.cc:385] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.180831  8407 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.182139  8407 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.183350  8216 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:00.184933  8257 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:00.185846  8407 ts_tablet_manager.cc:1434] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:00.186110  8453 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.186691  8453 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:00.187203  8407 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.187518  8453 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.188853  8408 tablet_bootstrap.cc:492] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.189891  8408 ts_tablet_manager.cc:1403] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 13:01:00.190778  8451 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.191304  8451 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.192662  8408 raft_consensus.cc:359] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.193310  8408 raft_consensus.cc:385] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.193570  8408 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.194145  8451 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.194782  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.196185  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:00.197028  8259 leader_election.cc:343] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:00.197853  8257 leader_election.cc:343] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.198333  8257 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:00.198418  8408 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.200351  8407 tablet_bootstrap.cc:654] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.201363  8451 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.203464  8408 ts_tablet_manager.cc:1434] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:01:00.204741  8408 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.215517  8407 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.216121  8407 ts_tablet_manager.cc:1403] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.008s
I20260709 13:01:00.221350  8466 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.221885  8466 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.222873  8408 tablet_bootstrap.cc:654] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.224232  8466 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.227588  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.230476  8291 raft_consensus.cc:2393] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 1: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:00.231961  8459 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.232434  8453 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.232504  8459 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.235811  8459 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.236250  8408 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.236682  8408 ts_tablet_manager.cc:1403] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.003s
I20260709 13:01:00.225880  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:00.227407  8409 tablet_bootstrap.cc:492] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:00.227669  8413 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.228029  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:00.229189  8430 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.242753  8430 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.245545  8430 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.246685  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:00.248250  8331 leader_election.cc:343] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.250924  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.251637  8293 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:00.252930  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:00.242046  8367 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.254060  8430 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.254658  8430 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.255020  8430 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.258261  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:00.258777  8164 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:00.259931  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.261843  8407 raft_consensus.cc:359] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.261969  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:00.261935  8331 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:00.262567  8407 raft_consensus.cc:385] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.262271  8408 raft_consensus.cc:359] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.262950  8408 raft_consensus.cc:385] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.263201  8408 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.263391  8466 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.263873  8408 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.266856  8407 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.267645  8459 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.267602  8407 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.268539  8413 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.269057  8413 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.269672  8407 ts_tablet_manager.cc:1434] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.000s
I20260709 13:01:00.270612  8407 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.271550  8408 ts_tablet_manager.cc:1434] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:01:00.272847  8408 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.277159  8413 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.278972  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:00.280524  8259 leader_election.cc:343] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.285102  8116 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.285109  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:00.287725  8459 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.287902  8257 leader_election.cc:343] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.288394  8257 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:00.288262  8459 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.289487  8413 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.290423  8459 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.291275  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.291906  8291 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:00.292497  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.293013  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:00.293082  8364 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:00.293879  8459 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.294257  8459 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.294585  8459 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.299922  8459 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.300414  8367 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:00.304312  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:00.304705  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:00.304919  8291 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.305218  8364 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.306397  8459 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.299867  8466 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.311319  8218 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.310878  8114 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.310030  8430 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.329334  8451 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.330212  8430 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.331771  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:00.332356  8293 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.332924  8409 tablet_bootstrap.cc:654] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.334374  8407 tablet_bootstrap.cc:654] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.335745  8291 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:00.337808  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:00.338815  8459 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.339237  8408 tablet_bootstrap.cc:654] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.339534  8459 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:00.333925  8364 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:00.341230  8459 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.343362  8293 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:00.345968  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:00.347316  8430 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.347919  8412 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.348033  8430 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:00.348379  8412 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.348856  8430 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.350628  8412 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.350775  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:00.351346  8217 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.358059  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.359028  8292 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 1: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:00.359323  8408 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.360225  8408 ts_tablet_manager.cc:1403] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.001s
I20260709 13:01:00.362782  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.364387  8184 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:00.365669  8459 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.372545  8408 raft_consensus.cc:359] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.373483  8408 raft_consensus.cc:385] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.373932  8465 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.374164  8459 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.373821  8408 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.377398  8409 tablet_bootstrap.cc:492] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:00.377931  8409 ts_tablet_manager.cc:1403] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.007s
I20260709 13:01:00.378142  8408 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.377355  8217 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:00.381742  8409 raft_consensus.cc:359] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.383142  8409 raft_consensus.cc:385] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.383415  8409 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.384598  8407 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.384845  8409 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.385423  8408 ts_tablet_manager.cc:1434] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:01:00.386384  8408 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.386970  8407 ts_tablet_manager.cc:1403] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.004s
I20260709 13:01:00.386608  8465 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:00.398115  8409 ts_tablet_manager.cc:1434] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:01:00.362317  8466 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:01:00.402668  8409 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:00.409987  8407 raft_consensus.cc:359] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.410657  8407 raft_consensus.cc:385] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.410871  8407 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.411420  8407 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.414336  8407 ts_tablet_manager.cc:1434] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:01:00.415200  8407 tablet_bootstrap.cc:492] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.423004  8408 tablet_bootstrap.cc:654] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.422379  8115 catalog_manager.cc:5697] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.428555  8407 tablet_bootstrap.cc:654] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.430158  8409 tablet_bootstrap.cc:654] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.444598  8407 tablet_bootstrap.cc:492] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.445094  8407 ts_tablet_manager.cc:1403] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.001s
I20260709 13:01:00.444375  8116 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.445258  8430 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.447808  8407 raft_consensus.cc:359] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.448493  8407 raft_consensus.cc:385] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.448752  8407 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.472287  8416 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.475422  8412 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.492661  8412 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:00.495747  8408 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.496245  8408 ts_tablet_manager.cc:1403] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.024s
I20260709 13:01:00.498755  8408 raft_consensus.cc:359] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.499413  8408 raft_consensus.cc:385] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.500236  8408 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.500878  8408 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.503103  8408 ts_tablet_manager.cc:1434] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:01:00.503010  8462 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.504029  8408 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.506297  8409 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:00.506765  8409 ts_tablet_manager.cc:1403] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.000s
I20260709 13:01:00.509260  8409 raft_consensus.cc:359] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.510723  8408 tablet_bootstrap.cc:654] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.511643  8407 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.516974  8407 ts_tablet_manager.cc:1434] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:01:00.522317  8408 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.522835  8408 ts_tablet_manager.cc:1403] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:01:00.523882  8407 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.525398  8408 raft_consensus.cc:359] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.526111  8408 raft_consensus.cc:385] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.526396  8408 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.527115  8408 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.529585  8408 ts_tablet_manager.cc:1434] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:00.509975  8409 raft_consensus.cc:385] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.530524  8408 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.530483  8409 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.532639  8409 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.536069  8409 ts_tablet_manager.cc:1434] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:01:00.536960  8409 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:00.540442  8459 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.540616  8407 tablet_bootstrap.cc:654] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.540616  8408 tablet_bootstrap.cc:654] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.540982  8459 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.544827  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:01:00.546223  8183 leader_election.cc:343] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.547899  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.548542  8364 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:00.549966  8184 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:00.550752  8429 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.551118  8429 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.551467  8429 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.553531  8459 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.556921  8408 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.557387  8408 ts_tablet_manager.cc:1403] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.007s
I20260709 13:01:00.559859  8408 raft_consensus.cc:359] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.560490  8408 raft_consensus.cc:385] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.560748  8408 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.561367  8408 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.561019  8429 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.563406  8408 ts_tablet_manager.cc:1434] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:00.564267  8408 tablet_bootstrap.cc:492] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.564229  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:01:00.565665  8183 leader_election.cc:343] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.566526  8409 tablet_bootstrap.cc:654] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.570448  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:00.571061  8364 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.571996  8408 tablet_bootstrap.cc:654] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.582885  8364 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:00.583683  8408 tablet_bootstrap.cc:492] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.584282  8408 ts_tablet_manager.cc:1403] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 13:01:00.584444  8184 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:00.585479  8412 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.586040  8412 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:00.588297  8429 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.587970  8412 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.587951  8408 raft_consensus.cc:359] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.590478  8408 raft_consensus.cc:385] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.590757  8408 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.591372  8408 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.592748  8409 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:00.593205  8409 ts_tablet_manager.cc:1403] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:01:00.594498  8408 ts_tablet_manager.cc:1434] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:01:00.595737  8408 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.597122  8409 raft_consensus.cc:359] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.597756  8409 raft_consensus.cc:385] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.598008  8409 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.598671  8409 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.600921  8409 ts_tablet_manager.cc:1434] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:00.602270  8409 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:00.604024  8466 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.604511  8466 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.605528  8408 tablet_bootstrap.cc:654] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.606617  8466 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.607524  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:00.608153  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.608846  8292 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
W20260709 13:01:00.609066  8331 leader_election.cc:343] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.619282  8409 tablet_bootstrap.cc:654] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.623008  8115 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.624276  8407 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.624734  8407 ts_tablet_manager.cc:1403] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.020s
I20260709 13:01:00.626241  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:00.629585  8407 raft_consensus.cc:359] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.629528  8466 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.630440  8466 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.630710  8466 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.631795  8407 raft_consensus.cc:385] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.632019  8407 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.632669  8407 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.635035  8407 ts_tablet_manager.cc:1434] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:01:00.635973  8407 tablet_bootstrap.cc:492] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.640275  8466 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.642956  8408 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.643115  8466 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.643473  8408 ts_tablet_manager.cc:1403] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.016s
I20260709 13:01:00.646312  8408 raft_consensus.cc:359] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.646860  8407 tablet_bootstrap.cc:654] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.646989  8408 raft_consensus.cc:385] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.647302  8408 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.647645  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:00.648209  8292 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.648057  8408 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.651077  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:00.652387  8408 ts_tablet_manager.cc:1434] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:00.653328  8408 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
W20260709 13:01:00.654103  8331 leader_election.cc:343] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.655061  8292 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:00.657894  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:00.659107  8466 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.659909  8466 raft_consensus.cc:697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:00.660722  8466 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.656831  8409 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:00.662854  8409 ts_tablet_manager.cc:1403] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.011s
I20260709 13:01:00.665482  8409 raft_consensus.cc:359] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.665999  8409 raft_consensus.cc:385] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.666378  8409 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.667141  8409 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.667665  8408 tablet_bootstrap.cc:654] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.674754  8413 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:00.675117  8409 ts_tablet_manager.cc:1434] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:01:00.676689  8409 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:00.682972  8409 tablet_bootstrap.cc:654] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.689193  8407 tablet_bootstrap.cc:492] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.689656  8407 ts_tablet_manager.cc:1403] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.006s
I20260709 13:01:00.692073  8407 raft_consensus.cc:359] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.692581  8407 raft_consensus.cc:385] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.692847  8407 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.693444  8407 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.696425  8407 ts_tablet_manager.cc:1434] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:00.697386  8407 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.698186  8466 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.698735  8466 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.699018  8451 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:00.702319  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.703104  8292 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:00.703936  8466 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.704926  8332 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:00.705592  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:00.711017  8465 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.711503  8465 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.711778  8465 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:00.712630  8331 leader_election.cc:343] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.711941  8114 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.715358  8408 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.715929  8408 ts_tablet_manager.cc:1403] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.004s
I20260709 13:01:00.718029  8407 tablet_bootstrap.cc:654] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.740190  8465 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.747932  8465 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.749171  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:00.749740  8292 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.749167  8408 raft_consensus.cc:359] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.751283  8408 raft_consensus.cc:385] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.751515  8408 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.750649  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:00.754448  8409 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:00.754948  8409 ts_tablet_manager.cc:1403] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.008s
W20260709 13:01:00.755527  8331 leader_election.cc:343] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.756379  8465 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.756886  8465 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.758280  8409 raft_consensus.cc:359] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.758925  8409 raft_consensus.cc:385] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.759203  8409 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.761579  8292 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:00.761183  8409 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.764554  8332 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:00.765494  8466 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.765700  8409 ts_tablet_manager.cc:1434] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:00.752043  8408 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.766000  8466 raft_consensus.cc:697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:00.766796  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:00.767035  8466 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.767580  8216 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:00.769320  8412 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.769498  8331 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:00.769960  8409 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:00.769806  8412 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.770310  8462 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.770713  8462 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.771067  8462 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.772042  8412 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.774220  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.774214  8408 ts_tablet_manager.cc:1434] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 13:01:00.775185  8365 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:00.775990  8408 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:00.776886  8184 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:00.778705  8412 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.776965  8407 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:00.779870  8407 ts_tablet_manager.cc:1403] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.005s
I20260709 13:01:00.779316  8412 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.786345  8462 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.786988  8412 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.777006  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.789342  8292 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:00.793073  8416 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:00.793898  8465 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.794441  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:00.795015  8216 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.797418  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.797794  8462 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.799374  8429 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.799393  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:00.798218  8293 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:00.803520  8459 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.805657  8413 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.805794  8216 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:00.806177  8413 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.807125  8408 tablet_bootstrap.cc:654] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.800061  8429 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.809232  8413 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.812345  8429 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.812171  8412 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.813117  8331 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:00.813215  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:00.814668  8216 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:00.814847  8416 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.815094  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.815376  8416 raft_consensus.cc:697] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:00.816725  8257 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:01:00.817479  8259 leader_election.cc:343] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.817569  8412 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.817692  8453 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.818287  8453 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.819092  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:00.818961  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.812053  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:00.819959  8293 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:00.820343  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:00.820775  8365 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:00.819779  8291 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.820103  8453 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.821640  8453 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.820854  8367 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.821849  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:00.822057  8184 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:00.816285  8416 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.821969  8453 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.829828  8453 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:00.830170  8257 leader_election.cc:343] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.828482  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:00.833132  8259 leader_election.cc:343] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.833468  8291 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:00.833634  8259 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:00.834206  8466 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.835322  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:00.837924  8409 tablet_bootstrap.cc:654] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.839326  8114 catalog_manager.cc:5697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.828380  8367 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:00.842271  8413 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.842644  8429 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.843128  8429 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:00.829334  8412 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.845180  8429 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.850554  8412 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.860697  8407 raft_consensus.cc:359] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.864163  8407 raft_consensus.cc:385] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.864406  8407 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.865077  8407 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.865604  8412 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.857959  8453 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.921768  8453 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:00.923568  8115 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.927664  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:01:00.929095  8259 leader_election.cc:343] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.940138  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:00.941033  8218 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.945384  8459 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:00.977896  8408 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:00.978437  8408 ts_tablet_manager.cc:1403] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.203s	user 0.030s	sys 0.017s
I20260709 13:01:00.981563  8465 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.986261  8465 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:00.989945  8407 ts_tablet_manager.cc:1434] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.210s	user 0.007s	sys 0.006s
I20260709 13:01:00.991068  8407 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:00.991827  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:00.992457  8291 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:00.994371  8465 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:00.994792  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:00.998212  8331 leader_election.cc:343] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.999841  8114 catalog_manager.cc:5697] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.001286  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:01.001957  8465 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.002336  8465 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.002676  8409 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.002663  8465 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.002867  8407 tablet_bootstrap.cc:654] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.003296  8409 ts_tablet_manager.cc:1403] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.234s	user 0.011s	sys 0.010s
I20260709 13:01:01.009231  8465 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.010358  8551 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:01.011080  8409 raft_consensus.cc:359] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.011727  8409 raft_consensus.cc:385] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.011978  8409 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.012576  8409 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.015729  8412 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.017025  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:00.998126  8218 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:01.018900  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:01.019461  8291 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.024765  8465 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.024977  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:01.025722  8293 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.025436  8408 raft_consensus.cc:359] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.028646  8408 raft_consensus.cc:385] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.028923  8408 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.029774  8408 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.034734  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:01.038806  8367 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.039736  8408 ts_tablet_manager.cc:1434] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.004s
I20260709 13:01:01.029978  8412 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.041779  8408 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.043179  8409 ts_tablet_manager.cc:1434] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:01:01.044687  8409 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
W20260709 13:01:01.058544  8331 leader_election.cc:343] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.063388  8291 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:01.064383  8257 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:01.064653  8367 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:01.065754  8413 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.066332  8413 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:01.066849  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:01.067777  8413 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:01.071792  8183 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.069190  8551 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.073194  8551 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:01.074015  8551 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.075021  8466 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.081593  8293 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:01.086473  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:01.090302  8466 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.098575  8407 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:01.098964  8407 ts_tablet_manager.cc:1403] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.018s
I20260709 13:01:01.100541  8466 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:01.101428  8466 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.102887  8409 tablet_bootstrap.cc:654] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.098109  8413 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.104282  8413 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.106330  8413 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.106237  8407 raft_consensus.cc:359] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.106992  8407 raft_consensus.cc:385] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.107255  8407 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.107864  8407 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.108095  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.108695  8218 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:01.110131  8407 ts_tablet_manager.cc:1434] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:01:01.109936  8257 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:01.110437  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.111379  8407 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:01.111084  8115 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.111091  8453 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.115445  8453 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.115795  8453 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.114439  8367 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:01.127087  8413 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.140477  8453 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.139207  8413 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.173336  8408 tablet_bootstrap.cc:654] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.173167  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:01.175541  8218 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.176219  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:01.176784  8364 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.177589  8453 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.182967  8364 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:01.183389  8218 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:01.184828  8259 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:01.192282  8453 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.192787  8453 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:01.188330  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.192610  8465 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.187543  8413 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.193672  8453 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:01.200656  8257 leader_election.cc:343] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.205422  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.205750  8409 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.206300  8409 ts_tablet_manager.cc:1403] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.162s	user 0.027s	sys 0.009s
I20260709 13:01:01.212321  8407 tablet_bootstrap.cc:654] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:01.212399  8331 consensus_peers.cc:597] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:01.214898  8259 leader_election.cc:343] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.215351  8259 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:01.216852  8112 catalog_manager.cc:5697] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:01.219897  8413 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.219615  8114 catalog_manager.cc:5697] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.238888  8293 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.246829  8409 raft_consensus.cc:359] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.247638  8409 raft_consensus.cc:385] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.247948  8409 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.248651  8409 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.249567  8115 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.250768  8409 ts_tablet_manager.cc:1434] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
W20260709 13:01:01.257261  8331 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.269804  8462 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.288661  8407 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:01.289230  8407 ts_tablet_manager.cc:1403] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.178s	user 0.003s	sys 0.010s
I20260709 13:01:01.290661  8409 tablet_bootstrap.cc:492] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.291577  8465 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.299667  8551 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:01.301857  8413 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.302387  8413 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.302934  8408 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:01.303022  8407 raft_consensus.cc:359] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.310504  8408 ts_tablet_manager.cc:1403] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.269s	user 0.044s	sys 0.052s
I20260709 13:01:01.310679  8407 raft_consensus.cc:385] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.310981  8407 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.327654  8409 tablet_bootstrap.cc:654] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.324077  8407 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.330734  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.330969  8413 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.331748  8551 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:01.333144  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.334805  8408 raft_consensus.cc:359] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.335670  8407 ts_tablet_manager.cc:1434] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:01:01.335899  8408 raft_consensus.cc:385] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.336174  8408 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.336609  8407 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:01.338671  8408 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.343160  8551 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.343644  8408 ts_tablet_manager.cc:1434] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:01:01.343674  8551 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.348969  8409 tablet_bootstrap.cc:492] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.349505  8409 ts_tablet_manager.cc:1403] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.000s
I20260709 13:01:01.350991  8551 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.344868  8259 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:01.353775  8408 tablet_bootstrap.cc:492] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.356040  8453 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.358697  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:01.363219  8293 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 1: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:01.366044  8408 tablet_bootstrap.cc:654] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.366418  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.371117  8184 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:01.372038  8407 tablet_bootstrap.cc:654] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.376466  8552 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.378363  8409 raft_consensus.cc:359] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.379112  8409 raft_consensus.cc:385] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.379379  8409 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.380134  8409 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.382535  8409 ts_tablet_manager.cc:1434] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:01:01.383549  8409 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
W20260709 13:01:01.386957  8164 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:01.395380  8552 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.402655  8409 tablet_bootstrap.cc:654] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.402753  8408 tablet_bootstrap.cc:492] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:01.403151  8407 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:01.403450  8408 ts_tablet_manager.cc:1403] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.015s
I20260709 13:01:01.403733  8407 ts_tablet_manager.cc:1403] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
I20260709 13:01:01.405447  8408 raft_consensus.cc:359] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.406173  8408 raft_consensus.cc:385] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.406502  8408 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.406245  8407 raft_consensus.cc:359] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.406878  8407 raft_consensus.cc:385] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.407178  8407 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.407178  8408 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.407884  8407 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.408486  8409 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.411619  8409 ts_tablet_manager.cc:1403] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.002s
I20260709 13:01:01.409165  8408 ts_tablet_manager.cc:1434] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:01.414270  8408 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.414790  8409 raft_consensus.cc:359] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.415717  8409 raft_consensus.cc:385] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.415964  8409 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.416601  8409 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.409866  8407 ts_tablet_manager.cc:1434] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:01:01.418691  8409 ts_tablet_manager.cc:1434] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:01.418872  8407 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:01.419763  8409 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.424888  8407 tablet_bootstrap.cc:654] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.425335  8409 tablet_bootstrap.cc:654] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.427981  8408 tablet_bootstrap.cc:654] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.431433  8462 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.432018  8462 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.435669  8462 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.435817  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.436474  8218 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:01.437285  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:01.437674  8331 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:01.437914  8293 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:01.438555  8462 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.438767  8408 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:01.438987  8462 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.439248  8408 ts_tablet_manager.cc:1403] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 13:01:01.439340  8462 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.443997  8409 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.444525  8409 ts_tablet_manager.cc:1403] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:01:01.447214  8462 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.447510  8409 raft_consensus.cc:359] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.448278  8409 raft_consensus.cc:385] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.448593  8409 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.449263  8409 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.450119  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:01.450664  8218 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.451393  8409 ts_tablet_manager.cc:1434] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:01.452733  8409 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.453285  8408 raft_consensus.cc:359] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.453920  8408 raft_consensus.cc:385] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.454206  8408 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.454945  8408 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.457521  8218 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:01.458786  8331 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:01.459792  8409 tablet_bootstrap.cc:654] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.460160  8408 ts_tablet_manager.cc:1434] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:01:01.461040  8408 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.464402  8430 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.464915  8430 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:01.465808  8430 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.469646  8408 tablet_bootstrap.cc:654] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.469504  8413 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.470095  8413 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.472380  8413 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.475086  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.476323  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:01:01.476590  8259 leader_election.cc:343] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.476938  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.477000  8293 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.476588  8552 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:01.478320  8257 leader_election.cc:343] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.478776  8257 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:01.479219  8408 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:01.479679  8408 ts_tablet_manager.cc:1403] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:01:01.480154  8413 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.481451  8462 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.482295  8408 raft_consensus.cc:359] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.483007  8408 raft_consensus.cc:385] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.483439  8408 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.484624  8408 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.486385  8409 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.486827  8408 ts_tablet_manager.cc:1434] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:01.493691  8408 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.497216  8554 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.498739  8407 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:01.499178  8407 ts_tablet_manager.cc:1403] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.000s
I20260709 13:01:01.499385  8408 tablet_bootstrap.cc:654] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.501191  8409 ts_tablet_manager.cc:1403] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.004s
I20260709 13:01:01.487923  8293 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:01.504473  8409 raft_consensus.cc:359] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.505173  8409 raft_consensus.cc:385] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.505457  8409 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.512964  8409 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.515333  8409 ts_tablet_manager.cc:1434] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:01:01.516942  8409 tablet_bootstrap.cc:492] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.523283  8409 tablet_bootstrap.cc:654] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.529572  8112 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:01.502427  8407 raft_consensus.cc:359] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.532426  8407 raft_consensus.cc:385] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.532796  8407 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.533552  8407 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.541366  8407 ts_tablet_manager.cc:1434] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:01:01.542253  8407 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:01.544847  8409 tablet_bootstrap.cc:492] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.545377  8409 ts_tablet_manager.cc:1403] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.003s
I20260709 13:01:01.546249  8407 tablet_bootstrap.cc:654] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.548660  8409 raft_consensus.cc:359] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.549355  8409 raft_consensus.cc:385] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.549610  8409 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.549722  8408 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:01.550420  8409 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.556031  8409 ts_tablet_manager.cc:1434] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:01:01.557010  8409 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.550233  8408 ts_tablet_manager.cc:1403] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.057s	user 0.032s	sys 0.008s
I20260709 13:01:01.563884  8408 raft_consensus.cc:359] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.564810  8408 raft_consensus.cc:385] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.565076  8408 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.565974  8408 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.568747  8408 ts_tablet_manager.cc:1434] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:01.569522  8409 tablet_bootstrap.cc:654] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.569862  8408 tablet_bootstrap.cc:492] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.570289  8430 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.570739  8367 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.570760  8430 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.573086  8430 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.575376  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.576107  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:01.576789  8292 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
W20260709 13:01:01.577169  8331 leader_election.cc:343] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.581241  8409 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.581934  8409 ts_tablet_manager.cc:1403] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 13:01:01.583211  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:01.584309  8430 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.584652  8430 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.584767  8409 raft_consensus.cc:359] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.585244  8430 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.587553  8408 tablet_bootstrap.cc:654] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.584640  8407 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:01.590436  8407 ts_tablet_manager.cc:1403] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.008s
I20260709 13:01:01.591702  8430 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.593048  8407 raft_consensus.cc:359] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.593683  8407 raft_consensus.cc:385] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.593955  8407 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.594707  8407 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.595119  8413 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.596727  8407 ts_tablet_manager.cc:1434] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:01.597703  8407 tablet_bootstrap.cc:492] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:01.598747  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:01:01.601614  8331 leader_election.cc:343] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.602684  8430 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.603291  8409 raft_consensus.cc:385] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.603770  8409 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.604328  8407 tablet_bootstrap.cc:654] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.605621  8462 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.606812  8408 tablet_bootstrap.cc:492] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:01.607266  8408 ts_tablet_manager.cc:1403] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:01:01.607834  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:01.608469  8292 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.609895  8408 raft_consensus.cc:359] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.610992  8408 raft_consensus.cc:385] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.611375  8408 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.612247  8408 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.613958  8293 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.615224  8409 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.617740  8409 ts_tablet_manager.cc:1434] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.001s
I20260709 13:01:01.618791  8409 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.619382  8408 ts_tablet_manager.cc:1434] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:01.621706  8408 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.632886  8408 tablet_bootstrap.cc:654] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.632480  8466 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.636262  8409 tablet_bootstrap.cc:654] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.639322  8216 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.651818  8409 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.652539  8409 ts_tablet_manager.cc:1403] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 13:01:01.655476  8409 raft_consensus.cc:359] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.656317  8409 raft_consensus.cc:385] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.656594  8409 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.657276  8409 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.659861  8409 ts_tablet_manager.cc:1434] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:01.660881  8409 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.662794  8413 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.663483  8413 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.667022  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.667847  8413 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.668634  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.669257  8364 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:01.672175  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:01.676606  8409 tablet_bootstrap.cc:654] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:01.674012  8257 leader_election.cc:343] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.672886  8413 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.684120  8413 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.684561  8413 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.686678  8466 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.687224  8466 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.689383  8466 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.691044  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.691721  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:01.692389  8290 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:01.692817  8409 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
W20260709 13:01:01.692960  8331 leader_election.cc:343] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.693326  8409 ts_tablet_manager.cc:1403] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 13:01:01.693923  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:01.696450  8430 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.696893  8430 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.697288  8430 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.699780  8451 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.696583  8409 raft_consensus.cc:359] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.702416  8409 raft_consensus.cc:385] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.702744  8409 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.703441  8409 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.705017  8409 ts_tablet_manager.cc:1434] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:01:01.706009  8409 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.708577  8430 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.672693  8292 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:01.711421  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:01.712668  8466 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.713340  8466 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:01.714329  8466 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.722694  8409 tablet_bootstrap.cc:654] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.727021  8465 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.727576  8465 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.729890  8465 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.732026  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:01.732331  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.732759  8290 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:01.732923  8218 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:01.734304  8331 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:01.735213  8416 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.735559  8416 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.735872  8416 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.736903  8409 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.737442  8409 ts_tablet_manager.cc:1403] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:01:01.740139  8409 raft_consensus.cc:359] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.740833  8409 raft_consensus.cc:385] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.741091  8409 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.741838  8451 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.741719  8409 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.744088  8409 ts_tablet_manager.cc:1434] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:01:01.745065  8409 tablet_bootstrap.cc:492] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.755945  8416 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.759042  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:01.760587  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:01.762055  8218 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.762336  8291 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.760927  8409 tablet_bootstrap.cc:654] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.773583  8218 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:01.775568  8412 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.781854  8412 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.782900  8430 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.783998  8412 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.785619  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.786957  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:01:01.787563  8184 leader_election.cc:343] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:01.788340  8331 leader_election.cc:343] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.757944  8416 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:01.780576  8291 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:01.800364  8331 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:01.805169  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:01.810396  8451 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:01.815239  8451 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.815862  8451 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.816723  8430 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.819123  8451 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.823597  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.805820  8291 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:01.830448  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:01.832410  8257 leader_election.cc:343] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.833209  8183 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:01.834472  8412 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:01:01.833240  8259 leader_election.cc:343] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.835445  8412 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.835529  8259 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:01.835841  8412 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.836582  8451 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.839951  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:01.853982  8293 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.855986  8412 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.852734  8430 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:01.858764  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:01.859416  8291 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.870491  8407 tablet_bootstrap.cc:492] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:01.870321  8430 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.871049  8407 ts_tablet_manager.cc:1403] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.274s	user 0.064s	sys 0.069s
I20260709 13:01:01.872066  8408 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:01.872481  8408 ts_tablet_manager.cc:1403] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.251s	user 0.111s	sys 0.108s
I20260709 13:01:01.873898  8407 raft_consensus.cc:359] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.874580  8407 raft_consensus.cc:385] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.874843  8407 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.874795  8408 raft_consensus.cc:359] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.875490  8408 raft_consensus.cc:385] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.875768  8408 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.875700  8407 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.876441  8408 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.773612  8413 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.877986  8407 ts_tablet_manager.cc:1434] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:01.878995  8407 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:01.883030  8408 ts_tablet_manager.cc:1434] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:01.883903  8408 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.885215  8407 tablet_bootstrap.cc:654] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.891733  8408 tablet_bootstrap.cc:654] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.902753  8408 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:01.903216  8408 ts_tablet_manager.cc:1403] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 13:01:01.905422  8407 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:01.905804  8407 ts_tablet_manager.cc:1403] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.012s
I20260709 13:01:01.906531  8409 tablet_bootstrap.cc:492] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.906972  8409 ts_tablet_manager.cc:1403] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.046s
I20260709 13:01:01.907470  8408 raft_consensus.cc:359] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.908212  8408 raft_consensus.cc:385] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.908108  8407 raft_consensus.cc:359] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.908556  8408 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.908752  8407 raft_consensus.cc:385] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.909030  8407 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.909242  8409 raft_consensus.cc:359] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.909885  8409 raft_consensus.cc:385] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.909637  8407 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.910175  8409 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.910812  8409 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.912127  8407 ts_tablet_manager.cc:1434] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:01.912947  8409 ts_tablet_manager.cc:1434] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:01.909384  8293 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:01.913832  8409 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:01.914625  8407 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:01.917510  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:01.921918  8217 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.922398  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:01.918624  8412 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.919337  8413 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.919646  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:01.909490  8408 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.920485  8409 tablet_bootstrap.cc:654] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.928510  8451 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.929759  8451 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.930321  8364 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.931864  8451 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.922935  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:01.933007  8430 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.922966  8407 tablet_bootstrap.cc:654] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.933677  8430 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:01.934441  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.934607  8430 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.936777  8408 ts_tablet_manager.cc:1434] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:01:01.937027  8603 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.936137  8291 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
W20260709 13:01:01.937441  8259 leader_election.cc:343] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.938092  8408 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:01.938812  8183 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:01.939096  8603 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.939636  8412 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.922971  8367 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.944149  8412 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:01.949558  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:01.949672  8412 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.950323  8366 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:01.945323  8603 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.950371  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.954607  8364 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:01.955437  8407 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:01.955875  8407 ts_tablet_manager.cc:1403] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.004s
I20260709 13:01:01.958433  8407 raft_consensus.cc:359] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.959076  8407 raft_consensus.cc:385] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.959160  8408 tablet_bootstrap.cc:654] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.959614  8603 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.959796  8407 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.960067  8603 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.960462  8407 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.962041  8603 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.962507  8407 ts_tablet_manager.cc:1434] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:01.963416  8407 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:01.964367  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:01.959218  8257 leader_election.cc:343] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.967661  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.968343  8218 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:01.969187  8409 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:01.969442  8259 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:01.969709  8409 ts_tablet_manager.cc:1403] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.004s
I20260709 13:01:01.969781  8257 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:01.970736  8603 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.971057  8407 tablet_bootstrap.cc:654] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.971081  8603 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.971598  8603 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.973070  8367 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:01.946537  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:01.975553  8257 leader_election.cc:343] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.973207  8409 raft_consensus.cc:359] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.975992  8257 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:01.977516  8413 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.977845  8451 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.978343  8451 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.978693  8451 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.980916  8603 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.983721  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:01.984289  8216 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.987282  8453 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.987758  8453 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:01.989355  8259 leader_election.cc:343] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.989496  8453 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:01.990641  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:01.967620  8217 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:01.991451  8453 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.992029  8453 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:01.992053  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:01.992959  8453 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:01.994215  8603 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.000168  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:02.002502  8216 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:01.985948  8451 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.007690  8451 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.002586  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:01:02.010444  8259 leader_election.cc:343] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:02.010978  8257 leader_election.cc:343] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.011509  8257 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:02.012378  8413 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.013226  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:02.013847  8366 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.019922  8257 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:02.021510  8413 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.022089  8413 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:02.022948  8413 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.030984  8466 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.035005  8112 catalog_manager.cc:5697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.036847  8112 catalog_manager.cc:5697] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.037835  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:02.038893  8112 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:02.045595  8257 leader_election.cc:343] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:02.053684  8259 leader_election.cc:343] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.056531  8466 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:01.977941  8409 raft_consensus.cc:385] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.062594  8409 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.063432  8409 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.065495  8409 ts_tablet_manager.cc:1434] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.095s	user 0.004s	sys 0.000s
I20260709 13:01:02.082171  8409 tablet_bootstrap.cc:492] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:02.084438  8408 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:02.084935  8408 ts_tablet_manager.cc:1403] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.147s	user 0.021s	sys 0.032s
I20260709 13:01:02.086308  8366 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:02.088415  8259 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:02.089233  8407 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:02.089692  8407 ts_tablet_manager.cc:1403] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.126s	user 0.035s	sys 0.033s
I20260709 13:01:02.089387  8408 raft_consensus.cc:359] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.090142  8408 raft_consensus.cc:385] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.090478  8408 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.090648  8413 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.091568  8409 tablet_bootstrap.cc:654] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.091308  8408 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.091742  8413 raft_consensus.cc:697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:02.093022  8413 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.093647  8408 ts_tablet_manager.cc:1434] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:02.094655  8408 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:02.097828  8614 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.098312  8614 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.098596  8114 catalog_manager.cc:5697] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.100322  8614 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.100085  8114 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.100869  8408 tablet_bootstrap.cc:654] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.101938  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:02.102325  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:02.102970  8367 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:02.104216  8259 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:02.105067  8413 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.105509  8413 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:02.105737  8257 leader_election.cc:343] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.105942  8413 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.110282  8408 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:02.110778  8408 ts_tablet_manager.cc:1403] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:01:02.112462  8407 raft_consensus.cc:359] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.113114  8407 raft_consensus.cc:385] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.116441  8409 tablet_bootstrap.cc:492] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:02.116914  8409 ts_tablet_manager.cc:1403] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.003s
I20260709 13:01:02.121459  8409 raft_consensus.cc:359] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.120936  8115 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.113322  8408 raft_consensus.cc:359] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.122736  8408 raft_consensus.cc:385] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.123003  8408 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.122223  8409 raft_consensus.cc:385] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.124404  8409 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.125605  8409 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.126194  8413 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.127671  8409 ts_tablet_manager.cc:1434] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:02.128590  8409 tablet_bootstrap.cc:492] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:02.123728  8408 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.129281  8413 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.130038  8416 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.130482  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:02.131117  8408 ts_tablet_manager.cc:1434] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:01:02.131081  8367 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.130811  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:02.132337  8408 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
W20260709 13:01:02.132830  8257 leader_election.cc:343] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.130519  8416 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.134851  8416 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:02.113379  8407 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.136121  8407 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.136624  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:02.138778  8407 ts_tablet_manager.cc:1434] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:01:02.139467  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:02.139681  8367 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:02.140480  8216 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 1: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:01:02.141278  8259 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:02.142302  8408 tablet_bootstrap.cc:654] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.142529  8413 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.144585  8331 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:02.145654  8430 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.146332  8407 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:02.144016  8413 raft_consensus.cc:697] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:02.147228  8413 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.150753  8409 tablet_bootstrap.cc:654] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.153278  8430 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.155915  8407 tablet_bootstrap.cc:654] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.166190  8408 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:02.166723  8408 ts_tablet_manager.cc:1403] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.006s
I20260709 13:01:02.169149  8408 raft_consensus.cc:359] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.169811  8408 raft_consensus.cc:385] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.170665  8408 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.171325  8408 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.169948  8409 tablet_bootstrap.cc:492] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:02.172554  8409 ts_tablet_manager.cc:1403] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:01:02.173467  8408 ts_tablet_manager.cc:1434] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:01:02.174481  8408 tablet_bootstrap.cc:492] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:02.180346  8408 tablet_bootstrap.cc:654] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.180079  8413 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.180912  8413 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.185154  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:02.186717  8259 leader_election.cc:343] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.186745  8409 raft_consensus.cc:359] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.187493  8409 raft_consensus.cc:385] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.187752  8409 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.188591  8413 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.187752  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:02.190340  8257 leader_election.cc:343] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.190770  8257 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:02.192502  8407 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:02.189692  8409 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.191819  8413 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.193111  8407 ts_tablet_manager.cc:1403] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.003s
I20260709 13:01:02.194883  8409 ts_tablet_manager.cc:1434] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:01:02.195940  8409 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:02.196779  8407 raft_consensus.cc:359] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.197507  8407 raft_consensus.cc:385] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.197810  8407 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.198693  8407 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.201514  8407 ts_tablet_manager.cc:1434] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:02.203948  8409 tablet_bootstrap.cc:654] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.208225  8407 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:02.209928  8413 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.210520  8413 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.213838  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:02.215984  8257 leader_election.cc:343] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.217657  8413 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.223625  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:02.226589  8407 tablet_bootstrap.cc:654] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:02.226779  8259 leader_election.cc:343] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.227331  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:02.228457  8413 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.232769  8115 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.234615  8115 catalog_manager.cc:5697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.250625  8407 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:02.251236  8407 ts_tablet_manager.cc:1403] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.009s
I20260709 13:01:02.254519  8407 raft_consensus.cc:359] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.255343  8407 raft_consensus.cc:385] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.255702  8407 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.256778  8407 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.261227  8407 ts_tablet_manager.cc:1434] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:02.262413  8407 tablet_bootstrap.cc:492] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:02.270962  8407 tablet_bootstrap.cc:654] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.277767  8416 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.278393  8416 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.280871  8416 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:02.283510  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:02.284261  8216 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:02.285393  8412 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.285914  8412 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.288111  8412 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.289880  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:02.291090  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:02.291407  8331 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:02.292348  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:02.293376  8466 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.293802  8466 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.295113  8466 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.296500  8183 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:02.299515  8416 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:02.304225  8430 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:02.305506  8429 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.310210  8293 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
W20260709 13:01:02.328627  8331 consensus_peers.cc:597] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.330976  8465 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.336031  8451 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.336526  8451 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.337365  8407 tablet_bootstrap.cc:492] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:02.338246  8407 ts_tablet_manager.cc:1403] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.012s
I20260709 13:01:02.338527  8451 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.340669  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:02.342028  8465 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.345119  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:02.346577  8257 leader_election.cc:343] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:02.347378  8259 leader_election.cc:343] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.347826  8259 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:02.348870  8451 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.355381  8466 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.365969  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:02.366916  8215 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.375545  8217 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.378564  8215 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:02.361795  8407 raft_consensus.cc:359] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.380134  8407 raft_consensus.cc:385] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.380587  8407 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.380093  8331 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:02.381701  8465 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.382248  8465 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:02.381883  8407 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.386188  8407 ts_tablet_manager.cc:1434] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:01:02.402963  8407 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:02.383405  8465 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.396425  8215 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.384294  8466 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:02.431533  8412 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.448868  8407 tablet_bootstrap.cc:654] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.411089  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:02.452256  8465 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:02.463109  8614 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.468463  8291 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.479918  8115 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.496628  8451 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:02.498584  8291 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:02.528561  8412 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.528597  8614 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.542560  8413 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.543403  8413 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.547415  8413 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.547611  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:02.548125  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:02.549351  8259 leader_election.cc:343] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.550988  8413 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:02.560218  8257 leader_election.cc:343] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.560725  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:02.570338  8413 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:02.593755  8164 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:02.597798  8409 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:02.603721  8409 ts_tablet_manager.cc:1403] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.408s	user 0.100s	sys 0.176s
W20260709 13:01:02.598937  8257 consensus_peers.cc:597] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.599064  8614 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:02.620504  8216 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.620745  8409 raft_consensus.cc:359] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.621488  8409 raft_consensus.cc:385] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.621815  8409 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.622576  8409 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.623579  8408 tablet_bootstrap.cc:492] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:02.623996  8408 ts_tablet_manager.cc:1403] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.450s	user 0.166s	sys 0.132s
I20260709 13:01:02.627162  8409 ts_tablet_manager.cc:1434] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:01:02.628219  8409 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:02.632498  8407 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:02.632910  8407 ts_tablet_manager.cc:1403] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.230s	user 0.049s	sys 0.024s
I20260709 13:01:02.639813  8407 raft_consensus.cc:359] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.640897  8407 raft_consensus.cc:385] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.642428  8407 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.644025  8407 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.645277  8614 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.646622  8407 ts_tablet_manager.cc:1434] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:01:02.647871  8409 tablet_bootstrap.cc:654] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.651444  8407 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:02.655279  8408 raft_consensus.cc:359] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.655984  8408 raft_consensus.cc:385] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.656240  8408 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.656972  8408 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.659317  8408 ts_tablet_manager.cc:1434] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:01:02.660580  8408 tablet_bootstrap.cc:492] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:02.669768  8614 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:02.683892  8409 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:02.684329  8407 tablet_bootstrap.cc:654] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.684412  8409 ts_tablet_manager.cc:1403] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.019s
I20260709 13:01:02.697459  8409 raft_consensus.cc:359] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.702668  8408 tablet_bootstrap.cc:654] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.698266  8409 raft_consensus.cc:385] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.708338  8409 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.714507  8409 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.719419  8409 ts_tablet_manager.cc:1434] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.002s
I20260709 13:01:02.720465  8409 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:02.731866  8408 tablet_bootstrap.cc:492] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:02.732381  8408 ts_tablet_manager.cc:1403] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.001s
I20260709 13:01:02.737473  8408 raft_consensus.cc:359] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.738219  8408 raft_consensus.cc:385] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.738297  8407 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:02.738509  8408 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.738888  8407 ts_tablet_manager.cc:1403] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.088s	user 0.031s	sys 0.022s
I20260709 13:01:02.739363  8408 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.740546  8409 tablet_bootstrap.cc:654] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.741320  8408 ts_tablet_manager.cc:1434] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:02.742427  8408 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:02.741519  8407 raft_consensus.cc:359] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.746335  8407 raft_consensus.cc:385] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.746649  8407 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.747781  8407 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.748761  8408 tablet_bootstrap.cc:654] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.754091  8407 ts_tablet_manager.cc:1434] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:01:02.755009  8554 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.755560  8554 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.757844  8554 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.759002  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:02.759276  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:02.759919  8367 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:02.760097  8292 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:02.761195  8184 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:02.763247  8407 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:02.764292  8554 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.764664  8554 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.764981  8554 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.785629  8407 tablet_bootstrap.cc:654] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.790505  8409 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:02.790974  8409 ts_tablet_manager.cc:1403] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.015s
I20260709 13:01:02.791468  8554 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.793495  8409 raft_consensus.cc:359] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.794193  8409 raft_consensus.cc:385] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.794462  8409 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.794499  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:02.795109  8292 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.795825  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:02.796351  8367 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.798120  8407 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:02.798609  8407 ts_tablet_manager.cc:1403] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 13:01:02.801347  8408 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:02.801810  8292 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:02.795230  8554 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.803098  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:02.801167  8407 raft_consensus.cc:359] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.804044  8407 raft_consensus.cc:385] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.804566  8407 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.804430  8554 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.802628  8367 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:02.806368  8554 raft_consensus.cc:697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:02.806133  8409 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.805447  8407 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.801824  8408 ts_tablet_manager.cc:1403] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.060s	user 0.028s	sys 0.013s
I20260709 13:01:02.807505  8554 consensus_queue.cc:237] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.875466  8408 raft_consensus.cc:359] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.876171  8408 raft_consensus.cc:385] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.876438  8408 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.877032  8408 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.878628  8408 ts_tablet_manager.cc:1434] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.001s
I20260709 13:01:02.879513  8408 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:02.882320  8407 ts_tablet_manager.cc:1434] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.083s	user 0.014s	sys 0.018s
I20260709 13:01:02.883353  8407 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:02.885932  8614 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.886694  8614 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.888630  8614 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.888540  8430 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.892678  8408 tablet_bootstrap.cc:654] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.889123  8407 tablet_bootstrap.cc:654] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.900216  8409 ts_tablet_manager.cc:1434] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.109s	user 0.004s	sys 0.006s
I20260709 13:01:02.905411  8412 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.905956  8412 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.906248  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:02.908054  8412 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.912142  8416 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.912644  8416 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.912986  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:02.914744  8416 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:02.916137  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:02.923378  8116 catalog_manager.cc:5697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:02.930406  8331 leader_election.cc:343] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:02.930771  8259 leader_election.cc:343] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.933043  8215 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.933001  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:02.942452  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:02.942837  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:02.943421  8292 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:02.941641  8416 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:02.947777  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:02.948551  8466 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.948902  8466 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.949225  8466 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.955633  8183 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:02.956504  8554 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.958196  8409 tablet_bootstrap.cc:492] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
W20260709 13:01:02.958633  8257 leader_election.cc:343] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.959138  8257 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:02.959913  8451 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.964589  8409 tablet_bootstrap.cc:654] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.967724  8554 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.968436  8554 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.958228  8466 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:02.971536  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:02.972016  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:02.972211  8289 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:02.972347  8466 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:01:02.973570  8331 leader_election.cc:343] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.974573  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:02.975422  8412 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.975783  8412 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.976115  8412 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.978529  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:02.979121  8289 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.982853  8554 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:02.984807  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:02.986685  8184 leader_election.cc:343] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.990422  8289 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:02.992158  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:02.993366  8466 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.993906  8466 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:02.994802  8466 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.002102  8412 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.007133  8216 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.012079  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:01:03.013535  8184 leader_election.cc:343] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.014627  8412 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.015369  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:03.015952  8289 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.018821  8409 tablet_bootstrap.cc:492] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.019323  8409 ts_tablet_manager.cc:1403] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.003s
I20260709 13:01:03.025672  8289 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:03.022181  8409 raft_consensus.cc:359] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.026969  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:03.027524  8409 raft_consensus.cc:385] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.027841  8409 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.028283  8412 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.028841  8412 raft_consensus.cc:697] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:03.029208  8407 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:03.029698  8407 ts_tablet_manager.cc:1403] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.147s	user 0.016s	sys 0.052s
I20260709 13:01:03.031837  8408 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:03.032439  8408 ts_tablet_manager.cc:1403] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.153s	user 0.032s	sys 0.036s
I20260709 13:01:03.035377  8408 raft_consensus.cc:359] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.036127  8408 raft_consensus.cc:385] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.036492  8408 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.029740  8412 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.037266  8408 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.039801  8408 ts_tablet_manager.cc:1434] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:01:03.040853  8408 tablet_bootstrap.cc:492] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:03.042407  8114 catalog_manager.cc:5697] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.036207  8407 raft_consensus.cc:359] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.029935  8409 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.045153  8409 ts_tablet_manager.cc:1434] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:01:03.046059  8409 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.051785  8407 raft_consensus.cc:385] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.052219  8407 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.052436  8409 tablet_bootstrap.cc:654] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.052999  8407 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.056161  8407 ts_tablet_manager.cc:1434] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
I20260709 13:01:03.057251  8407 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:03.063725  8407 tablet_bootstrap.cc:654] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.068473  8409 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.068601  8114 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.069051  8409 ts_tablet_manager.cc:1403] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
I20260709 13:01:03.073689  8409 raft_consensus.cc:359] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.074519  8409 raft_consensus.cc:385] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.074667  8408 tablet_bootstrap.cc:654] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.075997  8409 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.076769  8409 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.078591  8409 ts_tablet_manager.cc:1434] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:03.079630  8409 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.080040  8412 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.080986  8412 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.083788  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:03.084457  8289 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:03.085686  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:03.086531  8409 tablet_bootstrap.cc:654] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.086587  8429 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.087023  8429 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.087324  8429 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.094152  8408 tablet_bootstrap.cc:492] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:03.094662  8408 ts_tablet_manager.cc:1403] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 13:01:03.095106  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:03.095916  8366 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:03.098951  8412 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.098958  8408 raft_consensus.cc:359] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.101034  8408 raft_consensus.cc:385] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.102205  8408 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.103852  8408 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.107447  8408 ts_tablet_manager.cc:1434] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:01:03.108230  8429 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.113633  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:03.114357  8289 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.122439  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:03.123113  8367 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.139192  8408 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:03.139925  8429 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.142812  8367 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:03.151806  8184 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:03.153856  8412 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.154464  8412 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:03.155308  8412 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.162369  8289 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:03.170795  8116 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.172003  8409 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.172881  8407 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:03.172901  8409 ts_tablet_manager.cc:1403] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.040s
I20260709 13:01:03.173671  8407 ts_tablet_manager.cc:1403] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.117s	user 0.038s	sys 0.020s
I20260709 13:01:03.173691  8408 tablet_bootstrap.cc:654] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.178009  8409 raft_consensus.cc:359] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.178960  8409 raft_consensus.cc:385] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.178627  8407 raft_consensus.cc:359] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.179293  8409 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.179709  8407 raft_consensus.cc:385] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.180264  8407 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.180106  8409 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.181142  8407 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.184372  8409 ts_tablet_manager.cc:1434] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 13:01:03.185530  8407 ts_tablet_manager.cc:1434] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:01:03.186751  8407 tablet_bootstrap.cc:492] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:03.190989  8409 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.193060  8407 tablet_bootstrap.cc:654] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.196606  8408 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:03.197309  8408 ts_tablet_manager.cc:1403] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.004s
I20260709 13:01:03.200107  8408 raft_consensus.cc:359] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.200840  8408 raft_consensus.cc:385] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.201119  8408 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.202615  8408 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.203888  8409 tablet_bootstrap.cc:654] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.211140  8408 ts_tablet_manager.cc:1434] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.007s
I20260709 13:01:03.212311  8408 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:03.217869  8407 tablet_bootstrap.cc:492] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:03.218446  8407 ts_tablet_manager.cc:1403] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.013s
I20260709 13:01:03.220767  8408 tablet_bootstrap.cc:654] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.221832  8407 raft_consensus.cc:359] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.222613  8407 raft_consensus.cc:385] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.222892  8407 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.223752  8646 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.223673  8407 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.224318  8646 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.232398  8407 ts_tablet_manager.cc:1434] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:01:03.233667  8407 tablet_bootstrap.cc:492] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:03.241742  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:03.243451  8259 leader_election.cc:343] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.243996  8646 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.244488  8407 tablet_bootstrap.cc:654] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.245627  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:03.247428  8257 leader_election.cc:343] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.247925  8257 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:03.250882  8646 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:03.263154  8407 tablet_bootstrap.cc:492] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:03.263731  8407 ts_tablet_manager.cc:1403] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.002s
I20260709 13:01:03.265817  8409 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.266299  8409 ts_tablet_manager.cc:1403] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.080s	user 0.028s	sys 0.027s
I20260709 13:01:03.266445  8407 raft_consensus.cc:359] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.267221  8407 raft_consensus.cc:385] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.267539  8407 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.268193  8407 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.269145  8409 raft_consensus.cc:359] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.269832  8409 raft_consensus.cc:385] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.270124  8409 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.270484  8407 ts_tablet_manager.cc:1434] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:01:03.270864  8409 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.271427  8407 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:03.272980  8409 ts_tablet_manager.cc:1434] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:03.277078  8409 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.277405  8407 tablet_bootstrap.cc:654] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.280803  8412 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:03.283131  8409 tablet_bootstrap.cc:654] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.292891  8408 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:03.293408  8408 ts_tablet_manager.cc:1403] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.017s
I20260709 13:01:03.295743  8407 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:03.296475  8407 ts_tablet_manager.cc:1403] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.025s	user 0.002s	sys 0.017s
I20260709 13:01:03.296005  8408 raft_consensus.cc:359] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.297219  8408 raft_consensus.cc:385] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.297731  8408 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.298413  8408 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.300562  8408 ts_tablet_manager.cc:1434] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:03.300551  8407 raft_consensus.cc:359] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.301388  8412 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.301960  8408 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:03.304153  8409 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.304611  8409 ts_tablet_manager.cc:1403] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.004s
I20260709 13:01:03.310684  8408 tablet_bootstrap.cc:654] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.311059  8407 raft_consensus.cc:385] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.312125  8407 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.312842  8407 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.304162  8412 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.314558  8429 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.316762  8412 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.315418  8409 raft_consensus.cc:359] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.316972  8407 ts_tablet_manager.cc:1434] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:01:03.317813  8409 raft_consensus.cc:385] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.318140  8409 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.318717  8407 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:03.318770  8409 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.318557  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:03.321308  8409 ts_tablet_manager.cc:1434] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:01:03.321532  8366 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:03.322672  8409 tablet_bootstrap.cc:492] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.323119  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:03.324225  8412 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.324666  8412 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.325052  8412 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.328579  8407 tablet_bootstrap.cc:654] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.323522  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:03.333122  8289 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:03.330124  8409 tablet_bootstrap.cc:654] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.330714  8416 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.334195  8416 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.336410  8416 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:03.337633  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:03.338357  8290 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:03.341672  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:03.343271  8331 leader_election.cc:343] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.347590  8332 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:03.348109  8412 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.349519  8466 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.380283  8466 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.380654  8466 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.380849  8407 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:03.381268  8407 ts_tablet_manager.cc:1403] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.011s
I20260709 13:01:03.357009  8416 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.383212  8416 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.383961  8407 raft_consensus.cc:359] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.384907  8407 raft_consensus.cc:385] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.385250  8407 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.385663  8416 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:03.365723  8429 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.376838  8554 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.386001  8407 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.386361  8554 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.388348  8554 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.389858  8429 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.391948  8429 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.377799  8409 tablet_bootstrap.cc:492] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.393046  8409 ts_tablet_manager.cc:1403] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.020s
I20260709 13:01:03.393046  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:03.394037  8293 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:03.398355  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:03.399524  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:03.400168  8289 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:03.400137  8409 raft_consensus.cc:359] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.402509  8682 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.402936  8682 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.403327  8682 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.403911  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:03.405644  8554 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.405691  8466 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.406217  8554 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.406710  8554 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.409776  8412 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.402869  8409 raft_consensus.cc:385] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.410460  8409 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.410449  8682 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.411207  8409 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.411604  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:03.412377  8290 raft_consensus.cc:2393] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 1: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:03.413300  8409 ts_tablet_manager.cc:1434] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:01:03.413736  8682 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.414495  8409 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.424878  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:03.425593  8293 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.426427  8646 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.426954  8646 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.430160  8646 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.430903  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:03.431552  8289 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.438704  8408 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:03.439229  8408 ts_tablet_manager.cc:1403] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.137s	user 0.048s	sys 0.044s
I20260709 13:01:03.441640  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:03.413658  8466 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:03.442313  8408 raft_consensus.cc:359] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.443007  8408 raft_consensus.cc:385] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.443523  8408 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.443771  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:03.443928  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:03.444591  8364 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.444192  8408 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.444967  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:03.442998  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:03.446758  8408 ts_tablet_manager.cc:1434] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
W20260709 13:01:03.446846  8184 leader_election.cc:343] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.447929  8408 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
W20260709 13:01:03.448246  8184 leader_election.cc:343] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:03.449229  8257 leader_election.cc:343] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:03.449229  8184 leader_election.cc:343] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.451192  8409 tablet_bootstrap.cc:654] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.454167  8466 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.455215  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:03.455677  8408 tablet_bootstrap.cc:654] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.451737  8364 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:03.456794  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:03.457641  8682 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.458140  8682 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:03.455811  8290 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.458986  8682 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.462596  8646 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.463150  8646 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.467576  8646 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.468081  8409 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.468628  8409 ts_tablet_manager.cc:1403] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.007s
I20260709 13:01:03.474162  8409 raft_consensus.cc:359] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.474951  8409 raft_consensus.cc:385] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.475286  8409 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.476029  8409 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.478519  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:03.479668  8409 ts_tablet_manager.cc:1434] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:01:03.480695  8409 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.484331  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:03.487198  8409 tablet_bootstrap.cc:654] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.493049  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:03.494783  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:03.495379  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:03.498010  8364 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:03.494035  8215 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:03.499154  8331 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:03.499900  8466 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.500681  8409 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.501118  8409 ts_tablet_manager.cc:1403] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:01:03.503500  8257 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:03.503605  8409 raft_consensus.cc:359] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.504369  8409 raft_consensus.cc:385] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.504662  8409 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.506708  8646 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.507110  8646 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.507038  8409 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.507532  8646 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.507653  8466 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:03.509241  8409 ts_tablet_manager.cc:1434] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:01:03.510217  8409 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.511704  8293 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:03.513653  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:03.514820  8429 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.515097  8289 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:03.515316  8429 raft_consensus.cc:697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:03.526979  8429 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.528898  8614 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.529688  8614 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.517198  8646 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.517827  8409 tablet_bootstrap.cc:654] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.519637  8408 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:03.532101  8408 ts_tablet_manager.cc:1403] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.015s
I20260709 13:01:03.533087  8614 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.534293  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:03.534798  8408 raft_consensus.cc:359] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.535449  8408 raft_consensus.cc:385] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:03.535637  8257 leader_election.cc:343] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.535714  8408 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.519908  8412 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.536325  8412 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.539094  8412 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.539916  8408 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.540244  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:03.540393  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:03.540866  8364 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:03.542027  8408 ts_tablet_manager.cc:1434] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:01:03.541075  8292 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:03.540526  8554 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.539094  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:03.545377  8215 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.547186  8409 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.547796  8409 ts_tablet_manager.cc:1403] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.003s
I20260709 13:01:03.543767  8465 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.549175  8465 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.536537  8646 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.544740  8183 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:03.551105  8412 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.550873  8409 raft_consensus.cc:359] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.551441  8412 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.551724  8409 raft_consensus.cc:385] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.551764  8412 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.552167  8409 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.553082  8465 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:01:03.544678  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 45586us
W20260709 13:01:03.559151  8331 leader_election.cc:343] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.544128  8408 tablet_bootstrap.cc:492] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:03.563400  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:03.563807  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:03.565938  8293 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:03.552917  8409 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:03.566469  8184 leader_election.cc:343] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.568058  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:03.566504  8554 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.569389  8466 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.569738  8466 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.570212  8409 ts_tablet_manager.cc:1434] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:01:03.570052  8466 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.572952  8409 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:03.578052  8466 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.581665  8408 tablet_bootstrap.cc:654] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.573166  8412 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.582846  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:03.583583  8289 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.584713  8412 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.582948  8409 tablet_bootstrap.cc:654] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.587112  8466 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:03.587344  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:03.591455  8646 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.592188  8646 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.592581  8407 ts_tablet_manager.cc:1434] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.211s	user 0.039s	sys 0.033s
I20260709 13:01:03.593636  8407 tablet_bootstrap.cc:492] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:03.594365  8646 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.594942  8289 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:03.595429  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:03.596730  8257 leader_election.cc:343] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.596971  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:03.570063  8215 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:03.597551  8292 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.597766  8364 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 1: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:03.598348  8257 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:03.599208  8646 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.599756  8646 raft_consensus.cc:697] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:03.600319  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:03.600654  8646 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.606238  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:03.606940  8409 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:03.607242  8614 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.607506  8409 ts_tablet_manager.cc:1403] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.003s
I20260709 13:01:03.608237  8614 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.608707  8554 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.609994  8554 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:03.610512  8614 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.610710  8658 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.611202  8658 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.611374  8554 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.614948  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:03.615402  8183 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:03.616403  8687 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:03.616685  8658 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:03.617121  8257 leader_election.cc:343] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.618804  8409 raft_consensus.cc:359] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.619881  8409 raft_consensus.cc:385] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.620221  8409 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.621162  8409 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.624523  8409 ts_tablet_manager.cc:1434] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:01:03.624713  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:03.625763  8687 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.626957  8292 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:03.628104  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:03.629060  8466 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.629822  8466 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:03.632023  8466 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.633203  8409 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
W20260709 13:01:03.636924  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 76625.8us
W20260709 13:01:03.638500  8259 leader_election.cc:343] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.638999  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:03.640452  8658 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:03.644172  8257 leader_election.cc:343] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.675768  8112 catalog_manager.cc:5697] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.680305  8112 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.662840  8290 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:03.739760  8682 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.091s
W20260709 13:01:03.904357  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 263974us
I20260709 13:01:03.915429  8614 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.916708  8614 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:03.925974  8614 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:03.973340  8408 tablet_bootstrap.cc:492] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
W20260709 13:01:03.978137  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46396.3us
I20260709 13:01:03.989400  8409 tablet_bootstrap.cc:654] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.997519  8429 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:03.990427  8408 ts_tablet_manager.cc:1403] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.446s	user 0.008s	sys 0.009s
W20260709 13:01:04.024161  8691 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.154s	user 0.005s	sys 0.000s
W20260709 13:01:04.025358  8699 log.cc:927] Time spent T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.150s	user 0.000s	sys 0.003s
W20260709 13:01:04.025970  8700 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.078s	user 0.003s	sys 0.000s
W20260709 13:01:04.030762  8701 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.158s	user 0.002s	sys 0.001s
I20260709 13:01:04.032341  8332 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:04.038336  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:04.039247  8364 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.040735  8462 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:04.041339  8462 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:04.033814  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:04.043254  8462 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.048617  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:04.050624  8215 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 1: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:04.053808  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:04.051422  8364 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:04.057946  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:04.057081  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:04.062135  8407 tablet_bootstrap.cc:654] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:04.073351  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:04.073652  8115 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.105417  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:04.106364  8215 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 1: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:04.107084  8408 raft_consensus.cc:359] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.108384  8408 raft_consensus.cc:385] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.109819  8408 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:04.111999  8408 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.114813  8409 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:04.114282  8366 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.117406  8412 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:04.120829  8705 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.119809  8259 leader_election.cc:343] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.122411  8259 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.123257  8658 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:04.124533  8259 leader_election.cc:343] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.125325  8409 ts_tablet_manager.cc:1403] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.492s	user 0.022s	sys 0.031s
I20260709 13:01:04.125185  8259 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.121460  8705 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.135588  8408 ts_tablet_manager.cc:1434] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.126s	user 0.004s	sys 0.004s
I20260709 13:01:04.136118  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:04.137226  8408 tablet_bootstrap.cc:492] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:04.137676  8705 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:04.143955  8703 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:04.164470  8407 tablet_bootstrap.cc:492] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:04.165418  8407 ts_tablet_manager.cc:1403] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.572s	user 0.020s	sys 0.037s
I20260709 13:01:04.178018  8362 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:04.180888  8259 leader_election.cc:343] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.183406  8259 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.185451  8705 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:04.187187  8259 leader_election.cc:343] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.187672  8259 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.188583  8705 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:04.197654  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:04.198370  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.191911  8407 raft_consensus.cc:359] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.210503  8407 raft_consensus.cc:385] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.210774  8407 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
W20260709 13:01:04.212527  8257 leader_election.cc:343] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:04.213564  8259 leader_election.cc:343] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.218466  8703 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.220949  8407 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.219045  8703 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.230049  8466 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.230594  8466 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.235638  8703 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:04.237884  8257 leader_election.cc:343] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.240737  8429 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:04.241686  8466 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:04.242691  8407 ts_tablet_manager.cc:1434] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 13:01:04.244148  8407 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:04.245790  8554 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:04.233366  8409 raft_consensus.cc:359] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.248129  8409 raft_consensus.cc:385] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.248363  8409 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:04.247687  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.252859  8466 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.249504  8429 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:01:04.256285  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 47655.4us
I20260709 13:01:04.249856  8703 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:01:04.259037  8705 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:04.259860  8658 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.263507  8409 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.270249  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:04.279479  8409 ts_tablet_manager.cc:1434] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.152s	user 0.006s	sys 0.003s
I20260709 13:01:04.281665  8409 tablet_bootstrap.cc:492] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:04.281540  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:04.291141  8257 leader_election.cc:343] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.300980  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:04.260702  8554 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:01:04.301865  8288 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:04.312181  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:04.327909  8554 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:04.329772  8412 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:04.334105  8259 leader_election.cc:343] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.334676  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.335369  8658 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:04.378921  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:04.383347  8259 leader_election.cc:343] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.383971  8259 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.403539  8116 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:04.436973  8407 tablet_bootstrap.cc:654] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:04.441056  8408 tablet_bootstrap.cc:654] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:04.441987  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 58672.9us
I20260709 13:01:04.447744  8725 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:04.457399  8721 log.cc:927] Time spent T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:04.466121  8466 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:04.523339  8409 tablet_bootstrap.cc:654] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:04.524085  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 58406.8us
I20260709 13:01:04.549846  8407 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:04.550453  8407 ts_tablet_manager.cc:1403] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.307s	user 0.008s	sys 0.008s
I20260709 13:01:04.556428  8332 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:04.590348  8709 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:04.590852  8709 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:04.591228  8709 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.617592  8614 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.620294  8614 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.623998  8614 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:04.640653  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:04.655470  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 83003us
I20260709 13:01:04.662704  8708 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.671512  8407 raft_consensus.cc:359] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.672307  8407 raft_consensus.cc:385] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.672627  8407 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
W20260709 13:01:04.672820  8164 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:04.673250  8407 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.674561  8408 tablet_bootstrap.cc:492] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:04.674994  8408 ts_tablet_manager.cc:1403] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.538s	user 0.008s	sys 0.026s
I20260709 13:01:04.673306  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:04.663230  8708 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:04.719789  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 51995.9us
W20260709 13:01:04.714026  8720 log.cc:927] Time spent T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.069s	user 0.009s	sys 0.019s
I20260709 13:01:04.731691  8409 tablet_bootstrap.cc:492] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:04.733476  8409 ts_tablet_manager.cc:1403] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.453s	user 0.020s	sys 0.027s
I20260709 13:01:04.734506  8708 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:04.736820  8408 raft_consensus.cc:359] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.761003  8408 raft_consensus.cc:385] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.761801  8408 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
W20260709 13:01:04.770426  8257 leader_election.cc:343] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:04.760679  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 104261us
I20260709 13:01:04.772125  8408 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.750245  8709 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.790489  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:04.791167  8407 ts_tablet_manager.cc:1434] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.240s	user 0.016s	sys 0.015s
I20260709 13:01:04.802436  8728 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:01:04.804795  8259 leader_election.cc:343] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.805250  8259 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.808123  8214 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.810621  8408 ts_tablet_manager.cc:1434] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.135s	user 0.012s	sys 0.003s
I20260709 13:01:04.809902  8658 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:04.820681  8407 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:04.820751  8408 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:04.825217  8465 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.825702  8465 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:04.829037  8331 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.831489  8465 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:04.847144  8409 raft_consensus.cc:359] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.854301  8409 raft_consensus.cc:385] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.854637  8409 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:04.854983  8408 tablet_bootstrap.cc:654] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:04.848095  8116 catalog_manager.cc:5697] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.857896  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:04.858912  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:04.861097  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:04.862198  8286 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
W20260709 13:01:04.865067  8331 leader_election.cc:343] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.870287  8365 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:04.873061  8750 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.873816  8750 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.876406  8750 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:04.876933  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:04.855355  8409 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.833693  8709 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:04.879580  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:04.861094  8407 tablet_bootstrap.cc:654] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:04.886211  8749 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:01:04.887912  8682 raft_consensus.cc:3055] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.888782  8682 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:04.889555  8409 ts_tablet_manager.cc:1434] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.156s	user 0.008s	sys 0.000s
I20260709 13:01:04.889868  8682 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.891122  8682 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.890373  8114 catalog_manager.cc:5697] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:04.900220  8409 tablet_bootstrap.cc:492] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:04.901809  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:04.909731  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:04.911201  8332 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:01:04.903183  8184 leader_election.cc:343] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.912369  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:04.913115  8284 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:04.914383  8416 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:04.914623  8462 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:04.915026  8462 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.915345  8462 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.927145  8462 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.929450  8462 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:04.930189  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:04.931970  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:04.937994  8284 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.939515  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:01:04.940327  8331 leader_election.cc:343] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.945019  8750 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:04.948441  8183 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:04.950126  8409 tablet_bootstrap.cc:654] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:04.950563  8682 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:04.952229  8682 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.952756  8682 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.958135  8407 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:04.962512  8284 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:04.970162  8682 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.970727  8407 ts_tablet_manager.cc:1403] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.157s	user 0.009s	sys 0.016s
I20260709 13:01:04.971582  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:04.966575  8409 tablet_bootstrap.cc:492] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:04.972358  8462 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:04.972841  8462 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:04.973177  8409 ts_tablet_manager.cc:1403] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.000s
I20260709 13:01:04.973079  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:04.973763  8291 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.973701  8462 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.966861  8408 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:04.979000  8408 ts_tablet_manager.cc:1403] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.159s	user 0.032s	sys 0.055s
I20260709 13:01:04.981910  8408 raft_consensus.cc:359] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.983204  8291 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:04.977759  8409 raft_consensus.cc:359] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.986934  8409 raft_consensus.cc:385] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.985976  8407 raft_consensus.cc:359] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.987486  8183 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:04.987241  8408 raft_consensus.cc:385] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.988113  8408 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:04.988369  8749 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:04.988844  8749 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:04.988940  8408 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.984246  8682 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:04.987848  8407 raft_consensus.cc:385] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:04.990489  8407 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:04.987586  8409 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:04.986159  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:04.989627  8749 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.992895  8409 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:04.993698  8407 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:04.995393  8184 leader_election.cc:343] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:04.995652  8409 ts_tablet_manager.cc:1434] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 13:01:04.999897  8408 ts_tablet_manager.cc:1434] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:01:05.027271  8407 ts_tablet_manager.cc:1434] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:01:05.027583  8408 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:05.030988  8409 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:05.028323  8407 tablet_bootstrap.cc:492] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:05.052870  8112 catalog_manager.cc:5697] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.054453  8408 tablet_bootstrap.cc:654] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.057190  8409 tablet_bootstrap.cc:654] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.066772  8407 tablet_bootstrap.cc:654] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.069073  8114 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:05.089239  8407 tablet_bootstrap.cc:492] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:05.089753  8407 ts_tablet_manager.cc:1403] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.002s
I20260709 13:01:05.092478  8407 raft_consensus.cc:359] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.093168  8407 raft_consensus.cc:385] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.093427  8407 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.093871  8407 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.101514  8407 ts_tablet_manager.cc:1434] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:01:05.102566  8407 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:05.105320  8408 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:05.105755  8409 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:05.106218  8409 ts_tablet_manager.cc:1403] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.017s
I20260709 13:01:05.108965  8409 raft_consensus.cc:359] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.109963  8409 raft_consensus.cc:385] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.110230  8409 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.105789  8408 ts_tablet_manager.cc:1403] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.078s	user 0.006s	sys 0.018s
I20260709 13:01:05.110818  8409 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.113380  8409 ts_tablet_manager.cc:1434] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:05.113845  8408 raft_consensus.cc:359] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.114578  8408 raft_consensus.cc:385] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.114670  8409 tablet_bootstrap.cc:492] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:05.116525  8407 tablet_bootstrap.cc:654] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.119200  8408 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.120007  8408 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.122036  8408 ts_tablet_manager.cc:1434] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:01:05.123602  8408 tablet_bootstrap.cc:492] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:05.125023  8409 tablet_bootstrap.cc:654] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.126355  8658 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.127064  8658 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.137588  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.145130  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.146406  8408 tablet_bootstrap.cc:654] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:05.146858  8259 leader_election.cc:343] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:05.158156  8257 leader_election.cc:343] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.160269  8257 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:05.166320  8743 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:05.155881  8658 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.172472  8407 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:05.172600  8409 tablet_bootstrap.cc:492] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:05.172974  8407 ts_tablet_manager.cc:1403] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.000s
I20260709 13:01:05.173151  8409 ts_tablet_manager.cc:1403] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.000s
I20260709 13:01:05.175391  8407 raft_consensus.cc:359] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.175892  8407 raft_consensus.cc:385] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.176184  8409 raft_consensus.cc:359] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.176999  8409 raft_consensus.cc:385] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.177349  8409 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.176116  8407 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.178658  8407 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.182505  8409 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.186869  8407 ts_tablet_manager.cc:1434] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:01:05.188155  8407 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:05.194497  8409 ts_tablet_manager.cc:1434] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:01:05.197263  8409 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:05.197366  8749 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.198917  8749 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.203166  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:05.203876  8284 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:05.204066  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.204792  8365 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:05.205749  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:05.207214  8707 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:05.207548  8707 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.207844  8707 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.208467  8408 tablet_bootstrap.cc:492] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:05.208949  8408 ts_tablet_manager.cc:1403] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.018s
I20260709 13:01:05.211391  8749 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.212251  8407 tablet_bootstrap.cc:654] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.213145  8408 raft_consensus.cc:359] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.213842  8408 raft_consensus.cc:385] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.214156  8408 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.211386  8409 tablet_bootstrap.cc:654] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.214711  8658 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.215457  8658 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.219715  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.218202  8408 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.222030  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.223170  8365 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:05.223372  8707 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.224149  8408 ts_tablet_manager.cc:1434] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:01:05.225505  8259 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:05.226887  8408 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:05.226744  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:05.227007  8743 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:05.227344  8284 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.227394  8743 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.227907  8743 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.238343  8408 tablet_bootstrap.cc:654] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.242276  8707 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.240592  8284 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:05.243675  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:05.244287  8366 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.251794  8658 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:05.252818  8257 leader_election.cc:343] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.256019  8409 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:05.253134  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:05.257098  8409 ts_tablet_manager.cc:1403] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.010s
I20260709 13:01:05.257838  8749 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:05.258577  8749 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:05.259384  8749 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.261147  8409 raft_consensus.cc:359] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.262557  8409 raft_consensus.cc:385] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.262988  8409 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.263722  8409 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.271181  8408 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:05.271857  8408 ts_tablet_manager.cc:1403] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.007s
I20260709 13:01:05.275183  8408 raft_consensus.cc:359] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.275892  8408 raft_consensus.cc:385] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.276146  8408 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.277009  8408 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.279989  8408 ts_tablet_manager.cc:1434] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:05.266016  8409 ts_tablet_manager.cc:1434] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:01:05.282469  8409 tablet_bootstrap.cc:492] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: Bootstrap starting.
I20260709 13:01:05.286755  8408 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:05.289336  8658 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.289855  8658 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.294502  8366 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:05.294981  8409 tablet_bootstrap.cc:654] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.279253  8743 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.305920  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:05.306291  8658 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.306578  8365 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.308406  8408 tablet_bootstrap.cc:654] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.313158  8365 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:05.313426  8409 tablet_bootstrap.cc:492] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: No bootstrap required, opened a new log
I20260709 13:01:05.313961  8409 ts_tablet_manager.cc:1403] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.005s
I20260709 13:01:05.314215  8259 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:05.315044  8658 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:05.315546  8658 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:05.316371  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.316592  8658 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.317142  8409 raft_consensus.cc:359] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.317888  8409 raft_consensus.cc:385] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.318199  8409 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Initialized, Role: FOLLOWER
W20260709 13:01:05.318706  8259 leader_election.cc:343] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.319428  8646 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.319316  8409 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.319995  8646 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.322007  8409 ts_tablet_manager.cc:1434] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:05.322021  8646 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.323848  8743 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.326104  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.329244  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:05.330991  8257 leader_election.cc:343] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.332389  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:05.332158  8114 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:05.334406  8257 leader_election.cc:343] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.328570  8709 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.336639  8257 leader_election.cc:343] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.337065  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:05.338584  8748 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:05.337846  8709 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.348759  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.351768  8408 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:05.352465  8408 ts_tablet_manager.cc:1403] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.003s
I20260709 13:01:05.355312  8709 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:05.356478  8408 raft_consensus.cc:359] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.356895  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.357303  8408 raft_consensus.cc:385] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.357590  8408 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.358299  8408 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.364537  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:05.365336  8284 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:05.368649  8407 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:05.369212  8407 ts_tablet_manager.cc:1403] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.181s	user 0.049s	sys 0.033s
W20260709 13:01:05.358381  8331 leader_election.cc:343] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.370800  8332 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:01:05.371919  8259 leader_election.cc:343] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.372370  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:05.372601  8462 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:05.373440  8408 ts_tablet_manager.cc:1434] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 13:01:05.377169  8462 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.377558  8462 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.377954  8408 tablet_bootstrap.cc:492] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:05.378659  8748 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:05.384979  8407 raft_consensus.cc:359] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.385702  8407 raft_consensus.cc:385] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.385957  8407 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.387269  8747 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.387845  8747 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.388224  8682 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.388620  8682 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.389991  8747 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:05.390707  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.386770  8407 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.391888  8682 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.392539  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:05.392699  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:05.393231  8291 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 1: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:05.393412  8284 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 1: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:05.391768  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.398409  8331 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:05.399202  8709 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.400777  8408 tablet_bootstrap.cc:654] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.393314  8407 ts_tablet_manager.cc:1434] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:01:05.406553  8709 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:05.406481  8184 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:05.405772  8112 catalog_manager.cc:5697] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:05.413108  8707 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.413892  8702 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.414402  8702 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.416577  8702 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.419682  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:05.420334  8284 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:05.421411  8707 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:05.421615  8407 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:05.424378  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:05.425354  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:05.426697  8184 leader_election.cc:343] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.427229  8429 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:05.427580  8429 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.427886  8429 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.428333  8407 tablet_bootstrap.cc:654] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.438467  8658 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.439098  8658 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.448261  8749 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:05.466905  8462 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.462049  8707 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:05.471468  8407 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:05.472011  8407 ts_tablet_manager.cc:1403] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.002s
I20260709 13:01:05.473820  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.474900  8407 raft_consensus.cc:359] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.475677  8407 raft_consensus.cc:385] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:05.475502  8257 leader_election.cc:343] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.475998  8407 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.476635  8407 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.477049  8462 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:05.478436  8214 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.479053  8407 ts_tablet_manager.cc:1434] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:05.479687  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:05.480217  8291 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.482240  8658 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.493893  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:05.494272  8429 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:05.496074  8331 leader_election.cc:343] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.496285  8429 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.497530  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:01:05.498979  8184 leader_election.cc:343] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.499940  8291 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:05.501991  8332 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:05.499002  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.503897  8462 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:05.512181  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:05.512806  8291 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.517062  8291 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:05.518153  8407 tablet_bootstrap.cc:492] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:05.519836  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:01:05.521463  8259 leader_election.cc:343] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.521952  8259 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:05.522784  8646 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:05.522780  8682 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:05.523427  8682 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:05.524206  8682 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.517709  8462 raft_consensus.cc:697] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:05.525965  8462 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.541625  8408 tablet_bootstrap.cc:492] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:05.542452  8408 ts_tablet_manager.cc:1403] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.165s	user 0.019s	sys 0.038s
I20260709 13:01:05.566162  8407 tablet_bootstrap.cc:654] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.579962  8703 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.580606  8703 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.600601  8462 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:05.602291  8703 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.600620  8408 raft_consensus.cc:359] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.607892  8408 raft_consensus.cc:385] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.608433  8408 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.611449  8709 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:05.619657  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:05.621651  8257 leader_election.cc:343] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.623253  8407 tablet_bootstrap.cc:492] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:05.623752  8407 ts_tablet_manager.cc:1403] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.005s
I20260709 13:01:05.612227  8408 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.609736  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.630825  8112 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:05.633190  8259 leader_election.cc:343] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.633656  8259 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:05.634544  8408 ts_tablet_manager.cc:1434] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.002s
I20260709 13:01:05.634685  8646 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:05.640795  8408 tablet_bootstrap.cc:492] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:05.647230  8115 catalog_manager.cc:5697] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.649731  8408 tablet_bootstrap.cc:654] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.653205  8407 raft_consensus.cc:359] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.653966  8407 raft_consensus.cc:385] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.654268  8407 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.654891  8407 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.656988  8407 ts_tablet_manager.cc:1434] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.004s
I20260709 13:01:05.657871  8407 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:05.663826  8407 tablet_bootstrap.cc:654] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.680591  8646 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.681221  8646 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.681908  8408 tablet_bootstrap.cc:492] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:05.682721  8408 ts_tablet_manager.cc:1403] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.005s
I20260709 13:01:05.686182  8646 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.685983  8408 raft_consensus.cc:359] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.686712  8408 raft_consensus.cc:385] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.686926  8408 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.687264  8749 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.687481  8408 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.687809  8749 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.689841  8749 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.690780  8408 ts_tablet_manager.cc:1434] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:05.691548  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.692003  8408 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:05.694444  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:05.695091  8291 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:05.695333  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.695959  8217 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:05.696382  8183 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:05.697233  8682 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:05.697580  8682 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.698235  8682 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.699127  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:05.699807  8363 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 0.
I20260709 13:01:05.700439  8257 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:05.703222  8407 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:05.703544  8743 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:05.703884  8407 ts_tablet_manager.cc:1403] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.003s
I20260709 13:01:05.704121  8743 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.704491  8743 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:05.707471  8184 leader_election.cc:343] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.703459  8408 tablet_bootstrap.cc:654] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.718158  8407 raft_consensus.cc:359] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.718858  8407 raft_consensus.cc:385] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.719127  8407 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.719774  8407 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.721828  8407 ts_tablet_manager.cc:1434] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:01:05.725549  8703 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:05.726593  8407 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:05.737744  8407 tablet_bootstrap.cc:654] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.744534  8429 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:05.784507  8257 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:05.717726  8743 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.789206  8743 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.790355  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:05.791163  8365 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.797335  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:05.798115  8217 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.799731  8365 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:05.802425  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:05.803399  8743 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:05.804162  8743 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:05.805126  8743 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.824450  8217 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:05.753494  8682 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.838588  8416 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.839097  8416 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.841251  8416 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:05.842427  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.843065  8214 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:05.843233  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:05.843835  8284 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.844729  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:05.845780  8291 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:05.847404  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:05.848225  8416 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:05.848573  8416 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.848891  8416 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.858717  8429 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:05.869720  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:01:05.871088  8184 leader_election.cc:343] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.838205  8115 catalog_manager.cc:5697] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:05.871770  8682 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.879351  8284 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:05.880584  8183 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:05.866627  8416 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.888787  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:05.889431  8217 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.890007  8682 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:05.890538  8682 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:05.891326  8682 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.895104  8416 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:05.894462  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:05.896106  8284 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.938480  8217 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:05.939412  8408 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:05.939851  8408 ts_tablet_manager.cc:1403] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.248s	user 0.102s	sys 0.103s
I20260709 13:01:05.941077  8407 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:05.941504  8407 ts_tablet_manager.cc:1403] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.215s	user 0.057s	sys 0.074s
I20260709 13:01:05.942354  8331 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:05.943724  8706 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:05.944168  8706 raft_consensus.cc:697] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:05.944942  8706 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.945732  8408 raft_consensus.cc:359] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.946408  8408 raft_consensus.cc:385] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.946652  8408 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.947250  8408 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.949219  8408 ts_tablet_manager.cc:1434] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:01:05.950152  8408 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:05.955847  8408 tablet_bootstrap.cc:654] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.956575  8703 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.957044  8703 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.957250  8407 raft_consensus.cc:359] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.957927  8407 raft_consensus.cc:385] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.958246  8407 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.958940  8407 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:05.960906  8703 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:05.961104  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:05.961750  8115 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:05.963627  8257 leader_election.cc:343] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.965020  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:05.966590  8259 leader_election.cc:343] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:05.967077  8259 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:05.968878  8703 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:05.969158  8284 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:05.960944  8407 ts_tablet_manager.cc:1434] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 13:01:05.976307  8407 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:05.982038  8407 tablet_bootstrap.cc:654] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:05.997697  8164 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:05.998270  8749 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:06.003163  8112 catalog_manager.cc:5697] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.007447  8408 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:06.008015  8408 ts_tablet_manager.cc:1403] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.014s
I20260709 13:01:06.009191  8407 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:06.009634  8407 ts_tablet_manager.cc:1403] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 13:01:06.010866  8408 raft_consensus.cc:359] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.011611  8408 raft_consensus.cc:385] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.011905  8408 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.012107  8407 raft_consensus.cc:359] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.012727  8407 raft_consensus.cc:385] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.013019  8407 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.012744  8408 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.013684  8407 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.015436  8408 ts_tablet_manager.cc:1434] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:01:06.015914  8407 ts_tablet_manager.cc:1434] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:01:06.016541  8408 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:06.016841  8407 tablet_bootstrap.cc:492] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:06.023658  8408 tablet_bootstrap.cc:654] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.024132  8407 tablet_bootstrap.cc:654] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.031052  8709 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.031571  8709 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.050312  8709 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.051676  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.052358  8284 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:06.053406  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.054309  8709 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.054674  8709 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.054533  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:06.055933  8331 leader_election.cc:343] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.056743  8408 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:06.057193  8408 ts_tablet_manager.cc:1403] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 13:01:06.059809  8408 raft_consensus.cc:359] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.060295  8709 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.060465  8408 raft_consensus.cc:385] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.060981  8408 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.061445  8407 tablet_bootstrap.cc:492] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:06.061910  8407 ts_tablet_manager.cc:1403] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.004s
I20260709 13:01:06.061585  8408 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.063712  8408 ts_tablet_manager.cc:1434] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:06.064378  8706 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.064800  8408 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:06.064421  8407 raft_consensus.cc:359] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.065521  8407 raft_consensus.cc:385] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.065794  8407 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.064883  8706 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.066674  8407 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.068671  8407 ts_tablet_manager.cc:1434] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:06.069350  8706 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.071090  8408 tablet_bootstrap.cc:654] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.074057  8407 tablet_bootstrap.cc:492] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:06.074645  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.078397  8293 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:06.079272  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.080030  8706 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.080356  8706 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.080657  8407 tablet_bootstrap.cc:654] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.080669  8706 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:06.081821  8184 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.087878  8706 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.091306  8709 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.092473  8407 tablet_bootstrap.cc:492] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:06.093016  8407 ts_tablet_manager.cc:1403] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:01:06.095680  8407 raft_consensus.cc:359] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.096436  8407 raft_consensus.cc:385] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.096987  8407 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.097659  8407 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.100777  8407 ts_tablet_manager.cc:1434] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:06.101781  8407 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:06.102412  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:06.108294  8407 tablet_bootstrap.cc:654] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:06.111470  8331 leader_election.cc:343] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.113440  8749 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.113906  8749 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.116098  8749 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.118036  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.118243  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:06.118780  8284 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
W20260709 13:01:06.120442  8184 leader_election.cc:343] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.122707  8706 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.124220  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:06.124366  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:06.124858  8215 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.124966  8749 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.125388  8749 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.125965  8749 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.130694  8408 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:06.131193  8408 ts_tablet_manager.cc:1403] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.027s
I20260709 13:01:06.132978  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:06.133529  8407 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:06.133966  8407 ts_tablet_manager.cc:1403] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 13:01:06.126111  8706 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:01:06.134377  8331 leader_election.cc:343] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.139787  8407 raft_consensus.cc:359] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.150144  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:06.135723  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:06.147018  8749 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.155597  8284 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.157145  8291 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.162040  8416 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.155026  8407 raft_consensus.cc:385] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.162575  8416 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.136981  8408 raft_consensus.cc:359] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.163272  8408 raft_consensus.cc:385] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.163534  8408 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
W20260709 13:01:06.163798  8331 leader_election.cc:343] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.164252  8408 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.167138  8291 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:06.167683  8408 ts_tablet_manager.cc:1434] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.005s
I20260709 13:01:06.165449  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:06.168021  8749 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.168147  8293 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.168833  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.169066  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:06.169569  8291 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 1: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:06.170156  8747 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.170986  8747 raft_consensus.cc:697] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:06.171816  8747 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.162765  8407 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.167563  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:06.173744  8709 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.173398  8407 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:06.174125  8184 leader_election.cc:343] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.174592  8462 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.175932  8407 ts_tablet_manager.cc:1434] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.007s
I20260709 13:01:06.178119  8407 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:06.172822  8293 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:06.166363  8284 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:06.182359  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:06.182520  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:06.184273  8462 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.184986  8462 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:06.184253  8707 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.186837  8707 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:06.187009  8407 tablet_bootstrap.cc:654] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.187745  8707 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.188186  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:06.189389  8408 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:06.164960  8416 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.195189  8331 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:06.197053  8416 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.185918  8462 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.200989  8408 tablet_bootstrap.cc:654] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.208227  8416 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.212518  8407 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:06.213084  8407 ts_tablet_manager.cc:1403] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 13:01:06.215888  8407 raft_consensus.cc:359] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.216578  8407 raft_consensus.cc:385] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.216830  8407 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.217465  8407 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.222795  8408 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:06.223397  8408 ts_tablet_manager.cc:1403] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 13:01:06.226722  8408 raft_consensus.cc:359] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.231124  8217 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.232627  8407 ts_tablet_manager.cc:1434] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:01:06.234263  8407 tablet_bootstrap.cc:492] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:06.241792  8703 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:06.227705  8408 raft_consensus.cc:385] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.249857  8408 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.250633  8408 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.261678  8407 tablet_bootstrap.cc:654] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.276355  8408 ts_tablet_manager.cc:1434] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:01:06.277642  8408 tablet_bootstrap.cc:492] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:06.285441  8407 tablet_bootstrap.cc:492] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:06.286049  8407 ts_tablet_manager.cc:1403] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.001s
I20260709 13:01:06.290199  8749 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.290690  8749 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.287122  8114 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.292018  8114 catalog_manager.cc:5697] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.292678  8749 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.294152  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:06.294837  8363 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:06.296082  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.296885  8749 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.297262  8749 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.297611  8749 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.297605  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.298307  8284 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:06.309018  8408 tablet_bootstrap.cc:654] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.311744  8407 raft_consensus.cc:359] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.312479  8407 raft_consensus.cc:385] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.312744  8407 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.317178  8407 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.318018  8749 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.319563  8407 ts_tablet_manager.cc:1434] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.030s	user 0.001s	sys 0.004s
I20260709 13:01:06.320500  8407 tablet_bootstrap.cc:492] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:06.324944  8112 catalog_manager.cc:5697] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.333338  8407 tablet_bootstrap.cc:654] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.337682  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:06.338321  8363 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.338385  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:06.339020  8286 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.345817  8363 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:06.346200  8286 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:06.347088  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.347857  8682 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.348291  8682 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:06.349128  8682 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.359457  8706 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.359993  8706 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.361543  8706 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.362241  8749 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.365535  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.366197  8284 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:06.368413  8408 tablet_bootstrap.cc:492] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:06.367945  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.370747  8814 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.371148  8814 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.371474  8814 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.377398  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:06.378119  8215 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:06.379460  8743 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.369109  8408 ts_tablet_manager.cc:1403] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.010s
I20260709 13:01:06.382958  8408 raft_consensus.cc:359] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.390722  8408 raft_consensus.cc:385] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.391093  8408 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.391762  8408 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.396739  8407 tablet_bootstrap.cc:492] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:06.397560  8407 ts_tablet_manager.cc:1403] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.017s
I20260709 13:01:06.399415  8408 ts_tablet_manager.cc:1434] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:01:06.400138  8407 raft_consensus.cc:359] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.401170  8407 raft_consensus.cc:385] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.400748  8682 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.401865  8408 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:06.401636  8682 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.406754  8682 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.408502  8743 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:06.408738  8407 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.409060  8743 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.409641  8407 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.410374  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:06.410952  8364 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:06.381803  8814 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.413407  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.413991  8284 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:06.413889  8408 tablet_bootstrap.cc:654] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.414343  8407 ts_tablet_manager.cc:1434] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:01:06.414686  8814 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.412047  8184 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.411135  8743 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.412665  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:06.415527  8407 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc: Bootstrap starting.
I20260709 13:01:06.415815  8217 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:06.408545  8112 catalog_manager.cc:5697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.416951  8257 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:06.417331  8749 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:06.417725  8749 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.418063  8749 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.417908  8743 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.421105  8743 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:06.421460  8743 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.425076  8749 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.429302  8749 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.430770  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:06.431381  8363 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.434336  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:06.434260  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:06.435012  8217 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.436565  8407 tablet_bootstrap.cc:654] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.440361  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:06.440569  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:06.441145  8284 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.441825  8706 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:06.446393  8743 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.447360  8293 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.453155  8217 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:06.453521  8284 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:06.453229  8293 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:06.454303  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:06.454787  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.455116  8408 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:06.455056  8215 raft_consensus.cc:2368] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3.
I20260709 13:01:06.455641  8408 ts_tablet_manager.cc:1403] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.014s
I20260709 13:01:06.457142  8257 leader_election.cc:400] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3.
I20260709 13:01:06.457159  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:06.457581  8257 leader_election.cc:403] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:06.458236  8703 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3.
I20260709 13:01:06.458467  8363 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:06.459280  8706 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.459293  8749 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:06.459954  8706 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:06.460114  8749 raft_consensus.cc:697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:06.460376  8743 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.461326  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:06.459085  8408 raft_consensus.cc:359] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.462055  8364 raft_consensus.cc:2368] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3.
I20260709 13:01:06.462317  8408 raft_consensus.cc:385] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.462612  8408 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.462061  8749 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.463270  8408 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.465548  8408 ts_tablet_manager.cc:1434] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:01:06.466571  8259 leader_election.cc:400] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3.
I20260709 13:01:06.461517  8706 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.474018  8408 tablet_bootstrap.cc:492] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Bootstrap starting.
I20260709 13:01:06.480499  8780 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.510583  8114 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:06.514138  8393 tablet.cc:2406] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:06.519907  8407 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc: No bootstrap required, opened a new log
I20260709 13:01:06.520391  8407 ts_tablet_manager.cc:1403] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.009s
I20260709 13:01:06.508065  8749 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:01:06.525560  8682 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.526044  8682 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.528944  8749 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.534837  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:06.535630  8363 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:06.536989  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.539367  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.539994  8291 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 0.
I20260709 13:01:06.540989  8429 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.541420  8429 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.541721  8429 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.537808  8682 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.531380  8407 raft_consensus.cc:359] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.551899  8407 raft_consensus.cc:385] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.552403  8407 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.567732  8407 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.573181  8407 ts_tablet_manager.cc:1434] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 13:01:06.573917  8408 tablet_bootstrap.cc:654] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.553544  8429 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.592497  8811 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.592972  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:06.593582  8291 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.593098  8811 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.596056  8811 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.596982  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.597683  8286 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:06.598858  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:06.599468  8332 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.600757  8812 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.601123  8812 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.600965  8682 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.601943  8682 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.603965  8682 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.601526  8812 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.604478  8750 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.599500  8215 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 0.
I20260709 13:01:06.611691  8291 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:06.615239  8811 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.615866  8811 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.619233  8811 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.619529  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:06.620882  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:06.623081  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.625524  8286 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 1: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:06.627637  8750 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.628077  8750 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:06.628185  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:06.630008  8114 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.629799  8365 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.630473  8750 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.624131  8812 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.637241  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:06.637858  8217 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.640759  8812 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:06.643127  8184 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:06.644852  8217 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:06.645793  8331 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:06.646242  8682 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.646551  8812 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.647245  8812 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:06.648028  8812 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:06.651726  8184 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.652755  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:06.653185  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:06.654369  8286 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.663946  8286 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:06.666567  8332 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:06.655503  8112 catalog_manager.cc:5697] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.675730  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:06.676403  8363 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.679018  8682 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:06.704766  8828 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:01:06.714425  8811 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.674633  8429 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 1 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:06.738025  8408 tablet_bootstrap.cc:492] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: No bootstrap required, opened a new log
I20260709 13:01:06.753630  8408 ts_tablet_manager.cc:1403] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent bootstrapping tablet: real 0.280s	user 0.026s	sys 0.033s
I20260709 13:01:06.712100  8363 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:06.756280  8408 raft_consensus.cc:359] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.757017  8408 raft_consensus.cc:385] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.757302  8408 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.758504  8408 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:06.760030  8408 ts_tablet_manager.cc:1434] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:06.763478  8811 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.764834  8836 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:06.770021  8429 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.773445  8215 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.774219  8811 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.775650  8706 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.782361  8811 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.785869  8114 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.882850  8462 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:06.895828  8462 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.009863  8364 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:07.011147  8836 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:07.046463  8291 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:07.047888  8750 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:07.054507  8811 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.069532  8811 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.070032  8811 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:07.075070  8811 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:07.078219  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:07.079900  8812 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.081173  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:07.082675  8361 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.085029  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:07.101181  8812 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:07.141470  8429 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.150681  8707 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:08.026197  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:08.060941  8853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:08.061456  8852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:08.061584  8855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:08.063086  7088 server_base.cc:1061] running on GCE node
I20260709 13:01:08.065755  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:08.066102  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:08.066351  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602068066328 us; error 0 us; skew 500 ppm
I20260709 13:01:08.067284  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:08.070994  7088 webserver.cc:533] Webserver started at http://127.6.236.4:38905/ using document root <none> and password file <none>
I20260709 13:01:08.071527  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:08.071784  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:08.072086  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:08.073295  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-3-root/instance:
uuid: "4a50f39e2d8e4886a79849938f2272a6"
format_stamp: "Formatted at 2026-07-09 13:01:08 on dist-test-slave-j4mc"
I20260709 13:01:08.083709  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.011s	sys 0.001s
I20260709 13:01:08.089907  8860 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:08.091006  7088 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:01:08.091478  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-3-root
uuid: "4a50f39e2d8e4886a79849938f2272a6"
format_stamp: "Formatted at 2026-07-09 13:01:08 on dist-test-slave-j4mc"
I20260709 13:01:08.091889  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:08.148433  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:08.149914  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:08.151283  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:08.153730  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:08.153932  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:08.154206  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:08.154376  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:08.262653  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.4:42929
I20260709 13:01:08.262738  8922 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.4:42929 every 8 connection(s)
I20260709 13:01:08.268257  7088 auto_leader_rebalancer-test.cc:384] add a tserver: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:08.285662  8923 heartbeater.cc:344] Connected to a master server at 127.6.236.62:39147
I20260709 13:01:08.286274  8923 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:08.287024  8923 heartbeater.cc:507] Master 127.6.236.62:39147 requested a full tablet report, sending...
I20260709 13:01:08.289268  8114 ts_manager.cc:194] Registered new tserver with Master: 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:08.291478  8114 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48060
I20260709 13:01:09.256397  8217 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:09.264118  8363 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:09.266553  8928 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:09.275368  8291 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:09.278437  8928 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:09.291386  8183 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b726723bee647ec82d162a5cf1a6515. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:09.293593  8836 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.295516  8923 heartbeater.cc:499] Master 127.6.236.62:39147 was elected leader, sending a full tablet report...
I20260709 13:01:09.296929  8291 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.301327  8364 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.319273  8112 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.341041  8364 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:09.404132  8215 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:09.412685  8706 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:09.464123  8291 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:09.470017  8706 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.484750  8943 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
W20260709 13:01:09.490172  8332 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6d613c8b7844e67ad3e2aa415a57d42. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:09.491273  8214 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.515448  8115 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.522140  8286 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.540153  8286 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:09.552795  8217 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:09.554208  8364 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:09.554837  8944 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:09.562337  8942 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.571702  8743 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
W20260709 13:01:09.577677  8258 consensus_peers.cc:597] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d553c54f49c4cd1a7737e4136f02960. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:09.577495  8361 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.581902  8214 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.592056  8215 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:09.598896  8114 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.604292  8286 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:01:09.606536  8183 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b6a07d8346e4fd5a54166e1cb3b1660. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:09.607108  8928 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.610236  8361 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:09.611584  8836 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.627307  8287 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.625494  8927 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.641709  8361 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:09.673947  8112 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.725054  8958 ts_tablet_manager.cc:933] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:09.730731  8958 tablet_copy_client.cc:323] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:09.750313  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet 5b726723bee647ec82d162a5cf1a6515 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:09.750960  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet 5b726723bee647ec82d162a5cf1a6515 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-5b726723bee647ec82d162a5cf1a6515
I20260709 13:01:09.757803  8228 tablet_copy_source_session.cc:215] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:09.761744  8958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b726723bee647ec82d162a5cf1a6515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.782657  8958 tablet_copy_client.cc:806] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:09.783309  8958 tablet_copy_client.cc:670] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:09.792893  8958 tablet_copy_client.cc:538] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:09.808676  8958 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:09.834578  8958 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.835762  8958 tablet_bootstrap.cc:492] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:09.836915  8958 ts_tablet_manager.cc:1403] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.009s
I20260709 13:01:09.841572  8958 raft_consensus.cc:359] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:09.842823  8958 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:09.843779  8958 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:09.853632  8958 ts_tablet_manager.cc:1434] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:01:09.856698  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-5b726723bee647ec82d162a5cf1a6515 received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:09.858724  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-5b726723bee647ec82d162a5cf1a6515 on tablet 5b726723bee647ec82d162a5cf1a6515 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:10.017527  8958 ts_tablet_manager.cc:933] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:10.019068  8958 tablet_copy_client.cc:323] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:10.030483  8965 ts_tablet_manager.cc:933] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:10.033872  8377 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet f6d613c8b7844e67ad3e2aa415a57d42 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:10.034508  8377 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet f6d613c8b7844e67ad3e2aa415a57d42 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-f6d613c8b7844e67ad3e2aa415a57d42
I20260709 13:01:10.034588  8965 tablet_copy_client.cc:323] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:10.038385  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet 8b6a07d8346e4fd5a54166e1cb3b1660 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:10.038997  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet 8b6a07d8346e4fd5a54166e1cb3b1660 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-8b6a07d8346e4fd5a54166e1cb3b1660
I20260709 13:01:10.046103  8228 tablet_copy_source_session.cc:215] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:10.049641  8965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6a07d8346e4fd5a54166e1cb3b1660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.058683  8377 tablet_copy_source_session.cc:215] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:10.063766  8958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d613c8b7844e67ad3e2aa415a57d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.064821  8965 tablet_copy_client.cc:806] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:10.065438  8965 tablet_copy_client.cc:670] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:10.070065  8965 tablet_copy_client.cc:538] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:10.081857  8965 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:10.087087  8958 tablet_copy_client.cc:806] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:10.087836  8958 tablet_copy_client.cc:670] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:10.096015  8958 tablet_copy_client.cc:538] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:10.106349  8958 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:10.114903  8965 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:10.116004  8965 tablet_bootstrap.cc:492] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:10.116796  8965 ts_tablet_manager.cc:1403] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.035s	user 0.027s	sys 0.004s
I20260709 13:01:10.120438  8965 raft_consensus.cc:359] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:10.121454  8965 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:10.122193  8965 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:10.129184  8969 ts_tablet_manager.cc:933] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:10.131788  8965 ts_tablet_manager.cc:1434] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:01:10.141211  8969 tablet_copy_client.cc:323] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:10.142012  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-8b6a07d8346e4fd5a54166e1cb3b1660 received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:10.142761  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-8b6a07d8346e4fd5a54166e1cb3b1660 on tablet 8b6a07d8346e4fd5a54166e1cb3b1660 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:10.144500  8958 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:10.150271  8958 tablet_bootstrap.cc:492] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:10.150995  8958 ts_tablet_manager.cc:1403] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.014s
I20260709 13:01:10.153893  8958 raft_consensus.cc:359] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:10.154748  8958 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:10.155381  8958 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:10.159484  8958 ts_tablet_manager.cc:1434] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:10.162870  8377 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-f6d613c8b7844e67ad3e2aa415a57d42 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:10.163334  8377 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-f6d613c8b7844e67ad3e2aa415a57d42 on tablet f6d613c8b7844e67ad3e2aa415a57d42 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:10.180569  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet 7d553c54f49c4cd1a7737e4136f02960 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:10.181787  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet 7d553c54f49c4cd1a7737e4136f02960 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-7d553c54f49c4cd1a7737e4136f02960
I20260709 13:01:10.192462  8303 tablet_copy_source_session.cc:215] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:10.195711  8969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d553c54f49c4cd1a7737e4136f02960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.212116  8969 tablet_copy_client.cc:806] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:10.212765  8969 tablet_copy_client.cc:670] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:10.216291  8969 tablet_copy_client.cc:538] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:10.222823  8898 raft_consensus.cc:1217] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:10.226784  8969 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:10.278548  8969 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:10.279422  8969 tablet_bootstrap.cc:492] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:10.280138  8969 ts_tablet_manager.cc:1403] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.016s
I20260709 13:01:10.283223  8969 raft_consensus.cc:359] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:10.284370  8969 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:10.285030  8969 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:10.291504  8969 ts_tablet_manager.cc:1434] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:10.293192  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-7d553c54f49c4cd1a7737e4136f02960 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:10.293632  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-7d553c54f49c4cd1a7737e4136f02960 on tablet 7d553c54f49c4cd1a7737e4136f02960 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:10.534157  8898 raft_consensus.cc:1217] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:10.557706  8898 raft_consensus.cc:1217] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:10.640776  8898 raft_consensus.cc:1217] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:10.810304  8974 raft_consensus.cc:1064] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:10.812413  8974 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:10.829856  8898 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.831411  8836 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:10.833153  8361 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.833454  8286 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.834859  8927 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:10.836640  8927 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:10.871886  8927 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:10.873761  8897 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:10.888059  8114 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:10.891816  8286 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:10.929029  8361 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:10.970599  8214 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:10.976416  8286 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.976670  8897 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.977898  8976 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.979079  8974 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.988891  8974 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:10.990796  8286 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:10.999354  8897 raft_consensus.cc:2955] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.004117  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b726723bee647ec82d162a5cf1a6515 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:11.017172  8115 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.028666  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b726723bee647ec82d162a5cf1a6515 with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:11.032485  8984 tablet_replica.cc:333] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:11.033668  8984 raft_consensus.cc:2243] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.034446  8984 raft_consensus.cc:2272] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.039126  8972 raft_consensus.cc:1064] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:11.041085  8972 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:11.042302  8984 ts_tablet_manager.cc:1916] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:11.047484  8897 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:11.049211  8364 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:11.049929  8743 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:11.052592  8743 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:11.056324  8214 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:11.059353  8972 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:11.061075  8984 ts_tablet_manager.cc:1929] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:11.061661  8984 log.cc:1199] T 5b726723bee647ec82d162a5cf1a6515 P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/5b726723bee647ec82d162a5cf1a6515
I20260709 13:01:11.063881  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 5b726723bee647ec82d162a5cf1a6515 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:11.079080  8972 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.093724  8214 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.098881  8364 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.102981  8897 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.115763  8112 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.133085  8947 raft_consensus.cc:1064] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:11.135630  8947 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:11.142410  8976 raft_consensus.cc:1064] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:11.145218  8976 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:11.156148  8286 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:11.172189  8897 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:11.173928  8986 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:11.184505  8898 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:11.187039  8927 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:11.186652  8898 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.192320  8990 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:11.200838  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 60317.2us
I20260709 13:01:11.209750  8363 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:11.211922  8115 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.231830  8293 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:11.236274  8898 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:11.237839  8462 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:11.240732  8991 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:11.251530  8286 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:11.253736  8927 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:11.254158  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d553c54f49c4cd1a7737e4136f02960 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:11.271555  8363 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:11.271638  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d553c54f49c4cd1a7737e4136f02960 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:11.273365  8976 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:11.275059  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 61966.3us
I20260709 13:01:11.286674  8990 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:11.288074  9001 tablet_replica.cc:333] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:11.288942  9001 raft_consensus.cc:2243] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.290620  9001 raft_consensus.cc:2272] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.292184  8214 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:11.301774  9001 ts_tablet_manager.cc:1916] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:11.314637  8364 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.300420  8998 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.302326  8293 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.306171  8361 raft_consensus.cc:2955] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.305976  8996 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.308547  8897 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.329080  8462 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:11.349826  8115 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.351908  8116 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.355448  8293 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.363420  8897 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.366657  9001 ts_tablet_manager.cc:1929] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:11.371486  9001 log.cc:1199] T 7d553c54f49c4cd1a7737e4136f02960 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/7d553c54f49c4cd1a7737e4136f02960
I20260709 13:01:11.373554  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 7d553c54f49c4cd1a7737e4136f02960 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:11.388756  8214 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:11.391340  8215 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.398177  8287 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:11.399776  8998 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:11.411881  8898 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:11.416023  8998 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:11.427533  8998 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.438757  8287 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.446681  8897 raft_consensus.cc:2955] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.467530  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b6a07d8346e4fd5a54166e1cb3b1660 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:11.476079  8115 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.491644  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6a07d8346e4fd5a54166e1cb3b1660 with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:11.492627  8984 tablet_replica.cc:333] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:11.493809  8984 raft_consensus.cc:2243] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.494577  8984 raft_consensus.cc:2272] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.502658  8984 ts_tablet_manager.cc:1916] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:11.516856  8984 ts_tablet_manager.cc:1929] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:01:11.517181  8984 log.cc:1199] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/8b6a07d8346e4fd5a54166e1cb3b1660
I20260709 13:01:11.518936  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 8b6a07d8346e4fd5a54166e1cb3b1660 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:11.809664  8363 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:11.815207  8897 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:11.816862  8947 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:11.817162  8214 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:11.822382  8947 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:11.824728  8462 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.833340  8897 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.857240  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6d613c8b7844e67ad3e2aa415a57d42 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:11.864207  8112 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.873354  8214 raft_consensus.cc:2955] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:11.890057  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet f6d613c8b7844e67ad3e2aa415a57d42 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:11.892616  9005 tablet_replica.cc:333] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:11.893653  9005 raft_consensus.cc:2243] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.894416  9005 raft_consensus.cc:2272] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.901281  9005 ts_tablet_manager.cc:1916] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:11.914507  9005 ts_tablet_manager.cc:1929] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:11.914834  9005 log.cc:1199] T f6d613c8b7844e67ad3e2aa415a57d42 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/f6d613c8b7844e67ad3e2aa415a57d42
I20260709 13:01:11.916201  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet f6d613c8b7844e67ad3e2aa415a57d42 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:12.958961  8363 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:12.965126  8286 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:12.965116  8332 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8fe31b6ada204d4fab7c4cbe1912fff6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:12.965747  8214 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:12.966521  9004 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:12.967250  8945 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:12.973971  9006 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:12.975572  8286 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:12.975620  8214 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:12.992293  8363 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:12.992058  8112 catalog_manager.cc:5697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.003511  8286 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:13.004180  8332 consensus_peers.cc:597] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 893302ae4fac4d73945a8ad0a674a1e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.005081  9006 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.005648  8213 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:13.007164  9006 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.019821  9004 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.022176  8286 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.029650  8213 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.050040  8114 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.063637  8213 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.080163  8286 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:13.082852  8183 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b139f81eea56438e9aba32ed1941dedb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.083171  8363 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:13.084435  9007 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.087541  9007 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.098011  8998 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.103991  8363 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.106957  8286 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.128327  8112 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.137279  8363 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.150435  8286 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:13.151335  8332 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2384ae06cadc456cb351a6dbe8483639. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.151335  8213 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:13.152318  9019 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.153306  9006 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.162492  9019 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.164134  8215 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.166926  8286 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:13.189244  8114 catalog_manager.cc:5697] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.384750  9026 ts_tablet_manager.cc:933] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:13.386612  9026 tablet_copy_client.cc:323] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:13.388198  8377 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 8fe31b6ada204d4fab7c4cbe1912fff6 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:13.388715  8377 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 8fe31b6ada204d4fab7c4cbe1912fff6 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-8fe31b6ada204d4fab7c4cbe1912fff6
I20260709 13:01:13.395641  8377 tablet_copy_source_session.cc:215] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:13.398399  9026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe31b6ada204d4fab7c4cbe1912fff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.413266  9026 tablet_copy_client.cc:806] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:13.414598  9026 tablet_copy_client.cc:670] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:13.419871  9026 tablet_copy_client.cc:538] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:13.431273  9026 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:13.449254  9026 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:13.449978  9026 tablet_bootstrap.cc:492] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:13.450541  9026 ts_tablet_manager.cc:1403] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:01:13.452904  9026 raft_consensus.cc:359] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.453488  9026 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:13.453970  9026 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.456863  9026 ts_tablet_manager.cc:1434] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:13.459302  8377 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-8fe31b6ada204d4fab7c4cbe1912fff6 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:13.459707  8377 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-8fe31b6ada204d4fab7c4cbe1912fff6 on tablet 8fe31b6ada204d4fab7c4cbe1912fff6 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:13.525156  9026 ts_tablet_manager.cc:933] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:13.526880  9026 tablet_copy_client.cc:323] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:13.528725  8377 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 893302ae4fac4d73945a8ad0a674a1e5 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:13.529274  8377 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 893302ae4fac4d73945a8ad0a674a1e5 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-893302ae4fac4d73945a8ad0a674a1e5
I20260709 13:01:13.537369  8377 tablet_copy_source_session.cc:215] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:13.541095  9026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893302ae4fac4d73945a8ad0a674a1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.554721  9026 tablet_copy_client.cc:806] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:13.555286  9026 tablet_copy_client.cc:670] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:13.559031  9026 tablet_copy_client.cc:538] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:13.569397  9026 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:13.596634  9026 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:13.597563  9026 tablet_bootstrap.cc:492] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:13.598405  9026 ts_tablet_manager.cc:1403] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.008s
I20260709 13:01:13.601614  9026 raft_consensus.cc:359] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.602699  9026 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:13.603420  9026 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.605909  9026 ts_tablet_manager.cc:1434] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:13.607497  8377 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-893302ae4fac4d73945a8ad0a674a1e5 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:13.607829  8377 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-893302ae4fac4d73945a8ad0a674a1e5 on tablet 893302ae4fac4d73945a8ad0a674a1e5 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:13.624495  9026 ts_tablet_manager.cc:933] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:13.626678  9026 tablet_copy_client.cc:323] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:13.628166  8377 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 2384ae06cadc456cb351a6dbe8483639 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:13.628696  8377 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 2384ae06cadc456cb351a6dbe8483639 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-2384ae06cadc456cb351a6dbe8483639
I20260709 13:01:13.636428  8377 tablet_copy_source_session.cc:215] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:13.639631  9026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2384ae06cadc456cb351a6dbe8483639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.656400  9026 tablet_copy_client.cc:806] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:13.656937  9026 tablet_copy_client.cc:670] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:13.660673  9026 tablet_copy_client.cc:538] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:13.668684  9026 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:13.704006  9034 ts_tablet_manager.cc:933] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:13.705695  9026 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:13.706736  9026 tablet_bootstrap.cc:492] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:13.707472  9026 ts_tablet_manager.cc:1403] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.013s
I20260709 13:01:13.710494  9026 raft_consensus.cc:359] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.710924  9034 tablet_copy_client.cc:323] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:13.711320  9026 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:13.711886  9026 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.712733  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet b139f81eea56438e9aba32ed1941dedb from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:13.713295  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet b139f81eea56438e9aba32ed1941dedb from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-b139f81eea56438e9aba32ed1941dedb
I20260709 13:01:13.715939  9026 ts_tablet_manager.cc:1434] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:13.718282  8377 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-2384ae06cadc456cb351a6dbe8483639 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:13.718681  8377 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-2384ae06cadc456cb351a6dbe8483639 on tablet 2384ae06cadc456cb351a6dbe8483639 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:13.727603  8228 tablet_copy_source_session.cc:215] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:13.731637  9034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b139f81eea56438e9aba32ed1941dedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.754417  9034 tablet_copy_client.cc:806] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:13.754976  9034 tablet_copy_client.cc:670] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:13.758908  9034 tablet_copy_client.cc:538] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:13.770766  9034 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:13.792052  9034 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:13.792980  9034 tablet_bootstrap.cc:492] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:13.793658  9034 ts_tablet_manager.cc:1403] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.001s
I20260709 13:01:13.796610  9034 raft_consensus.cc:359] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.797421  9034 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:13.798032  9034 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:13.805020  9034 ts_tablet_manager.cc:1434] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:01:13.808800  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-b139f81eea56438e9aba32ed1941dedb received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:13.809265  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-b139f81eea56438e9aba32ed1941dedb on tablet b139f81eea56438e9aba32ed1941dedb with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:13.830814  8897 raft_consensus.cc:1217] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:14.146912  8897 raft_consensus.cc:1217] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:14.180768  8897 raft_consensus.cc:1217] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:14.231706  8897 raft_consensus.cc:1217] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:14.356276  9040 raft_consensus.cc:1064] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:14.358724  9040 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:14.372576  8897 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.373919  8215 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.375567  9018 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.376089  8286 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.377513  9040 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.383160  9018 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.395345  9004 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.400918  8286 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.402621  8215 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.418421  8897 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.425819  8112 catalog_manager.cc:5697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.482023  8364 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:14.488451  8897 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.488453  8213 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.490209  9040 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.491176  9004 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.498857  9019 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.500716  8897 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.517115  8115 catalog_manager.cc:5697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.519138  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8fe31b6ada204d4fab7c4cbe1912fff6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:14.517377  8215 raft_consensus.cc:2955] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.548664  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fe31b6ada204d4fab7c4cbe1912fff6 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:14.563079  9050 tablet_replica.cc:333] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:14.564249  9050 raft_consensus.cc:2243] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.565076  9050 raft_consensus.cc:2272] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.572422  9050 ts_tablet_manager.cc:1916] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:14.587673  9050 ts_tablet_manager.cc:1929] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:14.588267  9050 log.cc:1199] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/8fe31b6ada204d4fab7c4cbe1912fff6
I20260709 13:01:14.590381  9049 raft_consensus.cc:1064] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:14.590353  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet 8fe31b6ada204d4fab7c4cbe1912fff6 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:14.593127  9049 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:14.600782  8897 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.602442  8286 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.602697  8213 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.604049  9018 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.604827  9049 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.605638  9019 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.623661  9019 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.631155  8836 raft_consensus.cc:1064] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:14.633651  8836 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:14.635857  8897 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.641075  8213 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.646183  8286 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.656920  8114 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.669443  8897 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.670930  9039 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.674809  8286 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.675575  8363 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.676478  8364 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:14.677029  8998 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.682312  8836 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.690056  8898 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.691761  9049 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:14.694175  8287 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.695530  9019 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.702294  9019 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.702113  9039 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.714089  8287 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.707082  8896 raft_consensus.cc:2955] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.710117  8898 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.738595  8284 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.745152  8112 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.746002  8116 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.756181  8363 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.763441  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 893302ae4fac4d73945a8ad0a674a1e5 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:14.772318  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 893302ae4fac4d73945a8ad0a674a1e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:14.794744  9040 raft_consensus.cc:1064] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:14.785142  8213 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:14.797935  9040 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:14.821064  8896 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.822993  8998 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.827250  8286 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.828768  9039 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.835240  8836 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.835665  9059 tablet_replica.cc:333] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:14.842654  8896 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.851222  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b139f81eea56438e9aba32ed1941dedb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:14.851953  8286 raft_consensus.cc:2955] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.880754  8897 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.886433  9018 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.888088  8112 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.890889  9059 raft_consensus.cc:2243] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.891804  9059 raft_consensus.cc:2272] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.899991  9059 ts_tablet_manager.cc:1916] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:14.887754  8286 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.911123  9018 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.920559  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet b139f81eea56438e9aba32ed1941dedb with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:14.929126  9059 ts_tablet_manager.cc:1929] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:14.930647  8214 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.934234  9059 log.cc:1199] T 893302ae4fac4d73945a8ad0a674a1e5 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/893302ae4fac4d73945a8ad0a674a1e5
I20260709 13:01:14.934335  9040 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.943619  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 893302ae4fac4d73945a8ad0a674a1e5 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:14.942153  9062 tablet_replica.cc:333] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:14.947311  9062 raft_consensus.cc:2243] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.948185  9062 raft_consensus.cc:2272] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.948300  9049 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.952943  8214 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.954597  9062 ts_tablet_manager.cc:1916] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:14.954257  8284 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.960979  8896 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.972211  8112 catalog_manager.cc:5697] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:14.999774  8363 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:15.008612  8896 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:15.010743  9067 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:15.011019  8214 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:15.010203  9062 ts_tablet_manager.cc:1929] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:15.012181  9062 log.cc:1199] T b139f81eea56438e9aba32ed1941dedb P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/b139f81eea56438e9aba32ed1941dedb
I20260709 13:01:15.013969  9040 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:15.023375  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet b139f81eea56438e9aba32ed1941dedb (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:15.023571  9066 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:15.033651  8896 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:15.041199  8214 raft_consensus.cc:2955] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:15.043056  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2384ae06cadc456cb351a6dbe8483639 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:15.051254  8112 catalog_manager.cc:5697] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:15.066990  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet 2384ae06cadc456cb351a6dbe8483639 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:15.068066  9050 tablet_replica.cc:333] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:15.069413  9050 raft_consensus.cc:2243] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.070251  9050 raft_consensus.cc:2272] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.073933  9050 ts_tablet_manager.cc:1916] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:15.087869  9050 ts_tablet_manager.cc:1929] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:15.088284  9050 log.cc:1199] T 2384ae06cadc456cb351a6dbe8483639 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/2384ae06cadc456cb351a6dbe8483639
I20260709 13:01:15.089586  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet 2384ae06cadc456cb351a6dbe8483639 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:16.141000  8363 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.146457  8286 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:16.146951  8332 consensus_peers.cc:597] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94f8a1b635cb4638922cb1dcf37e6e5b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:16.146445  8213 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:16.147862  9067 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:16.148663  9040 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:16.156278  9040 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.157863  8213 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.158875  8286 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.176496  8112 catalog_manager.cc:5697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.182902  8363 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.194514  8284 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:16.195075  8332 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffe3e60c735644e380589d65b7850fd2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:16.196192  9067 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:16.198977  8214 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:16.200778  9067 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:01:16.223699  9040 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.225049  8213 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.241685  8286 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.247917  8284 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.264894  8363 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:16.265561  8258 consensus_peers.cc:597] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 864d288163824eac975181159a2708d9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:16.266325  8990 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:16.266438  8115 catalog_manager.cc:5697] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.269748  8213 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:16.271067  8990 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:16.281311  9081 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.283236  8361 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.300690  8213 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.305542  8363 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.312963  8284 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:16.317209  8214 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:16.318511  8332 consensus_peers.cc:597] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:16.319392  9040 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:16.320422  9066 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:16.310010  8112 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.335455  8286 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.332319  9040 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.381621  8115 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.390121  8213 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:16.668959  9089 ts_tablet_manager.cc:933] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:16.671113  9089 tablet_copy_client.cc:323] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:16.673020  8377 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet ffe3e60c735644e380589d65b7850fd2 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:16.673596  8377 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet ffe3e60c735644e380589d65b7850fd2 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-ffe3e60c735644e380589d65b7850fd2
I20260709 13:01:16.683557  8377 tablet_copy_source_session.cc:215] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.687786  9089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe3e60c735644e380589d65b7850fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.701746  9091 ts_tablet_manager.cc:933] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:16.703881  9091 tablet_copy_client.cc:323] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:16.705379  8377 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 94f8a1b635cb4638922cb1dcf37e6e5b from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:16.705819  8377 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 94f8a1b635cb4638922cb1dcf37e6e5b from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-94f8a1b635cb4638922cb1dcf37e6e5b
I20260709 13:01:16.707109  9089 tablet_copy_client.cc:806] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.707796  9089 tablet_copy_client.cc:670] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.712445  9089 tablet_copy_client.cc:538] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.712621  8377 tablet_copy_source_session.cc:215] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.715373  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f8a1b635cb4638922cb1dcf37e6e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.722781  9089 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:16.734834  9091 tablet_copy_client.cc:806] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.735561  9091 tablet_copy_client.cc:670] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.744566  9091 tablet_copy_client.cc:538] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.763736  9091 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:16.775087  9089 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.783733  9089 tablet_bootstrap.cc:492] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:16.784590  9089 ts_tablet_manager.cc:1403] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.010s
I20260709 13:01:16.788026  9089 raft_consensus.cc:359] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.788998  9089 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:16.790228  9089 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.799635  9091 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.800632  9091 tablet_bootstrap.cc:492] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:16.801303  9091 ts_tablet_manager.cc:1403] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.010s
I20260709 13:01:16.804559  9091 raft_consensus.cc:359] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.805544  9091 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:16.806294  9091 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.817189  9091 ts_tablet_manager.cc:1434] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.007s
I20260709 13:01:16.828997  8377 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-94f8a1b635cb4638922cb1dcf37e6e5b received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:16.829599  8377 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-94f8a1b635cb4638922cb1dcf37e6e5b on tablet 94f8a1b635cb4638922cb1dcf37e6e5b with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:16.838382  9091 ts_tablet_manager.cc:933] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:16.858395  9095 ts_tablet_manager.cc:933] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:16.859038  9091 tablet_copy_client.cc:323] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:16.861301  8377 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:16.861861  8377 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-1fb0cdb40f8b48a7a5b79a8bfe7c8fb6
I20260709 13:01:16.880674  9089 ts_tablet_manager.cc:1434] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.096s	user 0.049s	sys 0.028s
I20260709 13:01:16.881753  8377 tablet_copy_source_session.cc:215] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.882781  9095 tablet_copy_client.cc:323] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:16.884414  8377 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-ffe3e60c735644e380589d65b7850fd2 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:16.885198  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet 864d288163824eac975181159a2708d9 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:16.885769  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet 864d288163824eac975181159a2708d9 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-864d288163824eac975181159a2708d9
I20260709 13:01:16.884846  8377 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-ffe3e60c735644e380589d65b7850fd2 on tablet ffe3e60c735644e380589d65b7850fd2 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:16.887846  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.893585  8303 tablet_copy_source_session.cc:215] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.907514  9095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864d288163824eac975181159a2708d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.924813  9091 tablet_copy_client.cc:806] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.925516  9091 tablet_copy_client.cc:670] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.930230  9091 tablet_copy_client.cc:538] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.932749  9095 tablet_copy_client.cc:806] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.933416  9095 tablet_copy_client.cc:670] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.937315  9095 tablet_copy_client.cc:538] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.940132  9091 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:16.949393  9095 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:16.988657  9091 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.989686  9091 tablet_bootstrap.cc:492] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:16.989717  9095 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.990554  9091 ts_tablet_manager.cc:1403] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.008s
I20260709 13:01:16.990990  9095 tablet_bootstrap.cc:492] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:16.992659  9095 ts_tablet_manager.cc:1403] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.019s
I20260709 13:01:16.994114  9091 raft_consensus.cc:359] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.995138  9091 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:16.995805  9091 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.995820  9095 raft_consensus.cc:359] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:16.997814  9095 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:16.998456  9091 ts_tablet_manager.cc:1434] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:01:16.998509  9095 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:17.001056  8377 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:17.001506  8377 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 on tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:17.005266  9095 ts_tablet_manager.cc:1434] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:01:17.007143  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-864d288163824eac975181159a2708d9 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:17.007711  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-864d288163824eac975181159a2708d9 on tablet 864d288163824eac975181159a2708d9 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:17.086755  8897 raft_consensus.cc:1217] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:17.193840  8897 raft_consensus.cc:1217] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:17.204823  8897 raft_consensus.cc:1217] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:17.264967  8897 raft_consensus.cc:1217] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:17.500716  9067 raft_consensus.cc:1064] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:17.502908  9067 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:17.509138  8286 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.509145  8897 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.510555  8215 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.511092  9072 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.512845  9040 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:17.514623  9072 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.524315  9040 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.529784  8286 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.530309  8215 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.544245  8897 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.551945  8115 catalog_manager.cc:5697] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.574281  9072 raft_consensus.cc:1064] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:17.577566  9072 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:17.598347  8215 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.599598  8897 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.599797  9040 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.600209  8287 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.603446  9067 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.606447  9040 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.630919  9040 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.636085  8215 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.643983  8286 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.647001  8364 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:17.653734  8897 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.658540  8215 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:17.661057  9040 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:17.661334  8115 catalog_manager.cc:5697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.672041  8897 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:17.672580  9072 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.676440  9066 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:17.676115  8215 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.681020  8363 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:17.683625  8897 raft_consensus.cc:2955] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.684592  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ffe3e60c735644e380589d65b7850fd2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:17.695823  8990 raft_consensus.cc:1064] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:17.698033  8115 catalog_manager.cc:5697] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.698348  8990 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:17.701946  8896 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:17.706918  9040 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:17.708081  8286 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:17.710500  9040 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:17.713546  9072 raft_consensus.cc:1064] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:17.716070  9072 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:17.721513  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet ffe3e60c735644e380589d65b7850fd2 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:17.726804  9110 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.728026  9118 tablet_replica.cc:333] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:17.734752  8286 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.736622  8896 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.751063  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94f8a1b635cb4638922cb1dcf37e6e5b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:17.756843  9118 raft_consensus.cc:2243] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.757682  9118 raft_consensus.cc:2272] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.760792  9118 ts_tablet_manager.cc:1916] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:17.769927  8897 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.771620  8214 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.772931  9067 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.773741  9119 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:17.778270  9110 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.785605  8115 catalog_manager.cc:5697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.800161  8284 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.805675  9066 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.764492  8896 raft_consensus.cc:2955] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.809868  9118 ts_tablet_manager.cc:1929] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:17.810420  9118 log.cc:1199] T ffe3e60c735644e380589d65b7850fd2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/ffe3e60c735644e380589d65b7850fd2
I20260709 13:01:17.815409  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet ffe3e60c735644e380589d65b7850fd2 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:17.821532  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 94f8a1b635cb4638922cb1dcf37e6e5b with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:17.828938  8215 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.828660  8363 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.830717  9119 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.833449  9119 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.850929  9126 tablet_replica.cc:333] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:17.855111  9067 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.858357  8897 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.878162  9121 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.886102  9126 raft_consensus.cc:2243] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.888083  9126 raft_consensus.cc:2272] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.887745  8116 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.897330  9126 ts_tablet_manager.cc:1916] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:17.900067  8363 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.898515  8215 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.910676  8286 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.900678  8214 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.948807  9126 ts_tablet_manager.cc:1929] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:17.949417  9126 log.cc:1199] T 94f8a1b635cb4638922cb1dcf37e6e5b P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/94f8a1b635cb4638922cb1dcf37e6e5b
I20260709 13:01:17.948493  8897 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.951398  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 94f8a1b635cb4638922cb1dcf37e6e5b (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:17.964632  8116 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:17.982803  8363 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:17.991209  8286 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:17.997637  8897 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:17.999769  9119 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.000576  8897 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:18.000911  8214 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:18.002720  9119 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.009647  8990 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:18.011037  8287 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:18.015326  9110 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.016722  9067 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.018307  8214 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:18.024559  8898 raft_consensus.cc:2955] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:18.032621  9110 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:18.034641  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 864d288163824eac975181159a2708d9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:18.046118  8286 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:18.043143  8898 raft_consensus.cc:2955] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:18.051017  8115 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.062583  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:18.070751  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 864d288163824eac975181159a2708d9 with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:18.081595  8115 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.082810  9130 tablet_replica.cc:333] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:18.083712  9130 raft_consensus.cc:2243] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.084299  9130 raft_consensus.cc:2272] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.088357  9130 ts_tablet_manager.cc:1916] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:18.094246  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:18.095270  9126 tablet_replica.cc:333] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:18.096194  9126 raft_consensus.cc:2243] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.096935  9126 raft_consensus.cc:2272] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.104935  9126 ts_tablet_manager.cc:1916] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:18.111927  9130 ts_tablet_manager.cc:1929] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:18.112344  9130 log.cc:1199] T 864d288163824eac975181159a2708d9 P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/864d288163824eac975181159a2708d9
I20260709 13:01:18.114115  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 864d288163824eac975181159a2708d9 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:18.121420  9126 ts_tablet_manager.cc:1929] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:18.121901  9126 log.cc:1199] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/1fb0cdb40f8b48a7a5b79a8bfe7c8fb6
I20260709 13:01:18.123528  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:19.169237  8363 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.175478  8287 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:19.176034  8332 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aee8a45d39bb4537bebf44a3d479ebd4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.175496  8213 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.177033  9067 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.178911  9067 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.195228  9067 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.197314  8213 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.198243  8286 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.218135  8112 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.219012  8213 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.233587  8363 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.236652  9087 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:19.244954  8183 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52604c43ccee4ddca5408d7cc08e134a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.246013  8287 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.247426  9136 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.256934  9088 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.260602  8284 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.266053  8365 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.273180  8363 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.281140  8116 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
W20260709 13:01:19.281877  8332 consensus_peers.cc:597] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3161be69a5b64eea9d078c61741b3db0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.289634  8213 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.292301  9072 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.293432  8284 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.298741  9110 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:19.313000  9072 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.314564  8214 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.316078  8287 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.332507  8363 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.335309  8115 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.341045  8287 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.342448  8214 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:19.345364  8332 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f17336652094c69a7e70a69b68a335d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.346239  9131 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.349368  9131 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.375844  9067 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.377441  8213 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.380007  8287 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:19.396569  8116 catalog_manager.cc:5697] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.670217  9152 ts_tablet_manager.cc:933] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:19.672111  9152 tablet_copy_client.cc:323] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:19.673851  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet 52604c43ccee4ddca5408d7cc08e134a from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:19.674463  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet 52604c43ccee4ddca5408d7cc08e134a from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-52604c43ccee4ddca5408d7cc08e134a
I20260709 13:01:19.681105  8228 tablet_copy_source_session.cc:215] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.684533  9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52604c43ccee4ddca5408d7cc08e134a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:19.702914  9152 tablet_copy_client.cc:806] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:19.706511  9152 tablet_copy_client.cc:670] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:19.711825  9152 tablet_copy_client.cc:538] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:19.721835  9152 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:19.745105  9152 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:19.746222  9152 tablet_bootstrap.cc:492] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:19.747042  9152 ts_tablet_manager.cc:1403] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:01:19.750170  9152 raft_consensus.cc:359] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.751040  9152 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:19.751717  9152 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.756024  9152 ts_tablet_manager.cc:1434] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:01:19.760584  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-52604c43ccee4ddca5408d7cc08e134a received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:19.761049  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-52604c43ccee4ddca5408d7cc08e134a on tablet 52604c43ccee4ddca5408d7cc08e134a with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:19.768807  9152 ts_tablet_manager.cc:933] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:19.774492  9152 tablet_copy_client.cc:323] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:19.776700  8377 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet aee8a45d39bb4537bebf44a3d479ebd4 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:19.777238  8377 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet aee8a45d39bb4537bebf44a3d479ebd4 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-aee8a45d39bb4537bebf44a3d479ebd4
I20260709 13:01:19.783834  9157 ts_tablet_manager.cc:933] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:19.785630  9157 tablet_copy_client.cc:323] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:19.786580  8377 tablet_copy_source_session.cc:215] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.787031  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 3161be69a5b64eea9d078c61741b3db0 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:19.787475  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 3161be69a5b64eea9d078c61741b3db0 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-3161be69a5b64eea9d078c61741b3db0
I20260709 13:01:19.789953  9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee8a45d39bb4537bebf44a3d479ebd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:19.794488  8376 tablet_copy_source_session.cc:215] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.803169  9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3161be69a5b64eea9d078c61741b3db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:19.808140  9152 tablet_copy_client.cc:806] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:19.808836  9152 tablet_copy_client.cc:670] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:19.815044  9152 tablet_copy_client.cc:538] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:19.820226  9157 tablet_copy_client.cc:806] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:19.820813  9157 tablet_copy_client.cc:670] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:19.828392  9152 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:19.841470  9157 tablet_copy_client.cc:538] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:19.855391  9157 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:19.858613  9152 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:19.860031  9152 tablet_bootstrap.cc:492] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:19.860806  9152 ts_tablet_manager.cc:1403] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.011s
I20260709 13:01:19.863768  9152 raft_consensus.cc:359] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.864630  9152 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:19.865310  9152 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.868911  9159 ts_tablet_manager.cc:933] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:19.870287  9152 ts_tablet_manager.cc:1434] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:19.874778  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-aee8a45d39bb4537bebf44a3d479ebd4 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:19.875206  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-aee8a45d39bb4537bebf44a3d479ebd4 on tablet aee8a45d39bb4537bebf44a3d479ebd4 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:19.881160  9159 tablet_copy_client.cc:323] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:19.882578  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 9f17336652094c69a7e70a69b68a335d from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:19.883008  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 9f17336652094c69a7e70a69b68a335d from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-9f17336652094c69a7e70a69b68a335d
I20260709 13:01:19.888631  8376 tablet_copy_source_session.cc:215] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.897611  9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f17336652094c69a7e70a69b68a335d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:19.922097  9157 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:19.923081  9157 tablet_bootstrap.cc:492] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:19.924372  9157 ts_tablet_manager.cc:1403] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.017s
I20260709 13:01:19.927274  9157 raft_consensus.cc:359] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.928081  9157 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:19.928711  9157 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.931396  9157 ts_tablet_manager.cc:1434] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:01:19.933040  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-3161be69a5b64eea9d078c61741b3db0 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:19.933451  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-3161be69a5b64eea9d078c61741b3db0 on tablet 3161be69a5b64eea9d078c61741b3db0 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:19.935552  9159 tablet_copy_client.cc:806] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:19.936123  9159 tablet_copy_client.cc:670] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:19.940418  9159 tablet_copy_client.cc:538] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:19.950829  9159 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:19.971571  9159 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:19.972496  9159 tablet_bootstrap.cc:492] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:19.973155  9159 ts_tablet_manager.cc:1403] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:01:19.977969  9159 raft_consensus.cc:359] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.978713  9159 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:19.979333  9159 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:19.981709  9159 ts_tablet_manager.cc:1434] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.006s
I20260709 13:01:19.983846  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-9f17336652094c69a7e70a69b68a335d received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:19.984256  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-9f17336652094c69a7e70a69b68a335d on tablet 9f17336652094c69a7e70a69b68a335d with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:20.159597  8897 raft_consensus.cc:1217] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.232932  8897 raft_consensus.cc:1217] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.247025  8897 raft_consensus.cc:1217] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.376848  8897 raft_consensus.cc:1217] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.654290  9110 raft_consensus.cc:1064] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:20.657500  9110 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:20.663983  8898 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.666944  9131 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:20.667500  9088 raft_consensus.cc:1064] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:20.672633  8284 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.675057  9072 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.682478  9088 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:20.686197  9131 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.688861  8284 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.697408  8897 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.718596  8213 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.721873  8115 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.733343  8365 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.734014  8897 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.734911  9131 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.739076  9139 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:20.743011  8284 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.745401  9139 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:20.749356  9172 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:20.755330  8214 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.795493  9162 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.798252  8365 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.802524  8897 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.817907  8284 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.824018  8112 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.852936  9131 raft_consensus.cc:1064] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:20.855614  8213 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:20.860901  9131 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:20.862812  8898 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:20.865688  9162 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:20.870854  8287 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:20.873015  9139 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:20.874394  9088 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.882573  8898 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.888387  8284 raft_consensus.cc:2955] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.913125  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52604c43ccee4ddca5408d7cc08e134a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:20.916854  8114 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.923359  8213 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.926466  8898 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.927592  9067 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.928893  9131 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.936420  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 52604c43ccee4ddca5408d7cc08e134a with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:20.947036  8284 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.948873  9067 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.959841  9181 tablet_replica.cc:333] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:20.962530  9067 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.964780  9181 raft_consensus.cc:2243] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:20.966022  9181 raft_consensus.cc:2272] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:20.966794  8214 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.970672  9181 ts_tablet_manager.cc:1916] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:20.970602  8286 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.990407  8115 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:20.994747  9110 raft_consensus.cc:1064] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:20.997028  9110 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:20.999174  8898 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.018419  8364 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:21.027084  9181 ts_tablet_manager.cc:1929] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.027597  9181 log.cc:1199] T 52604c43ccee4ddca5408d7cc08e134a P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/52604c43ccee4ddca5408d7cc08e134a
I20260709 13:01:21.029345  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 52604c43ccee4ddca5408d7cc08e134a (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:21.040096  8286 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.041217  8896 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.044785  8213 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.048578  8897 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.052434  9184 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.052940  8286 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.054481  9110 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.055610  9067 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.071127  9131 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:21.079495  9072 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.086093  9184 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.087203  8284 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.091785  8898 raft_consensus.cc:2955] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.091853  9110 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.098047  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3161be69a5b64eea9d078c61741b3db0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.099691  8214 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.110235  8115 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.124523  8114 catalog_manager.cc:5697] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.118793  8898 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.138881  8291 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.146418  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 3161be69a5b64eea9d078c61741b3db0 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:21.164944  9189 tablet_replica.cc:333] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:21.167620  9189 raft_consensus.cc:2243] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.168381  9189 raft_consensus.cc:2272] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.173496  8364 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:21.174849  9189 ts_tablet_manager.cc:1916] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.177917  8365 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:21.180506  8898 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.183564  9072 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.185011  8214 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.188762  8897 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.191135  8214 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.191120  9067 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:21.191509  9110 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.198024  8897 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.199357  9189 ts_tablet_manager.cc:1929] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.199999  9189 log.cc:1199] T 3161be69a5b64eea9d078c61741b3db0 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/3161be69a5b64eea9d078c61741b3db0
I20260709 13:01:21.206110  9067 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.211434  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 3161be69a5b64eea9d078c61741b3db0 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:21.213945  9067 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.213277  9184 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.218722  8898 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.219313  8213 raft_consensus.cc:2955] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.220077  8214 raft_consensus.cc:2955] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.237792  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aee8a45d39bb4537bebf44a3d479ebd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.242023  8112 catalog_manager.cc:5697] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:21.248934  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f17336652094c69a7e70a69b68a335d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.252594  8116 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.254297  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f17336652094c69a7e70a69b68a335d with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:21.262563  9190 tablet_replica.cc:333] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:21.264632  9190 raft_consensus.cc:2243] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.265396  9190 raft_consensus.cc:2272] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.271087  9190 ts_tablet_manager.cc:1916] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.272056  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet aee8a45d39bb4537bebf44a3d479ebd4 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:21.287776  9190 ts_tablet_manager.cc:1929] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.288338  9190 log.cc:1199] T 9f17336652094c69a7e70a69b68a335d P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/9f17336652094c69a7e70a69b68a335d
I20260709 13:01:21.290165  9190 tablet_replica.cc:333] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:21.290680  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet 9f17336652094c69a7e70a69b68a335d (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:21.291239  9190 raft_consensus.cc:2243] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.291989  9190 raft_consensus.cc:2272] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.295444  9190 ts_tablet_manager.cc:1916] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.313205  9190 ts_tablet_manager.cc:1929] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.313503  9190 log.cc:1199] T aee8a45d39bb4537bebf44a3d479ebd4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/aee8a45d39bb4537bebf44a3d479ebd4
I20260709 13:01:21.314790  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet aee8a45d39bb4537bebf44a3d479ebd4 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:22.346935  8213 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
W20260709 13:01:22.356040  8183 consensus_peers.cc:597] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8e2862cbf8e4bfdb5395396ea06c348. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.356841  8365 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.358456  9088 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.361690  8284 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.365877  9139 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.370395  9191 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.373382  8365 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.388868  8365 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:22.390895  8284 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.398980  8112 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:22.417651  8332 consensus_peers.cc:597] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73508a52a1594a38badce805866b753e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.420078  8287 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.420471  8213 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.422040  9192 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:22.427587  9072 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.442379  9072 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.443666  8284 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.446141  8213 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.460515  8214 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:22.491207  8364 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.493059  8291 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.494333  9139 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:22.495496  8183 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e437f18bf26d472eba0aa8ed4b920b7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.500201  9191 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.485381  8115 catalog_manager.cc:5697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.512949  9088 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.515259  8364 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.517853  8291 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.529263  8284 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:22.535180  8112 catalog_manager.cc:5697] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.557366  8214 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.558715  8364 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.559455  9151 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:22.560699  8258 consensus_peers.cc:597] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3069684e0be469dba5b83137f0c4e62. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.561847  9151 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:22.570421  9198 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.572765  8214 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.572754  8364 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.603343  8116 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:22.879667  9218 ts_tablet_manager.cc:933] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:22.884899  9218 tablet_copy_client.cc:323] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:22.891680  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 73508a52a1594a38badce805866b753e from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:22.892292  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 73508a52a1594a38badce805866b753e from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-73508a52a1594a38badce805866b753e
I20260709 13:01:22.899420  8376 tablet_copy_source_session.cc:215] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:22.902253  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73508a52a1594a38badce805866b753e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:22.909024  9220 ts_tablet_manager.cc:933] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:22.922333  9218 tablet_copy_client.cc:806] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:22.922492  9220 tablet_copy_client.cc:323] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:22.923136  9218 tablet_copy_client.cc:670] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:22.924665  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet e437f18bf26d472eba0aa8ed4b920b7e from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:22.925199  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet e437f18bf26d472eba0aa8ed4b920b7e from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-e437f18bf26d472eba0aa8ed4b920b7e
I20260709 13:01:22.943912  9218 tablet_copy_client.cc:538] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:22.945619  8228 tablet_copy_source_session.cc:215] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:22.950006  9220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e437f18bf26d472eba0aa8ed4b920b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:22.957638  9218 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:22.968408  9220 tablet_copy_client.cc:806] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:22.968984  9220 tablet_copy_client.cc:670] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:22.974885  9220 tablet_copy_client.cc:538] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:22.987766  9220 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:23.004356  9218 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:23.005277  9218 tablet_bootstrap.cc:492] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:23.005963  9218 ts_tablet_manager.cc:1403] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.018s
I20260709 13:01:23.007335  9222 ts_tablet_manager.cc:933] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:23.012575  9222 tablet_copy_client.cc:323] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:23.014335  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet d8e2862cbf8e4bfdb5395396ea06c348 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:23.014878  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet d8e2862cbf8e4bfdb5395396ea06c348 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-d8e2862cbf8e4bfdb5395396ea06c348
I20260709 13:01:23.018477  9220 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:23.020063  9220 tablet_bootstrap.cc:492] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:23.020833  9220 ts_tablet_manager.cc:1403] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.007s
I20260709 13:01:23.021060  9218 raft_consensus.cc:359] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:23.021981  9218 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:23.022662  9218 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:23.024533  9220 raft_consensus.cc:359] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:23.025458  9220 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:23.026165  9220 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:23.036442  9220 ts_tablet_manager.cc:1434] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:01:23.038499  8228 tablet_copy_source_session.cc:215] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:23.038645  8227 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-e437f18bf26d472eba0aa8ed4b920b7e received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:23.039090  8227 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-e437f18bf26d472eba0aa8ed4b920b7e on tablet e437f18bf26d472eba0aa8ed4b920b7e with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:23.042047  9218 ts_tablet_manager.cc:1434] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.005s
I20260709 13:01:23.044181  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-73508a52a1594a38badce805866b753e received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:23.044600  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-73508a52a1594a38badce805866b753e on tablet 73508a52a1594a38badce805866b753e with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:23.058348  9222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e2862cbf8e4bfdb5395396ea06c348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:23.072566  9222 tablet_copy_client.cc:806] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:23.073338  9222 tablet_copy_client.cc:670] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:23.077234  9222 tablet_copy_client.cc:538] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:23.089890  9222 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:23.112071  9222 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:23.116186  9222 tablet_bootstrap.cc:492] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:23.116918  9222 ts_tablet_manager.cc:1403] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.000s
I20260709 13:01:23.119464  9222 raft_consensus.cc:359] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:23.120236  9222 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:23.120821  9222 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:23.121829  9218 ts_tablet_manager.cc:933] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:23.124621  9222 ts_tablet_manager.cc:1434] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:01:23.126183  9218 tablet_copy_client.cc:323] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:23.126381  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-d8e2862cbf8e4bfdb5395396ea06c348 received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:23.126899  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-d8e2862cbf8e4bfdb5395396ea06c348 on tablet d8e2862cbf8e4bfdb5395396ea06c348 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:23.128088  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet b3069684e0be469dba5b83137f0c4e62 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:23.128717  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet b3069684e0be469dba5b83137f0c4e62 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-b3069684e0be469dba5b83137f0c4e62
I20260709 13:01:23.138917  8303 tablet_copy_source_session.cc:215] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:23.142215  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3069684e0be469dba5b83137f0c4e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:23.157758  9218 tablet_copy_client.cc:806] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:23.158396  9218 tablet_copy_client.cc:670] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:23.169354  9218 tablet_copy_client.cc:538] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:23.179443  9218 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:23.207054  9218 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:23.208137  9218 tablet_bootstrap.cc:492] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:23.209487  9218 ts_tablet_manager.cc:1403] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.009s
I20260709 13:01:23.212568  9218 raft_consensus.cc:359] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:23.213455  9218 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:23.214231  9218 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:23.216811  9218 ts_tablet_manager.cc:1434] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:01:23.218426  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-b3069684e0be469dba5b83137f0c4e62 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:23.218842  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-b3069684e0be469dba5b83137f0c4e62 on tablet b3069684e0be469dba5b83137f0c4e62 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:23.272581  8897 raft_consensus.cc:1217] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:23.336937  8898 raft_consensus.cc:1217] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:23.515527  8898 raft_consensus.cc:1217] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:23.541222  8898 raft_consensus.cc:1217] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:23.711668  9206 raft_consensus.cc:1064] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:23.714365  9206 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:23.722560  8215 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:23.723016  8898 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:23.724179  9204 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:23.725344  9192 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:23.726564  8284 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:23.738267  9088 raft_consensus.cc:1064] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:23.741109  9088 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:23.774732  9204 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:23.813771  8364 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:23.815893  9211 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:23.823763  9206 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:23.825750  8284 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:23.827778  8209 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:23.835340  9212 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:01:23.851845  8898 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:23.850481  8284 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:23.855764  8116 catalog_manager.cc:5697] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:23.863773  9237 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:01:23.893322  8897 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:23.913930  9088 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:23.926645  8897 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:23.928426  8364 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:23.973274  9246 raft_consensus.cc:1064] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:23.984735  9216 raft_consensus.cc:1064] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:23.990016  9216 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:24.003294  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 52706.7us
I20260709 13:01:24.010291  8287 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.026034  9246 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:24.042920  8898 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:24.044452  8363 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:24.046566  9198 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:24.047643  9251 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:24.052480  8209 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:24.055637  9198 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:24.056380  8897 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:24.061026  9212 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:24.127652  8287 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:24.140695  8114 catalog_manager.cc:5697] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.176242  8365 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:24.202826  9249 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:24.191825  9216 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.390892  8217 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:24.396467  8214 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.397841  8365 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.430236  8364 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:01:24.435716  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 147041us
I20260709 13:01:24.446395  8897 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:24.448204  9247 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:24.453668  8291 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:24.456488  8897 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:24.459061  9247 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:24.463829  8284 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:24.464742  9246 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.496367  8898 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.505460  9248 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.508752  9268 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:24.514524  8114 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:24.519152  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 49453.1us
I20260709 13:01:24.520323  8115 catalog_manager.cc:5697] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.524127  8897 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:24.530736  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 61333.2us
I20260709 13:01:24.587879  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet e437f18bf26d472eba0aa8ed4b920b7e with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:24.596743  9264 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:24.604163  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e437f18bf26d472eba0aa8ed4b920b7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:24.605906  8284 raft_consensus.cc:2955] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.587265  8287 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.601743  8897 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.616372  8112 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.627863  8365 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.678442  9275 tablet_replica.cc:333] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:24.681322  8217 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:24.681751  8286 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:24.688855  8293 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:24.695760  9248 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:24.697404  9275 raft_consensus.cc:2243] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.705509  8896 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:24.707520  8897 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:24.708501  9261 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:01:24.713443  9249 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.719444  9246 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:24.722638  8291 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.729293  9260 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.731020  9275 raft_consensus.cc:2272] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.731493  9264 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:24.735392  9275 ts_tablet_manager.cc:1916] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:24.740200  8896 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.740257  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8e2862cbf8e4bfdb5395396ea06c348 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:24.747866  8367 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:24.751874  9261 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:24.763319  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3069684e0be469dba5b83137f0c4e62 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:24.765260  8116 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.771586  8115 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.775431  8897 raft_consensus.cc:2955] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.787312  8367 raft_consensus.cc:2955] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.789352  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet b3069684e0be469dba5b83137f0c4e62 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:24.793079  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet d8e2862cbf8e4bfdb5395396ea06c348 with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:24.802243  9275 ts_tablet_manager.cc:1929] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:24.802821  9275 log.cc:1199] T e437f18bf26d472eba0aa8ed4b920b7e P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/e437f18bf26d472eba0aa8ed4b920b7e
I20260709 13:01:24.804697  9275 tablet_replica.cc:333] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:24.805658  9275 raft_consensus.cc:2243] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.806408  9275 raft_consensus.cc:2272] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.816092  9275 ts_tablet_manager.cc:1916] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:24.815743  9269 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.818601  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet e437f18bf26d472eba0aa8ed4b920b7e (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:24.826177  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73508a52a1594a38badce805866b753e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:24.834717  8293 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.841450  8114 catalog_manager.cc:5697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.848750  9276 tablet_replica.cc:333] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:24.850422  9276 raft_consensus.cc:2243] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.851251  9276 raft_consensus.cc:2272] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.858505  8896 raft_consensus.cc:2955] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:24.858026  9276 ts_tablet_manager.cc:1916] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:24.882555  9275 ts_tablet_manager.cc:1929] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:24.883208  9275 log.cc:1199] T d8e2862cbf8e4bfdb5395396ea06c348 P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/d8e2862cbf8e4bfdb5395396ea06c348
I20260709 13:01:24.883678  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 73508a52a1594a38badce805866b753e with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:24.885416  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet d8e2862cbf8e4bfdb5395396ea06c348 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:24.889928  9276 ts_tablet_manager.cc:1929] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:24.892571  9276 log.cc:1199] T b3069684e0be469dba5b83137f0c4e62 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/b3069684e0be469dba5b83137f0c4e62
I20260709 13:01:24.894790  9276 tablet_replica.cc:333] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:24.894785  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet b3069684e0be469dba5b83137f0c4e62 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:24.896129  9276 raft_consensus.cc:2243] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.897009  9276 raft_consensus.cc:2272] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.899863  9276 ts_tablet_manager.cc:1916] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:24.917887  9276 ts_tablet_manager.cc:1929] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:24.918768  9276 log.cc:1199] T 73508a52a1594a38badce805866b753e P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/73508a52a1594a38badce805866b753e
I20260709 13:01:24.920655  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 73508a52a1594a38badce805866b753e (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:25.957070  8365 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:25.963551  8217 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:25.963613  8284 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:25.964607  8332 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7effd0faf2d846cea5b8e82ac737b7e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:25.965212  9264 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.966140  9269 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.973089  9265 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:25.974946  8284 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:25.975917  8217 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:25.990833  8114 catalog_manager.cc:5697] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.007328  8365 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.022939  8214 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:26.023239  8332 consensus_peers.cc:597] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 931eba945dfb4e34aae782648072e6ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.024307  8284 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:26.025039  9265 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.028937  9264 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.044121  9264 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.049768  8213 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.053355  8286 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.067047  8115 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.067756  8213 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.078944  8365 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:26.079988  8183 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0356bb50f97540f48a0cb08e1407eb57. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.081233  9268 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.086472  8286 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:26.088346  9249 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.094831  9246 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.097215  8365 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.098641  8286 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.108572  8213 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.113883  8116 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.119158  8365 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:26.119664  8183 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84f1d898d0e9492bbd25195dba3e62d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.120101  8286 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:26.120774  9246 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.122987  9268 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.136684  9246 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.140277  8365 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.146938  8286 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.165586  8115 catalog_manager.cc:5697] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:26.417480  9294 ts_tablet_manager.cc:933] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:26.419610  9294 tablet_copy_client.cc:323] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:26.422235  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 931eba945dfb4e34aae782648072e6ea from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:26.422924  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 931eba945dfb4e34aae782648072e6ea from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-931eba945dfb4e34aae782648072e6ea
I20260709 13:01:26.430477  8376 tablet_copy_source_session.cc:215] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:26.433854  9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931eba945dfb4e34aae782648072e6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:26.451457  9294 tablet_copy_client.cc:806] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:26.452081  9294 tablet_copy_client.cc:670] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:26.455976  9294 tablet_copy_client.cc:538] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:26.469070  9294 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:26.476215  9297 ts_tablet_manager.cc:933] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:26.491658  9297 tablet_copy_client.cc:323] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:26.494962  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet 0356bb50f97540f48a0cb08e1407eb57 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:26.495522  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet 0356bb50f97540f48a0cb08e1407eb57 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-0356bb50f97540f48a0cb08e1407eb57
I20260709 13:01:26.503741  9294 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:26.505983  9294 tablet_bootstrap.cc:492] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:26.506817  9294 ts_tablet_manager.cc:1403] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.012s
I20260709 13:01:26.510113  9294 raft_consensus.cc:359] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.511049  9294 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:26.511276  8228 tablet_copy_source_session.cc:215] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:26.512719  9294 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.514909  9297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0356bb50f97540f48a0cb08e1407eb57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:26.547785  9294 ts_tablet_manager.cc:1434] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.041s	user 0.017s	sys 0.015s
I20260709 13:01:26.550309  9297 tablet_copy_client.cc:806] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:26.550961  9297 tablet_copy_client.cc:670] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:26.553225  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-931eba945dfb4e34aae782648072e6ea received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:26.553746  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-931eba945dfb4e34aae782648072e6ea on tablet 931eba945dfb4e34aae782648072e6ea with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:26.557679  9297 tablet_copy_client.cc:538] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:01:26.559742  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 74514.4us
I20260709 13:01:26.572839  9297 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:26.573087  9294 ts_tablet_manager.cc:933] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:26.586939  9294 tablet_copy_client.cc:323] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:26.588685  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 7effd0faf2d846cea5b8e82ac737b7e5 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:26.589247  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 7effd0faf2d846cea5b8e82ac737b7e5 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-7effd0faf2d846cea5b8e82ac737b7e5
I20260709 13:01:26.597555  8376 tablet_copy_source_session.cc:215] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:26.600440  9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7effd0faf2d846cea5b8e82ac737b7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:26.602691  9297 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:26.603657  9297 tablet_bootstrap.cc:492] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:26.604341  9297 ts_tablet_manager.cc:1403] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.008s
I20260709 13:01:26.607328  9297 raft_consensus.cc:359] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.608639  9297 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:26.609831  9297 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.612346  9297 ts_tablet_manager.cc:1434] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:01:26.614044  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-0356bb50f97540f48a0cb08e1407eb57 received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:26.614585  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-0356bb50f97540f48a0cb08e1407eb57 on tablet 0356bb50f97540f48a0cb08e1407eb57 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:26.618330  9294 tablet_copy_client.cc:806] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:26.618960  9294 tablet_copy_client.cc:670] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:26.622462  9294 tablet_copy_client.cc:538] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:26.631064  9294 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:26.650995  9294 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:26.651731  9294 tablet_bootstrap.cc:492] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:26.652308  9294 ts_tablet_manager.cc:1403] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:01:26.655224  9294 raft_consensus.cc:359] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.655821  9294 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:26.656417  9294 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.658564  9294 ts_tablet_manager.cc:1434] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:01:26.662562  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-7effd0faf2d846cea5b8e82ac737b7e5 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:26.662925  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-7effd0faf2d846cea5b8e82ac737b7e5 on tablet 7effd0faf2d846cea5b8e82ac737b7e5 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:26.680897  9294 ts_tablet_manager.cc:933] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:26.694559  9294 tablet_copy_client.cc:323] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:26.696832  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet 84f1d898d0e9492bbd25195dba3e62d4 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:26.697417  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet 84f1d898d0e9492bbd25195dba3e62d4 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-84f1d898d0e9492bbd25195dba3e62d4
I20260709 13:01:26.707649  8228 tablet_copy_source_session.cc:215] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:26.711042  9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f1d898d0e9492bbd25195dba3e62d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:26.729331  9294 tablet_copy_client.cc:806] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:26.730051  9294 tablet_copy_client.cc:670] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:26.733305  9294 tablet_copy_client.cc:538] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:26.741080  9294 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:26.756563  9294 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:26.757197  9294 tablet_bootstrap.cc:492] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:26.757678  9294 ts_tablet_manager.cc:1403] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:01:26.759985  9294 raft_consensus.cc:359] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.760722  9294 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:26.761296  9294 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:26.763413  9294 ts_tablet_manager.cc:1434] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:01:26.765270  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-84f1d898d0e9492bbd25195dba3e62d4 received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:26.765659  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-84f1d898d0e9492bbd25195dba3e62d4 on tablet 84f1d898d0e9492bbd25195dba3e62d4 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:26.923081  8898 raft_consensus.cc:1217] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:27.041268  8896 raft_consensus.cc:1217] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:27.162331  8896 raft_consensus.cc:1217] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:27.279860  8896 raft_consensus.cc:1217] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:27.318938  9264 raft_consensus.cc:1064] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:27.321640  9264 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:27.328958  8214 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.329910  8291 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.328974  8896 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.331014  9310 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:27.332433  9302 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:27.333482  9269 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:27.359695  9310 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.362346  8284 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.379987  8896 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.389698  8114 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.403340  8217 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.426128  8367 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:27.430477  9268 raft_consensus.cc:1064] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:27.432852  9268 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:27.445755  8896 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.446681  8291 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.449146  9310 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:27.453804  9269 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.464735  9264 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.476867  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 931eba945dfb4e34aae782648072e6ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:27.478418  8898 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.481854  8284 raft_consensus.cc:2955] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:27.489225  8103 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 931eba945dfb4e34aae782648072e6ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:01:27.499596  8115 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.515532  8367 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.516757  8896 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.517062  8286 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.519284  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 931eba945dfb4e34aae782648072e6ea with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:27.518626  9308 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:27.522166  9322 tablet_replica.cc:333] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:27.523161  9322 raft_consensus.cc:2243] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.524739  9322 raft_consensus.cc:2272] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.528947  9268 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:27.532080  9322 ts_tablet_manager.cc:1916] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:27.556661  9321 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:27.571439  9322 ts_tablet_manager.cc:1929] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:27.572013  9322 log.cc:1199] T 931eba945dfb4e34aae782648072e6ea P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/931eba945dfb4e34aae782648072e6ea
I20260709 13:01:27.574014  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 931eba945dfb4e34aae782648072e6ea (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:27.587539  9302 raft_consensus.cc:1064] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:27.590335  9302 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:27.590552  9323 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.600845  8286 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.603066  8367 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.607990  8898 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.615749  8115 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.636319  8898 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.637953  8217 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.638343  9302 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:27.639791  9264 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:27.637596  8284 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.653107  8214 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:27.665833  9302 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:27.669636  9246 raft_consensus.cc:1064] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:27.673713  8896 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.676329  8291 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.675261  9246 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:27.676499  9268 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:27.682961  9323 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:27.693075  9268 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.697386  9264 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.697948  8286 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.701412  8217 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.703581  8898 raft_consensus.cc:2955] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.709946  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0356bb50f97540f48a0cb08e1407eb57 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:27.726684  8898 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.726322  8115 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.728180  9321 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:27.731030  8365 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.730026  8286 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.732726  9321 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:27.740864  8291 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.744247  9321 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:27.748594  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 0356bb50f97540f48a0cb08e1407eb57 with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:27.766702  8115 catalog_manager.cc:5697] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.781289  9334 tablet_replica.cc:333] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:27.782857  9334 raft_consensus.cc:2243] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.792285  8896 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.801676  9334 raft_consensus.cc:2272] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.811477  8365 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:27.823000  9323 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.824507  9334 ts_tablet_manager.cc:1916] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:27.827344  8291 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.833729  8898 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.838019  8367 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.851893  8116 catalog_manager.cc:5697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.867650  8217 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.868731  8898 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.869513  9302 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:27.873342  9302 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.879524  9269 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.883198  8217 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:27.884284  8213 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.894948  8897 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.895198  8367 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.896510  9246 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.899354  9246 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:01:27.908561  9323 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.913733  9334 ts_tablet_manager.cc:1929] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:27.917202  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7effd0faf2d846cea5b8e82ac737b7e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:27.922995  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 84f1d898d0e9492bbd25195dba3e62d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:27.926587  9334 log.cc:1199] T 0356bb50f97540f48a0cb08e1407eb57 P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/0356bb50f97540f48a0cb08e1407eb57
I20260709 13:01:27.926875  8115 catalog_manager.cc:5697] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.929314  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 0356bb50f97540f48a0cb08e1407eb57 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:27.922848  8365 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.932446  8898 raft_consensus.cc:2955] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.942380  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet 7effd0faf2d846cea5b8e82ac737b7e5 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:27.953006  8896 raft_consensus.cc:2955] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:27.969722  8115 catalog_manager.cc:5697] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:28.025375  9336 tablet_replica.cc:333] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:28.050719  9336 raft_consensus.cc:2243] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.051482  9336 raft_consensus.cc:2272] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.056641  9336 ts_tablet_manager.cc:1916] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:28.069551  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f1d898d0e9492bbd25195dba3e62d4 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:28.082681  9336 ts_tablet_manager.cc:1929] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:28.083287  9336 log.cc:1199] T 7effd0faf2d846cea5b8e82ac737b7e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/7effd0faf2d846cea5b8e82ac737b7e5
I20260709 13:01:28.085314  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet 7effd0faf2d846cea5b8e82ac737b7e5 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:28.088218  9336 tablet_replica.cc:333] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:28.089459  9336 raft_consensus.cc:2243] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.090837  9336 raft_consensus.cc:2272] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.095054  9336 ts_tablet_manager.cc:1916] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:28.111474  9336 ts_tablet_manager.cc:1929] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:28.111975  9336 log.cc:1199] T 84f1d898d0e9492bbd25195dba3e62d4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/84f1d898d0e9492bbd25195dba3e62d4
I20260709 13:01:28.113988  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet 84f1d898d0e9492bbd25195dba3e62d4 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:28.269940  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:28.325606  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:28.326260  8213 raft_consensus.cc:606] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:28.328536  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:28.329020  8213 raft_consensus.cc:606] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:28.331487  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:28.331979  8213 raft_consensus.cc:606] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:28.343966  8367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8c00c17016841839312c823fcffaf82"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:28.344460  8367 raft_consensus.cc:606] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:28.347719  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d19654c841264233b661225cdb0ef14b"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:28.348299  8213 raft_consensus.cc:606] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:28.350844  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe403af31f9840f3b20788181ba23576"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:28.351392  8213 raft_consensus.cc:606] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:28.352599  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:28.354185  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:28.376006  9321 raft_consensus.cc:993] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:28.376848  9321 raft_consensus.cc:1081] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:28.378456  8291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe403af31f9840f3b20788181ba23576"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:28.378937  8291 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.379228  8291 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.384111  8291 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.386631  8291 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:28.387116  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:28.387501  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:28.388161  8213 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.388240  8367 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.388522  8213 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:28.389215  8213 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.390100  8213 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.392908  8367 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:28.394124  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:28.394590  8213 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:28.394747  9338 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.395243  9338 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:28.396421  9338 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.406810  8112 catalog_manager.cc:5697] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.469715  9246 raft_consensus.cc:993] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:28.470458  9246 raft_consensus.cc:1081] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:28.472391  8293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:28.472890  8293 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.473223  8293 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.478215  8293 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.479671  8293 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:28.480571  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:28.480580  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:28.481181  8213 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.481520  8365 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.481556  8213 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:28.483038  8213 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.484313  8213 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.488806  8365 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:28.489972  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:28.491600  9263 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.492129  9263 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:28.493000  8213 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:28.493019  9263 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.502892  8112 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.509531  9323 raft_consensus.cc:993] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:28.510030  9323 raft_consensus.cc:1081] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:28.512988  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:01:28.513517  8898 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.513850  8898 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.519187  8898 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:28.520885  8898 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:28.521693  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:28.521974  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:28.522305  8217 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.522490  8293 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.522917  8217 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:28.523660  8217 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:28.524814  8217 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.528092  8293 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:28.529449  8863 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:28.530869  9337 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.533207  8217 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:28.535065  9337 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:28.536170  9337 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:28.544404  8112 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.616909  9302 raft_consensus.cc:993] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:28.617403  9302 raft_consensus.cc:1081] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:28.618956  8293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8c00c17016841839312c823fcffaf82"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60542
I20260709 13:01:28.619565  8293 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.620018  8293 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.628055  8293 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.631273  8293 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:28.632537  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:28.633082  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:28.633607  8365 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.633754  8217 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.634104  8365 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:28.634940  8365 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.636099  8365 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.639387  8217 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:28.640667  8257 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:28.641156  8365 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:28.641353  9338 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.641831  9338 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:28.642701  9338 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.652509  8112 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.788329  9321 raft_consensus.cc:993] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:28.788839  9268 raft_consensus.cc:1081] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:28.790051  8293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d19654c841264233b661225cdb0ef14b"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:28.790581  8293 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.790922  8293 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.795904  8293 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.797535  8293 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:28.798278  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:28.798483  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:28.798897  8217 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.799029  8365 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.799260  8217 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:28.800222  8217 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.801608  8217 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.805470  8365 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:28.806540  8259 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:28.807202  9338 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.807587  9338 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:28.808514  8217 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:28.808462  9338 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:28.817306  8112 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.893951  9321 raft_consensus.cc:993] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:28.894485  9268 raft_consensus.cc:1081] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:28.895910  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:01:28.896342  8898 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.896582  8898 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.902099  8898 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:28.904320  8898 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:28.905122  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:28.905682  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:28.905745  8217 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.906244  8217 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:28.906347  8365 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.906972  8217 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:28.908094  8217 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.912889  8365 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:28.913972  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:28.914063  8217 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:28.914728  9337 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.915200  9337 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:28.915972  9337 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:28.925424  8112 catalog_manager.cc:5697] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.926246  8217 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:28.927565  9337 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:28.940008  8293 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:28.941507  9337 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:28.977286  8365 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:28.978534  9338 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.983004  8367 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:28.984215  9338 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.992516  8217 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:28.995083  9348 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.018260  8214 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.020622  9348 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.088461  8214 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.091264  9338 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.108002  8367 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.111665  9359 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:29.155118  8293 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:29.160863  8214 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:01:29.161263  8258 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a41c46760f54470bb49d3fd515fb4414. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.162200  8367 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:29.162468  9263 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:29.163647  9348 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:29.169174  9348 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.172909  8367 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.173117  8214 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.192374  8116 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.194936  8293 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:29.208292  8367 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:29.210165  9367 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.213811  8217 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:29.217518  8258 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37fc7732f1124e04b9a47402ad544464. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.219712  9367 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.233595  9348 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.240598  8367 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.241943  8214 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.251917  8215 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:29.255472  8115 catalog_manager.cc:5697] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.272503  8214 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.274026  9368 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:29.280428  8367 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:29.281002  8183 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44115d987e9746a3b4f158acec40ce8f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.283658  9373 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.286931  8284 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:29.293838  9321 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.301631  9373 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.308012  8362 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:29.309149  8365 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.310793  9344 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:29.315236  8284 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.324262  8367 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.327059  8214 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:29.327304  9338 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:29.328722  9352 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:29.341988  8365 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:29.355721  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:29.353258  8112 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:29.382297  8332 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0545ed3bf21c4b3489c11d21d7796f22. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.384388  8215 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:29.385651  8284 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:29.389890  9346 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:29.392158  9346 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.456935  9269 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.458832  8213 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.466989  8293 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.494169  8115 catalog_manager.cc:5697] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:29.515376  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:29.561676  8365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:29.563650  8365 raft_consensus.cc:606] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:29.567021  8365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:29.567551  8365 raft_consensus.cc:606] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:29.570837  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:29.571404  8215 raft_consensus.cc:606] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:29.587762  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d19654c841264233b661225cdb0ef14b"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:29.588346  8293 raft_consensus.cc:606] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:29.591181  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:29.591732  8215 raft_consensus.cc:606] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:29.592690  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:29.594364  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:29.663515  9387 ts_tablet_manager.cc:933] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:29.666144  9387 tablet_copy_client.cc:323] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:29.668779  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet 37fc7732f1124e04b9a47402ad544464 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:29.669888  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet 37fc7732f1124e04b9a47402ad544464 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-37fc7732f1124e04b9a47402ad544464
I20260709 13:01:29.678947  8303 tablet_copy_source_session.cc:215] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:29.682192  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fc7732f1124e04b9a47402ad544464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:29.693958  9387 tablet_copy_client.cc:806] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:29.694605  9387 tablet_copy_client.cc:670] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:29.702198  9387 tablet_copy_client.cc:538] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:29.712482  9387 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:29.743974  9387 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.744964  9387 tablet_bootstrap.cc:492] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:29.745668  9387 ts_tablet_manager.cc:1403] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.008s
I20260709 13:01:29.748215  9390 ts_tablet_manager.cc:933] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:29.749692  9387 raft_consensus.cc:359] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:29.750608  9387 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:29.754633  9387 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:29.756829  9390 tablet_copy_client.cc:323] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:29.758888  9387 ts_tablet_manager.cc:1434] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:01:29.760313  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet 44115d987e9746a3b4f158acec40ce8f from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:29.760856  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet 44115d987e9746a3b4f158acec40ce8f from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-44115d987e9746a3b4f158acec40ce8f
I20260709 13:01:29.762638  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-37fc7732f1124e04b9a47402ad544464 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:29.763095  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-37fc7732f1124e04b9a47402ad544464 on tablet 37fc7732f1124e04b9a47402ad544464 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:29.767949  9387 ts_tablet_manager.cc:933] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:29.770319  8228 tablet_copy_source_session.cc:215] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:29.774921  9390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44115d987e9746a3b4f158acec40ce8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:29.784242  9387 tablet_copy_client.cc:323] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:29.786878  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet a41c46760f54470bb49d3fd515fb4414 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:29.787627  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet a41c46760f54470bb49d3fd515fb4414 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-a41c46760f54470bb49d3fd515fb4414
I20260709 13:01:29.797536  9302 raft_consensus.cc:993] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:29.798590  9302 raft_consensus.cc:1081] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:29.800557  8897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:01:29.801142  8897 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:29.801476  8897 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.802376  8303 tablet_copy_source_session.cc:215] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:29.811057  8897 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:29.815407  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c46760f54470bb49d3fd515fb4414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:29.815779  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:29.816262  9390 tablet_copy_client.cc:806] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:29.816355  8293 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.816869  9390 tablet_copy_client.cc:670] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:29.831472  8293 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:29.832885  9368 raft_consensus.cc:993] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:29.834049  9368 raft_consensus.cc:1081] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:29.835435  8863 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:29.837531  9352 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:29.838034  9352 raft_consensus.cc:697] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:29.838907  9352 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:29.840407  8897 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:29.834532  9391 ts_tablet_manager.cc:933] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:29.842406  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d19654c841264233b661225cdb0ef14b"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:29.842969  8215 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:29.843304  8215 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.858446  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:29.859107  8367 raft_consensus.cc:3055] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:29.859400  8367 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:29.860085  8367 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:29.855746  9321 raft_consensus.cc:993] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:29.861337  8367 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.861589  9321 raft_consensus.cc:1081] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:29.863262  8896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:01:29.863859  8896 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:29.864181  8896 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.871307  9391 tablet_copy_client.cc:323] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:29.872867  8896 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:29.875797  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 0545ed3bf21c4b3489c11d21d7796f22 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:29.875939  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:29.876367  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 0545ed3bf21c4b3489c11d21d7796f22 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-0545ed3bf21c4b3489c11d21d7796f22
I20260709 13:01:29.879814  8217 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:29.880185  8217 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:29.880964  8217 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:29.882503  8217 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.883155  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:29.883765  8293 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.884101  8376 tablet_copy_source_session.cc:215] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:29.884492  8896 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:29.903589  8217 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:29.905347  9391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0545ed3bf21c4b3489c11d21d7796f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:29.910723  9390 tablet_copy_client.cc:538] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:29.923482  9372 raft_consensus.cc:993] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:29.931326  9372 raft_consensus.cc:1081] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:29.925127  9387 tablet_copy_client.cc:806] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:29.928439  8367 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:29.932399  9387 tablet_copy_client.cc:670] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:29.933830  8286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:29.934351  8286 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:29.934643  8286 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.935927  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:29.936740  9352 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:29.937206  9352 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:29.938007  9352 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:29.948539  8115 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.950873  8286 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:29.955984  8293 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:29.849869  8215 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:29.980338  8286 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:29.981563  8215 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:29.968480  9269 raft_consensus.cc:993] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:29.982402  9269 raft_consensus.cc:1081] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:29.982684  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:29.983008  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:29.983256  8365 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.983530  8367 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.983793  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:29.984376  8213 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:29.984669  8213 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:29.985422  8213 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:29.986858  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:29.987418  8286 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:29.987607  8213 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.961393  9391 tablet_copy_client.cc:806] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:29.990753  8286 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:29.991641  8286 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:29.992720  8286 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.990967  9391 tablet_copy_client.cc:670] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:29.978699  9387 tablet_copy_client.cc:538] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:30.001351  9391 tablet_copy_client.cc:538] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:29.995620  8213 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:30.014544  8365 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:30.023313  8184 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:30.024233  9377 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:30.024698  9377 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:30.025516  9377 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:30.018024  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:30.028406  9263 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.028927  9263 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:30.029763  9263 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:30.040573  9390 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:30.042650  8112 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.020452  8367 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:30.054764  8286 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:30.061496  8895 raft_consensus.cc:1217] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:30.068514  9391 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:30.079516  9387 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
W20260709 13:01:30.080382  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 102488us
I20260709 13:01:30.082568  8896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:01:30.083086  8896 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.083365  8896 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.109014  8896 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:30.109217  8116 catalog_manager.cc:5697] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.119343  8896 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:30.121028  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:30.124728  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:30.126211  8286 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.124770  8367 raft_consensus.cc:3055] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.134426  8367 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:30.135285  8367 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:30.140722  8286 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:30.143939  8367 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.147014  8863 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:30.148329  9352 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.148974  9352 raft_consensus.cc:697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:30.149817  9352 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:30.171233  8367 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
W20260709 13:01:30.233050  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 86201us
I20260709 13:01:30.246546  9390 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:30.247617  9390 tablet_bootstrap.cc:492] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:30.256033  9391 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:30.257012  9391 tablet_bootstrap.cc:492] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:30.257776  9391 ts_tablet_manager.cc:1403] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.190s	user 0.018s	sys 0.006s
I20260709 13:01:30.258347  9390 ts_tablet_manager.cc:1403] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.220s	user 0.018s	sys 0.018s
I20260709 13:01:30.278607  9391 raft_consensus.cc:359] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:30.279498  9391 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:30.280078  9391 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:30.282812  9391 ts_tablet_manager.cc:1434] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:01:30.284660  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-0545ed3bf21c4b3489c11d21d7796f22 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:30.285084  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-0545ed3bf21c4b3489c11d21d7796f22 on tablet 0545ed3bf21c4b3489c11d21d7796f22 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:30.261590  9390 raft_consensus.cc:359] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:30.295378  9390 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:30.297016  9390 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:30.306504  9390 ts_tablet_manager.cc:1434] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 13:01:30.309548  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-44115d987e9746a3b4f158acec40ce8f received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:30.310091  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-44115d987e9746a3b4f158acec40ce8f on tablet 44115d987e9746a3b4f158acec40ce8f with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:30.309633  9387 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:30.312094  9387 tablet_bootstrap.cc:492] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:30.312777  9387 ts_tablet_manager.cc:1403] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.233s	user 0.036s	sys 0.040s
I20260709 13:01:30.315742  9387 raft_consensus.cc:359] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:30.316838  9387 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:30.317458  9387 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:30.319761  9387 ts_tablet_manager.cc:1434] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:30.321501  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-a41c46760f54470bb49d3fd515fb4414 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:30.321954  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-a41c46760f54470bb49d3fd515fb4414 on tablet a41c46760f54470bb49d3fd515fb4414 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:30.339960  8115 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.342427  8115 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.374166  8367 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:30.375360  9352 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:30.382819  8286 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:30.385628  9352 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:30.430094  8217 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:30.431448  9352 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:30.447791  8287 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:30.449486  9337 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:30.511647  8367 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:30.513504  9368 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:30.525321  8217 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:30.533638  9348 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:30.536736  9368 raft_consensus.cc:1064] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:30.539471  9368 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:30.543530  8286 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:30.547982  9377 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:30.582137  8363 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:30.584339  9367 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:30.586380  8895 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:30.590171  9348 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:30.582389  8367 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:30.595346  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:30.595911  8287 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:30.598218  9337 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:30.596385  9377 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:01:30.612378  8895 raft_consensus.cc:1217] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:30.639670  8213 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:30.654582  9367 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:30.673528  8896 raft_consensus.cc:1217] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:30.712936  8365 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:30.723073  9352 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:30.735831  9424 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.745927  8895 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.766542  8217 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.777251  8365 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.781260  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:30.784034  8113 catalog_manager.cc:5697] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.805326  8286 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:30.816773  8217 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:30.817272  8895 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:30.821242  9348 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:30.822305  9367 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:30.837522  8895 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.834266  9348 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.856535  8217 raft_consensus.cc:2955] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.882130  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37fc7732f1124e04b9a47402ad544464 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:30.882911  8113 catalog_manager.cc:5697] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:30.899145  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 37fc7732f1124e04b9a47402ad544464 with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:30.906953  8365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:30.907799  8365 raft_consensus.cc:606] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:30.911075  8365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:30.911615  8365 raft_consensus.cc:606] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:30.914903  8895 raft_consensus.cc:1217] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:30.918471  9429 tablet_replica.cc:333] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:30.919559  8286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:30.921708  9429 raft_consensus.cc:2243] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.922569  9429 raft_consensus.cc:2272] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.924913  8286 raft_consensus.cc:606] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:30.928139  9429 ts_tablet_manager.cc:1916] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:30.930310  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d19654c841264233b661225cdb0ef14b"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:30.931321  8217 raft_consensus.cc:606] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:30.935112  9346 raft_consensus.cc:993] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:30.935608  9404 raft_consensus.cc:1081] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:30.935779  8365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f92a5d6830044936958a95556af24660"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:30.936378  8365 raft_consensus.cc:606] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:30.937135  8895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:01:30.937711  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:30.937685  8895 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.938256  8895 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.939515  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:30.946532  9429 ts_tablet_manager.cc:1929] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:30.946156  8895 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:30.946977  9429 log.cc:1199] T 37fc7732f1124e04b9a47402ad544464 P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/37fc7732f1124e04b9a47402ad544464
I20260709 13:01:30.948493  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 37fc7732f1124e04b9a47402ad544464 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:30.949908  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:30.950222  8895 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:30.950476  8217 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.950816  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:30.951493  8365 raft_consensus.cc:3055] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.951781  8365 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:30.952572  8365 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:30.953792  8365 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.955559  8217 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:30.956574  8862 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:30.957208  9352 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.957597  9352 raft_consensus.cc:697] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:30.958343  9352 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:30.960373  8365 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:30.967047  8115 catalog_manager.cc:5697] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.977000  9377 raft_consensus.cc:993] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:30.977541  9402 raft_consensus.cc:1081] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:30.979173  8286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d19654c841264233b661225cdb0ef14b"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:30.979720  8286 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.980054  8286 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.986948  8286 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:30.988466  8286 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:30.990504  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:30.990574  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:30.991231  8217 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:30.991411  8365 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.991657  8217 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:30.992959  8217 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:30.994278  8217 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.998761  8365 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:30.999938  8259 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:31.000679  9348 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:31.001134  9348 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:31.002707  8217 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:31.007917  9348 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.022137  8115 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 4, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.042696  9384 raft_consensus.cc:993] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:31.043176  9384 raft_consensus.cc:1081] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:31.045879  8217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39256
I20260709 13:01:31.046558  8217 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:31.046954  8217 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.056378  8217 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.058924  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:31.059595  8293 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.139972  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:31.140633  8365 raft_consensus.cc:3055] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:31.140918  8365 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:31.141870  8365 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.143307  8365 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.132794  8217 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:31.168642  8293 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:31.169937  8365 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:31.178500  8184 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:31.179316  9402 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:31.179797  9402 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:31.180831  9402 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.212601  9321 raft_consensus.cc:1064] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:31.211496  8115 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.215236  9321 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:31.233201  8365 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:31.234680  9402 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:31.236379  8896 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:31.238217  9372 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:31.242544  8286 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:31.252770  9402 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:31.260819  9384 raft_consensus.cc:1064] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:31.263613  9384 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:31.286737  8293 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:31.289556  9346 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:31.303539  8215 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:31.305780  9401 raft_consensus.cc:993] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:31.306351  9401 raft_consensus.cc:1081] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:31.310263  8287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f92a5d6830044936958a95556af24660"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60542
I20260709 13:01:31.310861  8287 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:31.311221  8287 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.315696  9384 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:31.316661  9321 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.320595  8896 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:31.325831  9437 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:31.327101  8291 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.341862  8896 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.339898  8287 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.350718  8115 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.352742  8365 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.385501  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:31.386260  8217 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.385816  8215 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:31.392459  8213 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:31.396927  9348 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:31.400897  8367 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:31.402509  9321 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:31.411932  9321 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.414798  8896 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:31.420045  8367 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.422185  9372 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:31.438910  9424 raft_consensus.cc:1064] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:31.445092  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44115d987e9746a3b4f158acec40ce8f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:31.458890  9424 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:31.469151  8896 raft_consensus.cc:2955] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.477449  8217 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:31.478683  8215 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:31.478708  8257 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:31.482707  9348 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:31.483289  9348 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:31.484369  9348 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.501076  9337 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:31.505300  9263 raft_consensus.cc:993] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:31.505923  9263 raft_consensus.cc:1081] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:31.507926  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:31.508620  8215 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:31.509052  8215 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.529785  8287 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:31.551110  8213 raft_consensus.cc:1240] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:31.561725  8363 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:31.553856  8215 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.566440  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:31.567309  8286 raft_consensus.cc:3055] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:31.567724  8286 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:31.571807  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:31.577672  8363 raft_consensus.cc:3055] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:31.578006  8363 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:31.580818  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:31.581564  8367 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.572923  8115 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.579365  8363 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.594826  8286 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.595906  8286 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.597333  8363 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.579406  8215 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:31.596836  9263 consensus_queue.cc:1175] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ee13752324154b1293a47c9dcd8d6ba5" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:01:31.609477  9447 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:31.606542  8367 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:31.618813  8286 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:31.656703  8214 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:31.658624  9348 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:31.664515  8183 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:31.665489  9372 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:31.666235  9372 raft_consensus.cc:697] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:31.610554  9346 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.667205  9372 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:31.666229  8895 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:31.650871  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 58200.3us
I20260709 13:01:31.680123  8363 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:31.680459  8286 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:31.696883  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 104538us
W20260709 13:01:31.690611  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 69369.1us
I20260709 13:01:31.730348  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet 44115d987e9746a3b4f158acec40ce8f with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:31.768944  8363 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:31.793390  8367 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:01:31.793944  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 107436us
I20260709 13:01:31.807505  9321 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:31.838326  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 48316.3us
I20260709 13:01:31.846740  8896 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:31.837885  8113 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.873654  8363 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:31.866875  9453 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:01:31.877380  9337 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:01:31.918951  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 121971us
W20260709 13:01:31.920960  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 77085.1us
W20260709 13:01:31.926793  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 114115us
I20260709 13:01:31.929437  9458 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:31.934675  9453 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:01:31.968086  9463 tablet_replica.cc:333] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
W20260709 13:01:32.006491  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 193677us
I20260709 13:01:32.020413  8287 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.044656  8116 catalog_manager.cc:5697] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:31.940626  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:32.061318  9463 raft_consensus.cc:2243] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:32.078651  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 155720us
I20260709 13:01:32.080468  9463 raft_consensus.cc:2272] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:32.096923  8214 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.114416  8286 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:32.136435  9471 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.134989  8212 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:32.144819  9476 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:32.144955  9463 ts_tablet_manager.cc:1916] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:32.165406  8363 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:32.168936  9472 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:01:32.202999  8115 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.204737  8363 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:32.209455  9462 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:32.241954  9348 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:32.245138  8896 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.245718  8214 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.266218  9463 ts_tablet_manager.cc:1929] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:32.277477  9463 log.cc:1199] T 44115d987e9746a3b4f158acec40ce8f P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/44115d987e9746a3b4f158acec40ce8f
I20260709 13:01:32.280558  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet 44115d987e9746a3b4f158acec40ce8f (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:32.322820  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:32.462684  9489 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:01:32.480034  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 116649us
W20260709 13:01:32.482067  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 121787us
I20260709 13:01:32.499253  8115 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.529659  8363 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:32.639292  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 122795us
I20260709 13:01:32.702169  8212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:32.702852  8212 raft_consensus.cc:606] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:01:32.729689  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 152205us
I20260709 13:01:32.734458  8287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:32.735129  8287 raft_consensus.cc:606] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:32.740829  8287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:32.742985  8287 raft_consensus.cc:606] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:32.750176  8361 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:32.749886  8367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:32.754331  8367 raft_consensus.cc:606] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:32.763338  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:32.764158  8217 raft_consensus.cc:606] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:32.765578  9468 raft_consensus.cc:993] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:32.766042  9402 raft_consensus.cc:1081] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:32.768795  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:32.770620  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:32.774200  8215 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:32.780998  9437 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:32.796743  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 124349us
I20260709 13:01:32.799036  9472 raft_consensus.cc:993] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:32.799526  9472 raft_consensus.cc:1081] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:32.801245  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:01:32.801819  8898 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.802476  8898 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.807547  9451 raft_consensus.cc:993] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:32.808048  9451 raft_consensus.cc:1081] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:32.808704  8895 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:32.815164  8217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:32.815979  8217 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.816351  8217 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.819509  8898 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:32.823031  8215 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.825469  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:32.826110  8212 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.826422  8212 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:32.827178  8212 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:32.828655  8212 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.829164  9404 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:32.819293  9498 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:32.836388  8102 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 1 similar messages]
I20260709 13:01:32.841364  9437 raft_consensus.cc:993] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:32.841909  9437 raft_consensus.cc:1081] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:32.842036  8897 raft_consensus.cc:2955] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.846385  8287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60542
I20260709 13:01:32.846959  8287 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.850548  8287 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.847882  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:32.850155  9468 raft_consensus.cc:993] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:32.857712  8215 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.857817  9468 raft_consensus.cc:1081] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:32.859221  8898 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:32.859478  8895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:01:32.861047  8287 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:32.861692  8895 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.879525  8895 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.861305  8212 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:32.871444  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0545ed3bf21c4b3489c11d21d7796f22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:32.864631  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:32.883415  8286 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.884066  8862 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:32.864445  8215 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.864043  8217 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:32.888464  9490 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.888973  9490 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:32.889459  8215 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:32.887468  8116 catalog_manager.cc:5697] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:32.892537  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:32.892452  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:32.893128  8361 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.893174  8293 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:32.893599  8293 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:32.894404  8293 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:32.896637  8293 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.897506  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:32.893477  8217 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:32.889778  9490 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:32.898684  8898 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.900090  8287 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:32.900205  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:32.900744  8367 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.900972  8367 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:32.902104  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:32.902614  8209 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.906678  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:32.907284  8365 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.913460  8215 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:32.920017  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:32.920698  8291 raft_consensus.cc:3055] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.920564  8367 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:32.921051  8291 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:32.921690  8367 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.921947  8291 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:32.927632  8291 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.939286  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet 0545ed3bf21c4b3489c11d21d7796f22 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:32.961112  8361 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:32.966720  8291 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:32.966746  8286 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:32.978835  8367 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:32.979245  8898 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:32.980161  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:32.982415  9471 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.983001  9471 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:32.994553  8365 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:32.988946  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:32.996137  8184 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:33.002162  8293 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:33.009179  9476 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.009976  9476 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:32.983928  9471 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:33.004347  9502 tablet_replica.cc:333] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:33.001111  9402 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:33.016286  9402 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:33.011008  8895 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.017277  9402 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.033725  9502 raft_consensus.cc:2243] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:33.036180  9502 raft_consensus.cc:2272] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:33.010950  9476 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:33.046142  8209 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:33.053189  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:33.053911  8214 raft_consensus.cc:3055] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:33.054262  8214 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:33.054991  8214 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.055953  8214 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.060195  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:33.060923  8289 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.075727  8214 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:01:33.077487  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:33.053215  8895 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:33.090904  9337 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:33.076963  8102 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ecc8d80ac6df4f5b95c8befae4d08ed0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:33.100440  9337 raft_consensus.cc:697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:33.121904  9502 ts_tablet_manager.cc:1916] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:33.150795  9337 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:33.168004  9501 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:01:33.170279  8289 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:01:33.130273  8113 catalog_manager.cc:5697] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.217949  8116 catalog_manager.cc:5697] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.267516  8114 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.300173  9502 ts_tablet_manager.cc:1929] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:33.300661  9502 log.cc:1199] T 0545ed3bf21c4b3489c11d21d7796f22 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/0545ed3bf21c4b3489c11d21d7796f22
I20260709 13:01:33.302549  8113 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 4, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 4 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.302639  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet 0545ed3bf21c4b3489c11d21d7796f22 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:33.309976  8114 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.320711  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:33.321201  8214 raft_consensus.cc:606] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Received request to transfer leadership
I20260709 13:01:33.325930  8284 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:33.327138  9337 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:33.327706  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:33.328269  8214 raft_consensus.cc:606] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Received request to transfer leadership
I20260709 13:01:33.331761  8209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:33.332453  8209 raft_consensus.cc:606] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Received request to transfer leadership
W20260709 13:01:33.336433  8101 catalog_manager.cc:4755] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): ChangeConfig:REMOVE_PEER RPC failed for tablet a41c46760f54470bb49d3fd515fb4414: Remote error: Service unavailable: leader transfer in progress
W20260709 13:01:33.346479  8164 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:01:33.346990  8164 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for a41c46760f54470bb49d3fd515fb4414 already in progress
W20260709 13:01:33.347285  8164 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for a41c46760f54470bb49d3fd515fb4414 already in progress
I20260709 13:01:33.360816  8214 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:33.363265  9337 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:33.405710  8284 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:33.407578  9460 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:33.417649  9476 raft_consensus.cc:993] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:33.418246  9476 raft_consensus.cc:1081] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:33.434281  8284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:33.434895  8284 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.435230  8284 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.467116  8284 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.469489  8286 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.471388  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:33.471524  8284 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:33.472078  8365 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.473359  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:33.473935  8214 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:33.474323  8214 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:33.475093  8214 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.476126  8214 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.479012  9402 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:33.481237  8214 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:33.471450  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:33.482980  8897 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.488389  8365 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:33.491348  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:33.492475  9492 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:33.492967  9492 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:33.493816  9492 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.509708  8897 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:33.524665  8365 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.526356  9476 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:33.541806  8116 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 4, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.555516  8214 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:33.557660  9337 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:33.584908  8215 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.587426  9451 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:33.605479  8284 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:33.606772  9452 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:33.611454  8365 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.612838  9424 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:33.771581  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:33.819904  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:33.860656  8365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:33.861243  8365 raft_consensus.cc:606] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:33.864166  8365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:33.864897  8365 raft_consensus.cc:606] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:33.867200  8284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:33.867658  8284 raft_consensus.cc:606] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:33.870088  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:33.870570  8215 raft_consensus.cc:606] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:33.874212  8284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:33.874706  8284 raft_consensus.cc:606] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:33.875749  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:33.876919  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:33.881157  8215 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:33.882311  9424 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:33.887172  9451 raft_consensus.cc:993] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:33.887683  9424 raft_consensus.cc:1081] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:33.889478  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:33.890244  8215 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.890586  8215 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.896014  8215 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.898238  8215 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:33.899091  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:33.899678  8365 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.902494  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:33.903098  8897 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.904582  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:33.905144  8284 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:33.905542  8284 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:33.906454  8284 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.907898  8284 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.915369  8897 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:01:33.916810  8365 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:01:33.917917  8184 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:33.917968  8284 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:01:33.919464  9460 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:33.919955  9460 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:33.921332  9460 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:33.933471  8114 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 5, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.024420  9451 raft_consensus.cc:993] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:34.025161  9424 raft_consensus.cc:1081] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:34.026587  8209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:34.027029  8209 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.027278  8209 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.035916  8209 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:34.038182  8209 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:34.038708  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:34.039309  8289 raft_consensus.cc:3055] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:34.039557  8289 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:34.040315  8289 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:34.041388  8289 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.041497  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:34.042120  8361 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.048679  8289 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:34.048979  8361 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:34.049998  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:34.050722  9462 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:34.051460  9462 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:34.052145  9462 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:34.061432  8114 catalog_manager.cc:5697] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.190970  9460 raft_consensus.cc:993] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:34.192469  9460 raft_consensus.cc:1081] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:34.194391  8897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:01:34.194928  8897 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.195250  8897 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.202566  8897 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:34.205096  8897 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:34.205768  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:34.206426  8209 raft_consensus.cc:3055] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:34.206771  8209 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:34.207556  8209 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:34.208873  8209 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.216329  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:34.217273  8289 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.226949  8289 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:34.228189  8209 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:34.229982  8863 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:34.231135  9496 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:34.231614  9496 raft_consensus.cc:697] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:34.232558  9496 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:34.285614  9454 raft_consensus.cc:993] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:34.288990  9454 raft_consensus.cc:1081] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:34.299700  8286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60542
I20260709 13:01:34.299260  8114 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:34.300925  8286 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.310310  8286 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.348987  8286 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:34.364498  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 45835.6us
I20260709 13:01:34.365651  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:34.368259  8365 raft_consensus.cc:3055] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:34.368620  8365 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:34.369917  8365 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:34.372121  8365 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.375138  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:34.376269  8209 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:34.378762  8101 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:34.378973  8895 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:34.387329  9525 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:34.382259  8286 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:34.411936  9469 raft_consensus.cc:993] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:34.412818  9469 raft_consensus.cc:1081] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:34.402861  8209 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:34.413794  8365 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:34.416483  8257 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:34.417769  9424 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:34.418408  9424 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:34.419595  9424 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:34.416394  8289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60542
I20260709 13:01:34.424863  8289 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.425347  8289 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.435257  8367 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:34.444664  9525 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:34.486490  8284 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:34.500209  9524 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:34.505617  8289 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:34.562628  8289 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:34.585206  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:34.596794  8209 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.633531  8284 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.644651  8116 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.666695  8367 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.683231  8217 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:34.683055  9460 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:34.685709  9337 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:34.700042  9460 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.701999  8289 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:34.703979  9337 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:34.716691  8209 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:34.718277  8257 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:34.719606  9538 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:34.720088  9538 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:34.720993  9538 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:34.722335  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:34.722887  8365 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:34.723177  8365 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:34.723922  8365 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:34.725103  8365 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.764830  8365 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:34.766462  8284 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:34.814983  8115 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.823951  8365 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:34.824553  8258 consensus_peers.cc:597] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b137d34f34145b18037845635e297eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:34.825448  8209 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:34.825687  9533 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.827140  9451 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:34.838428  9533 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.840143  8209 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.843753  8365 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.860546  8209 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:34.860435  8116 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
W20260709 13:01:34.871110  8183 consensus_peers.cc:597] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1b1759fd5564511bf32b2e51ed1404c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:34.872825  8365 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:34.874662  8284 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:34.874563  9476 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:34.876499  9460 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:34.878706  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:34.884138  9476 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.888012  8284 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.892745  8365 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.906720  8116 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.917676  8361 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:34.937464  8287 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:34.937585  8332 consensus_peers.cc:597] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f676e8a33e184058b1fda69dd2836ce6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:34.938941  9454 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.940294  8209 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:34.942276  9469 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.960187  8217 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.962117  9533 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.961187  9537 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.987884  8217 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:34.990319  8209 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.990669  8287 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:34.995836  8115 catalog_manager.cc:5697] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.005221  8361 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.007336  9533 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.032749  8365 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:01:35.036738  8183 consensus_peers.cc:597] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e16f2ade8444f2c95d17cae4d4654c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.039633  9462 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:35.043107  8286 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:35.043399  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:35.045109  9460 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:35.090971  9558 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:35.095302  8361 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:35.129392  8286 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:35.136727  8365 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.138278  9451 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.155646  8116 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.181733  8217 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.189519  9538 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.194468  8287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:35.204293  8287 raft_consensus.cc:606] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:35.214010  8361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:35.214725  8361 raft_consensus.cc:606] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:35.218017  8287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "864d288163824eac975181159a2708d9"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:35.218655  8287 raft_consensus.cc:606] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:35.223014  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:35.223588  8217 raft_consensus.cc:606] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:35.224978  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:35.226553  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:35.310698  9532 raft_consensus.cc:993] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:35.311240  9526 raft_consensus.cc:1081] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:35.312886  8287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60542
I20260709 13:01:35.313388  8287 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.313776  8287 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.322050  8287 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:35.324348  8287 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:35.325937  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:35.326843  8365 raft_consensus.cc:3055] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.327210  8365 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:35.328167  8365 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:35.329013  8365 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.326113  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:35.331954  8212 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.343037  8212 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:35.344740  8257 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:35.345896  9533 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:35.347972  8365 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:35.348419  9533 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:35.350364  9533 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:35.358500  9565 ts_tablet_manager.cc:933] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:35.362248  9565 tablet_copy_client.cc:323] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:35.364671  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet f676e8a33e184058b1fda69dd2836ce6 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:35.365768  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet f676e8a33e184058b1fda69dd2836ce6 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-f676e8a33e184058b1fda69dd2836ce6
I20260709 13:01:35.364845  8116 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.373932  8376 tablet_copy_source_session.cc:215] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:35.378473  9565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f676e8a33e184058b1fda69dd2836ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.379108  9567 ts_tablet_manager.cc:933] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:35.381165  9567 tablet_copy_client.cc:323] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:35.384546  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet 3b137d34f34145b18037845635e297eb from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:35.385170  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet 3b137d34f34145b18037845635e297eb from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-3b137d34f34145b18037845635e297eb
I20260709 13:01:35.394387  9565 tablet_copy_client.cc:806] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:35.393922  8303 tablet_copy_source_session.cc:215] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:35.395123  9565 tablet_copy_client.cc:670] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:35.398731  9567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b137d34f34145b18037845635e297eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.399359  9565 tablet_copy_client.cc:538] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.410760  9565 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:35.418277  9567 tablet_copy_client.cc:806] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:35.418869  9567 tablet_copy_client.cc:670] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:35.438201  9567 tablet_copy_client.cc:538] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.439671  9565 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:35.440457  9565 tablet_bootstrap.cc:492] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:35.441058  9565 ts_tablet_manager.cc:1403] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.019s
I20260709 13:01:35.444028  9565 raft_consensus.cc:359] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:35.444662  9565 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:35.445142  9565 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:35.447677  9565 ts_tablet_manager.cc:1434] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:35.449579  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-f676e8a33e184058b1fda69dd2836ce6 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:35.450029  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-f676e8a33e184058b1fda69dd2836ce6 on tablet f676e8a33e184058b1fda69dd2836ce6 with peer 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:01:35.450121  8101 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer ca43983edda443fa9d74c1f80252f1fc from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:35.454164  9567 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:35.465679  9565 ts_tablet_manager.cc:933] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:35.467739  9565 tablet_copy_client.cc:323] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:35.469645  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet c1b1759fd5564511bf32b2e51ed1404c from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:35.470254  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet c1b1759fd5564511bf32b2e51ed1404c from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-c1b1759fd5564511bf32b2e51ed1404c
I20260709 13:01:35.480028  8228 tablet_copy_source_session.cc:215] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:35.482399  9558 raft_consensus.cc:993] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:35.482940  9558 raft_consensus.cc:1081] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Signalling peer ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:35.483218  9567 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:35.486040  8361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:42830
I20260709 13:01:35.486327  9565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b1759fd5564511bf32b2e51ed1404c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.486718  8361 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.487087  8361 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.495500  8361 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:35.497630  8361 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:35.498376  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:35.498977  8217 raft_consensus.cc:3055] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:35.499119  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:35.499323  8217 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:35.499257  9567 tablet_bootstrap.cc:492] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:35.499737  8287 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.500249  9567 ts_tablet_manager.cc:1403] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.008s
I20260709 13:01:35.500141  8217 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:35.502040  8217 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.503557  9567 raft_consensus.cc:359] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:35.504467  9567 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:35.505152  9567 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:35.517757  8217 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:35.519622  8331 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:35.525386  9469 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:35.526140  9469 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:35.527175  9469 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:35.528374  9533 raft_consensus.cc:993] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:35.528918  9538 raft_consensus.cc:1081] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:35.531565  8895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "864d288163824eac975181159a2708d9"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:01:35.532140  8895 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.532526  8895 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.540560  8895 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:35.556360  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:35.556653  8895 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:35.557047  8212 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.557245  9565 tablet_copy_client.cc:806] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:35.558283  9565 tablet_copy_client.cc:670] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:35.562237  9567 ts_tablet_manager.cc:1434] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.062s	user 0.018s	sys 0.028s
I20260709 13:01:35.561956  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:35.564692  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-3b137d34f34145b18037845635e297eb received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:35.565341  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-3b137d34f34145b18037845635e297eb on tablet 3b137d34f34145b18037845635e297eb with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:35.564716  8284 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.571239  8284 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:35.571746  9565 tablet_copy_client.cc:538] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.572088  8284 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:35.573329  8284 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.586856  8212 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:35.590989  8862 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:35.594306  9496 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:35.594862  9496 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:35.595703  9496 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:35.611996  9567 ts_tablet_manager.cc:933] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:35.615393  8287 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:35.620138  8284 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:35.675485  8116 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 3, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:35.706154  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 126561us
I20260709 13:01:35.713892  9567 tablet_copy_client.cc:323] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:35.723456  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet 0e16f2ade8444f2c95d17cae4d4654c2 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:35.724074  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet 0e16f2ade8444f2c95d17cae4d4654c2 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-0e16f2ade8444f2c95d17cae4d4654c2
I20260709 13:01:35.733109  8228 tablet_copy_source_session.cc:215] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:35.750329  9567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e16f2ade8444f2c95d17cae4d4654c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.749634  8113 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:35.766762  9565 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:35.801725  8361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:35.802507  8361 raft_consensus.cc:606] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:01:35.829344  9575 raft_consensus.cc:993] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:35.830678  9574 raft_consensus.cc:1081] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:35.836138  8217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:35.836721  8217 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.837064  8217 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.840891  8212 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.848846  8217 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:35.852006  8217 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:35.851898  9574 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.852716  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:35.853968  8286 raft_consensus.cc:3055] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:35.854210  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:35.854329  8286 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:35.854631  8361 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.855029  9567 tablet_copy_client.cc:806] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:35.855086  8286 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:35.855693  9567 tablet_copy_client.cc:670] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:35.856259  8286 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.860422  8361 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:35.860388  9567 tablet_copy_client.cc:538] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.861791  8184 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:35.863255  9583 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:35.863730  9583 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:35.864774  9583 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:35.871635  8286 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:35.881088  9567 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:35.882283  8361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:35.882946  8361 raft_consensus.cc:606] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:01:35.895985  8895 raft_consensus.cc:1217] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:35.927686  8361 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.932682  9575 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:35.956700  8103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 71912.2us
I20260709 13:01:35.973766  8367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:35.974499  8367 raft_consensus.cc:606] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:01:35.981792  8164 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:01:35.982256  8164 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c1b1759fd5564511bf32b2e51ed1404c already in progress
W20260709 13:01:35.982555  8164 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c1b1759fd5564511bf32b2e51ed1404c already in progress
I20260709 13:01:36.012784  8895 raft_consensus.cc:1217] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:36.020342  9565 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:36.021684  8209 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:36.024541  9565 tablet_bootstrap.cc:492] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:36.025380  9565 ts_tablet_manager.cc:1403] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.259s	user 0.025s	sys 0.013s
I20260709 13:01:36.031054  9572 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:36.031350  8116 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.041853  9565 raft_consensus.cc:359] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.042794  9565 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:36.043443  9565 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.044792  9567 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:36.050647  9567 tablet_bootstrap.cc:492] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:36.061199  9567 ts_tablet_manager.cc:1403] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.181s	user 0.035s	sys 0.004s
I20260709 13:01:36.073792  9565 ts_tablet_manager.cc:1434] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:01:36.072481  9567 raft_consensus.cc:359] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.075062  9567 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:36.076200  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-c1b1759fd5564511bf32b2e51ed1404c received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:36.076679  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-c1b1759fd5564511bf32b2e51ed1404c on tablet c1b1759fd5564511bf32b2e51ed1404c with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:36.080381  9567 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.094434  9567 ts_tablet_manager.cc:1434] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 13:01:36.097420  8286 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:36.098353  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-0e16f2ade8444f2c95d17cae4d4654c2 received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:36.098780  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-0e16f2ade8444f2c95d17cae4d4654c2 on tablet 0e16f2ade8444f2c95d17cae4d4654c2 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:36.100401  9577 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:36.114439  8212 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:36.118988  9532 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:36.141757  8895 raft_consensus.cc:1217] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:36.143602  9592 raft_consensus.cc:993] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:36.144147  9592 raft_consensus.cc:1081] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:36.147871  8217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39256
I20260709 13:01:36.148401  8217 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.148741  8217 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.150471  8895 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Advancing to term 3
I20260709 13:01:36.151722  8286 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:36.154954  9592 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:36.167629  8217 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.177297  8895 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:36.192641  8217 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:36.194159  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:36.194772  8289 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.194546  9592 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:36.195245  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:36.195840  8366 raft_consensus.cc:3055] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:36.196187  8366 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:36.196959  8366 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.200575  8366 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.201675  8289 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:01:36.203033  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:36.203959  9557 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:36.204444  9557 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:36.205286  9557 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.213027  8366 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:01:36.227099  8114 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 4, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.228140  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:36.303015  9538 raft_consensus.cc:1064] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:36.309702  9469 raft_consensus.cc:1064] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:36.312103  9469 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:36.305382  9538 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:36.326189  8897 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:36.327174  8217 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:36.329259  8289 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:36.349812  8897 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:36.353555  8366 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:36.353385  9574 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.358307  8217 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:36.360942  9574 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.362259  9587 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.364558  9587 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.367328  9532 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.370396  9538 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:36.382625  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:36.416565  8366 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.411907  9538 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.431506  9469 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.446863  8289 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.448377  8897 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.456931  8113 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.466722  8287 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:36.470157  9585 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.476451  8217 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.483739  8897 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.491802  8361 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:36.495404  9585 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.502027  8209 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.511992  8286 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:36.523604  8212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:36.524300  8212 raft_consensus.cc:606] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:36.543380  8897 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:36.521039  8116 catalog_manager.cc:5697] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.545027  9574 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:36.547303  8212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:36.547943  8212 raft_consensus.cc:606] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:36.554204  8289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f92a5d6830044936958a95556af24660"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:36.554788  8289 raft_consensus.cc:606] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:36.555224  9619 raft_consensus.cc:993] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:36.556128  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:36.556694  9451 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.558585  8897 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.561829  9583 raft_consensus.cc:1081] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:36.557821  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:36.567375  9619 raft_consensus.cc:1064] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
W20260709 13:01:36.567831  9619 raft_consensus.cc:1068] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: Unable to promote non-voter 4a50f39e2d8e4886a79849938f2272a6: Service unavailable: leader transfer in progress
I20260709 13:01:36.569430  8289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:36.570004  8289 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.570359  8289 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.576167  8289 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:36.578644  8289 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:36.582906  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:36.583619  8365 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:36.583698  8897 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.595295  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:36.597071  8215 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.597434  8215 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:36.598222  8215 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:36.598691  9575 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:36.599711  8215 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.607021  8365 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.616254  8215 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:36.619114  8257 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:36.619915  9538 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.620394  9538 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:36.621213  9538 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:36.624589  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b137d34f34145b18037845635e297eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:36.617494  8116 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.637202  8361 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:36.641616  8897 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:36.647841  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b137d34f34145b18037845635e297eb with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:36.656415  8285 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:36.659216  9532 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:36.674279  8285 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:36.676119  9583 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:36.686050  9622 tablet_replica.cc:333] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:36.690101  9622 raft_consensus.cc:2243] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:36.688546  8897 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:36.701695  9622 raft_consensus.cc:2272] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:36.709183  8361 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:36.712417  9583 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:36.713567  8897 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Advancing to term 4
I20260709 13:01:36.723165  9469 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:01:36.741804  9592 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.749168  9622 ts_tablet_manager.cc:1916] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:36.756345  9585 raft_consensus.cc:993] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:36.757282  9585 raft_consensus.cc:1081] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Signalling peer ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:36.760094  8363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:42830
I20260709 13:01:36.760696  8363 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.760915  8897 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:36.761018  8363 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.762742  9583 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:36.807154  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f676e8a33e184058b1fda69dd2836ce6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:36.785964  8363 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
W20260709 13:01:36.790498  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48856.3us
I20260709 13:01:36.799726  9557 raft_consensus.cc:1064] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:36.813884  9557 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:36.816993  8895 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.822036  8897 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:36.822402  8361 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:36.823436  9585 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:36.824920  9619 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:36.828730  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:36.829288  8215 raft_consensus.cc:3055] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.829566  8215 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:36.795893  8116 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.830287  8215 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.831627  8215 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.832669  8363 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:36.835436  8289 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:36.838367  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:36.838935  8286 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.837980  8285 raft_consensus.cc:2955] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.790017  9622 ts_tablet_manager.cc:1929] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:36.840337  9622 log.cc:1199] T 3b137d34f34145b18037845635e297eb P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/3b137d34f34145b18037845635e297eb
I20260709 13:01:36.845019  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 3b137d34f34145b18037845635e297eb (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:36.846702  8286 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:36.848829  8332 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:36.849913  9621 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:36.849550  9625 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.851915  9625 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:36.853490  9538 raft_consensus.cc:993] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:36.853252  9625 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:36.852875  8115 catalog_manager.cc:5697] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.854048  9451 raft_consensus.cc:1081] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:36.860464  8209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f92a5d6830044936958a95556af24660"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:36.861037  8209 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.861356  8209 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.863344  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet f676e8a33e184058b1fda69dd2836ce6 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:36.864307  9622 tablet_replica.cc:333] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:36.865320  9622 raft_consensus.cc:2243] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:36.866021  9622 raft_consensus.cc:2272] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:36.868683  8209 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:36.871286  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:36.871861  9622 ts_tablet_manager.cc:1916] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:36.871855  8289 raft_consensus.cc:3055] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.873164  8289 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:36.874010  8289 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:36.875062  8289 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.881351  8289 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:36.882458  8209 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:36.884061  8183 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:36.886116  9583 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.886703  9583 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:36.887580  9583 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:36.894357  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:36.894954  8363 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.898382  8113 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 3, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.901093  9623 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.907591  8366 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.909096  8215 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:36.916810  8897 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.929018  8363 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:36.942842  8114 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.947317  8289 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:36.950523  8361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:36.951123  8361 raft_consensus.cc:606] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:01:36.966801  8366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:36.967419  8366 raft_consensus.cc:606] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:01:36.982806  8366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:36.983392  8366 raft_consensus.cc:606] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:01:36.991743  8164 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:01:36.992219  8164 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0e16f2ade8444f2c95d17cae4d4654c2 already in progress
W20260709 13:01:36.992547  8164 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0e16f2ade8444f2c95d17cae4d4654c2 already in progress
I20260709 13:01:36.997227  8113 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.999277  9622 ts_tablet_manager.cc:1929] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:36.999753  9622 log.cc:1199] T f676e8a33e184058b1fda69dd2836ce6 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/f676e8a33e184058b1fda69dd2836ce6
I20260709 13:01:37.001477  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet f676e8a33e184058b1fda69dd2836ce6 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:37.017138  8215 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:37.021643  8897 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:37.022295  8285 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:37.022958  9623 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:37.023989  9583 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:37.031028  9623 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.033977  8897 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.035328  8289 raft_consensus.cc:2955] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.040889  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1b1759fd5564511bf32b2e51ed1404c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:37.052496  8113 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 6 to 7, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.063877  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b1759fd5564511bf32b2e51ed1404c with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:37.065963  9631 tablet_replica.cc:333] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:37.066901  9631 raft_consensus.cc:2243] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.067750  9631 raft_consensus.cc:2272] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.072146  9631 ts_tablet_manager.cc:1916] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:37.085916  9631 ts_tablet_manager.cc:1929] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:01:37.086289  9631 log.cc:1199] T c1b1759fd5564511bf32b2e51ed1404c P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/c1b1759fd5564511bf32b2e51ed1404c
I20260709 13:01:37.090600  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet c1b1759fd5564511bf32b2e51ed1404c (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:37.092936  8897 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:37.094432  9451 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:37.107807  8215 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:37.112092  9538 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:37.286373  8285 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:37.287492  9557 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:37.296494  8366 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:37.297791  9557 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:37.298154  8897 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Advancing to term 3
I20260709 13:01:37.307581  8897 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:37.309531  8215 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:37.312060  9593 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:37.313555  9593 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:37.325240  9593 raft_consensus.cc:993] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:37.325724  9593 raft_consensus.cc:1081] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:37.330964  9625 raft_consensus.cc:1064] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
W20260709 13:01:37.331439  9625 raft_consensus.cc:1068] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: Unable to promote non-voter 4a50f39e2d8e4886a79849938f2272a6: Service unavailable: leader transfer in progress
I20260709 13:01:37.336685  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39256
I20260709 13:01:37.337350  8215 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:37.337720  8215 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.338199  8285 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:37.340545  9593 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:37.348608  8215 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:37.358741  9625 raft_consensus.cc:1064] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
W20260709 13:01:37.359203  9625 raft_consensus.cc:1068] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: Unable to promote non-voter 4a50f39e2d8e4886a79849938f2272a6: Service unavailable: leader transfer in progress
I20260709 13:01:37.364738  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:37.368448  8215 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:37.376513  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:37.377092  8366 raft_consensus.cc:3055] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.377313  8366 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:37.377971  8366 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:37.384469  8366 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.394704  8366 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:01:37.395727  8184 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:37.396478  9583 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:37.396957  9583 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:37.397725  9583 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:37.409224  8113 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 4, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:37.531370  8101 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer ca43983edda443fa9d74c1f80252f1fc from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.563575  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:37.663128  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:37.700891  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:37.701488  8215 raft_consensus.cc:606] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:37.703905  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:37.704380  8215 raft_consensus.cc:606] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:37.706723  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:37.707263  8215 raft_consensus.cc:606] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:37.709460  8285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:37.710040  8285 raft_consensus.cc:606] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:37.711270  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:37.712656  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:37.766925  9538 raft_consensus.cc:993] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:37.767444  9575 raft_consensus.cc:1081] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:37.769390  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:37.769960  8215 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:37.770323  8215 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.775851  8215 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:37.777423  8215 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:37.778265  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:37.778474  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:37.778831  8285 raft_consensus.cc:3055] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.778997  8366 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.779177  8285 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:37.780086  8285 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:37.781669  8285 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.785477  8366 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:37.786623  8184 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:37.787390  9619 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.787815  9619 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:37.788573  9619 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:37.789032  8285 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:37.798652  8113 catalog_manager.cc:5697] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.814038  8366 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:37.815383  9557 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:37.823379  8897 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Advancing to term 4
I20260709 13:01:37.827172  8289 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.832908  8897 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:37.833390  8289 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:37.835407  9557 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:37.836313  9619 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:37.847019  9583 raft_consensus.cc:1064] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:37.849556  9583 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:37.858059  8897 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:37.859784  8285 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:37.861395  9557 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:37.862322  9619 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:37.865625  8366 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:37.871869  9557 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:37.881145  9642 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.882562  8897 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.886346  8366 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.905071  8114 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.925835  8286 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.948230  8217 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:37.952076  8897 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:37.952292  8286 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:37.953140  9619 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:37.954363  9642 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:37.961356  9619 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.963097  8286 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.967259  8895 raft_consensus.cc:2955] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.974745  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e16f2ade8444f2c95d17cae4d4654c2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:37.981580  8113 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 6 to 7, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:37.990837  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e16f2ade8444f2c95d17cae4d4654c2 with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:37.992726  9644 tablet_replica.cc:333] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:37.994498  9644 raft_consensus.cc:2243] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.995321  9644 raft_consensus.cc:2272] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.003212  9644 ts_tablet_manager.cc:1916] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:38.015334  9644 ts_tablet_manager.cc:1929] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:01:38.015725  9644 log.cc:1199] T 0e16f2ade8444f2c95d17cae4d4654c2 P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/0e16f2ade8444f2c95d17cae4d4654c2
I20260709 13:01:38.017251  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 0e16f2ade8444f2c95d17cae4d4654c2 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:38.036895  9642 raft_consensus.cc:993] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:38.037452  9643 raft_consensus.cc:1081] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:38.039059  8289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:38.039531  8289 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.039801  8289 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.045843  8289 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:38.047442  8289 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:38.048568  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:38.049105  8365 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.054489  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:38.055053  8365 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:38.055130  8217 raft_consensus.cc:3055] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:38.056034  8259 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:38.056440  8217 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:38.056998  9538 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:38.057482  9538 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:38.057209  8217 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:38.058323  9538 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:38.058856  8217 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.071913  8217 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:38.079466  9642 raft_consensus.cc:993] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:38.078739  8116 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 4, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.079965  9557 raft_consensus.cc:1081] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:38.082406  8366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:42830
I20260709 13:01:38.083072  8366 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.083551  8366 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.088445  9557 raft_consensus.cc:993] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:38.088994  9643 raft_consensus.cc:1081] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:38.093226  8895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:01:38.094586  8895 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.094950  8895 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.095046  8289 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.095561  8366 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:38.098129  8366 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:38.098496  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:38.099088  8286 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.098024  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:38.100008  8217 raft_consensus.cc:3055] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.100378  8217 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:38.101048  8217 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:38.101675  8895 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:38.102589  8217 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.104408  8895 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:38.109465  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:38.110024  8215 raft_consensus.cc:3055] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.110194  8209 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.110340  8215 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:38.111119  8215 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:38.110232  8217 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:38.112083  8215 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.112605  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:38.113689  8289 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.113065  8331 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:38.112167  9647 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:38.114907  9625 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.115399  9625 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:01:38.116163  8258 consensus_peers.cc:597] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8c00c17016841839312c823fcffaf82. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:38.116263  9625 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:38.117301  8366 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.118110  8215 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:38.120255  8862 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:38.120847  9577 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.121325  9577 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:38.121778  9451 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:38.122145  9577 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:38.130364  8286 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:38.132555  8289 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:38.142149  8116 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.142819  8114 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.143647  9451 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.152345  8365 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.162009  8209 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.150993  8217 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.176589  8286 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.177305  8365 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.179376  9557 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:38.178926  8114 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.181241  9643 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:01:38.185837  8183 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b44a898a39ca4aef88c7fc182072ddac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:38.206861  9642 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.208861  8286 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.212402  8365 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.227977  8286 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.232043  8116 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.240509  8365 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:01:38.242240  8258 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 457d66c5ca7c4163a642765639bc4f3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:38.242470  8217 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.243945  9647 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:38.245543  9451 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:38.254170  8286 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.255806  9643 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.257709  9575 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.264617  8217 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.273648  8365 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.280563  8289 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.284814  8113 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.312453  8365 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.326495  9557 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:38.334321  8258 consensus_peers.cc:597] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c38bdb3838dd476fb824170ffe3fe5e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:38.336293  8366 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:38.339219  9575 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.340796  8217 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:38.341940  9575 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.351044  9660 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.354730  8217 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.361325  8365 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:38.378340  8113 catalog_manager.cc:5697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.502398  8217 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.503628  9662 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.514308  8289 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.516016  9593 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.530650  8215 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:38.532822  9660 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:38.538312  8365 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:38.542264  9660 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:38.566008  8286 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:38.571187  9577 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:38.573498  9671 ts_tablet_manager.cc:933] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:38.575891  9671 tablet_copy_client.cc:323] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:38.577989  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet c8c00c17016841839312c823fcffaf82 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:38.578573  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet c8c00c17016841839312c823fcffaf82 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-c8c00c17016841839312c823fcffaf82
I20260709 13:01:38.587153  8303 tablet_copy_source_session.cc:215] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:38.594682  8215 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:38.598932  9632 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:38.609525  9671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c00c17016841839312c823fcffaf82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.645308  9674 ts_tablet_manager.cc:933] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:38.658514  9674 tablet_copy_client.cc:323] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:38.682631  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet b44a898a39ca4aef88c7fc182072ddac from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:38.683207  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet b44a898a39ca4aef88c7fc182072ddac from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-b44a898a39ca4aef88c7fc182072ddac
I20260709 13:01:38.690059  9671 tablet_copy_client.cc:806] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:38.690815  9671 tablet_copy_client.cc:670] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:38.710570  8228 tablet_copy_source_session.cc:215] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:38.713567  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:38.728410  9671 tablet_copy_client.cc:538] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:38.729010  9674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b44a898a39ca4aef88c7fc182072ddac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.741503  9671 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:38.742498  9680 ts_tablet_manager.cc:933] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:38.755731  9674 tablet_copy_client.cc:806] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:38.756397  9674 tablet_copy_client.cc:670] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:38.760562  9680 tablet_copy_client.cc:323] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:38.763581  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet c38bdb3838dd476fb824170ffe3fe5e2 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:38.764204  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet c38bdb3838dd476fb824170ffe3fe5e2 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-c38bdb3838dd476fb824170ffe3fe5e2
I20260709 13:01:38.767339  9674 tablet_copy_client.cc:538] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:38.772780  8303 tablet_copy_source_session.cc:215] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:38.778275  9682 ts_tablet_manager.cc:933] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:38.779439  9680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38bdb3838dd476fb824170ffe3fe5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.795688  9674 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:38.834641  9682 tablet_copy_client.cc:323] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:38.840252  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet 457d66c5ca7c4163a642765639bc4f3d from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:38.840828  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet 457d66c5ca7c4163a642765639bc4f3d from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-457d66c5ca7c4163a642765639bc4f3d
I20260709 13:01:38.848601  8303 tablet_copy_source_session.cc:215] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:38.855618  9682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457d66c5ca7c4163a642765639bc4f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.857645  9680 tablet_copy_client.cc:806] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:38.859702  9680 tablet_copy_client.cc:670] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:38.866839  9671 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:38.867100  9680 tablet_copy_client.cc:538] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:38.873528  9671 tablet_bootstrap.cc:492] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:38.874393  9671 ts_tablet_manager.cc:1403] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.133s	user 0.030s	sys 0.016s
I20260709 13:01:38.878314  9671 raft_consensus.cc:359] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.879165  9671 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:38.879806  9671 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.891934  9671 ts_tablet_manager.cc:1434] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:01:38.895409  9674 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:38.896446  9674 tablet_bootstrap.cc:492] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:38.897140  9674 ts_tablet_manager.cc:1403] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.011s
I20260709 13:01:38.900048  9674 raft_consensus.cc:359] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.900867  9674 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:38.901185  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-c8c00c17016841839312c823fcffaf82 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:38.901633  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-c8c00c17016841839312c823fcffaf82 on tablet c8c00c17016841839312c823fcffaf82 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:38.901502  9674 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.903272  9680 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:38.904237  9674 ts_tablet_manager.cc:1434] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:01:38.917716  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-b44a898a39ca4aef88c7fc182072ddac received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:38.918227  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-b44a898a39ca4aef88c7fc182072ddac on tablet b44a898a39ca4aef88c7fc182072ddac with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:38.920634  9682 tablet_copy_client.cc:806] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:38.925691  9682 tablet_copy_client.cc:670] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:38.929620  9682 tablet_copy_client.cc:538] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:38.930083  9680 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:38.934180  9680 tablet_bootstrap.cc:492] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:38.934875  9680 ts_tablet_manager.cc:1403] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.011s
I20260709 13:01:38.938608  9680 raft_consensus.cc:359] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.939402  9680 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:38.939742  9682 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:38.940012  9680 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.943225  9680 ts_tablet_manager.cc:1434] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:01:38.945076  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-c38bdb3838dd476fb824170ffe3fe5e2 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:38.945513  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-c38bdb3838dd476fb824170ffe3fe5e2 on tablet c38bdb3838dd476fb824170ffe3fe5e2 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:38.975128  9682 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:38.976052  9682 tablet_bootstrap.cc:492] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:38.976728  9682 ts_tablet_manager.cc:1403] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.008s
I20260709 13:01:38.979652  9682 raft_consensus.cc:359] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.980500  9682 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:38.981133  9682 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:38.983590  9682 ts_tablet_manager.cc:1434] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:38.984684  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:38.985319  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-457d66c5ca7c4163a642765639bc4f3d received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:38.985747  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-457d66c5ca7c4163a642765639bc4f3d on tablet 457d66c5ca7c4163a642765639bc4f3d with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:39.047199  8366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:39.047822  8366 raft_consensus.cc:606] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:39.051496  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:39.052062  8217 raft_consensus.cc:606] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:39.054888  8286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe403af31f9840f3b20788181ba23576"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:39.055426  8286 raft_consensus.cc:606] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:39.056557  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:39.057662  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:39.096377  8895 raft_consensus.cc:1217] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:39.122869  8897 raft_consensus.cc:1217] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:39.123325  8895 raft_consensus.cc:1217] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:39.282780  8895 raft_consensus.cc:1217] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:39.307555  9593 raft_consensus.cc:993] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:39.308091  9661 raft_consensus.cc:1081] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:39.309707  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39256
I20260709 13:01:39.310150  8215 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.310436  8215 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.320058  8215 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:39.322444  8215 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:39.323398  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:39.323967  8895 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.324165  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:39.324806  8365 raft_consensus.cc:3055] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.325150  8365 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:39.326288  8365 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:39.327967  8365 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.334291  8895 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:39.334743  8365 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:39.335561  8183 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:39.336702  9642 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.337159  9642 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:39.337990  9642 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:39.349296  8113 catalog_manager.cc:5697] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.421897  9642 raft_consensus.cc:993] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:39.422459  9557 raft_consensus.cc:1081] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:39.425343  8289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:39.425874  8289 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.426230  8289 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.430260  9647 raft_consensus.cc:993] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:39.430780  9575 raft_consensus.cc:1081] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:39.436728  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe403af31f9840f3b20788181ba23576"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:39.437270  8215 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.437664  8215 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.437294  8289 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:39.441684  8289 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:39.442204  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:39.442770  8366 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.441751  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:39.444167  8217 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.444440  8217 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:39.445220  8217 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:39.447399  8217 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.449474  8366 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:39.449288  8215 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:39.450739  8259 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:39.451972  8215 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:39.452441  9538 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.452904  9538 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:39.453490  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:39.453614  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:39.454046  8289 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:39.454463  8365 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.454550  8289 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:39.453709  9538 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:39.455607  8289 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:39.456776  8289 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.464838  8289 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:39.473861  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:39.475152  9557 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:39.474139  8217 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:39.475682  9557 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:39.479187  9557 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:39.475452  8365 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:39.500361  8113 catalog_manager.cc:5697] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.505308  8116 catalog_manager.cc:5697] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.579162  9575 raft_consensus.cc:1064] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:39.581794  9575 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:39.591987  8365 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.590873  8895 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.594286  9660 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:39.598270  9660 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:39.609131  8215 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.611245  9660 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:39.618439  9660 raft_consensus.cc:1064] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:39.638342  9660 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:39.646252  9642 raft_consensus.cc:1064] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:39.644799  8898 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.650404  9642 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:39.654726  8217 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.641893  9647 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.673794  9697 raft_consensus.cc:1064] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:39.677325  8895 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.676550  9697 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:39.679813  8366 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.691624  9557 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:39.694897  9557 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:39.681842  8289 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.722694  8365 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.680066  8116 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.725603  8895 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.727475  9538 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:39.730347  9538 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 13:01:39.751019  9700 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:01:39.776314  8898 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:39.782509  9538 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.783546  8217 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:39.784734  8366 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:39.786895  9538 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.793171  8217 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:39.788579  9697 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:01:39.799325  9709 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:39.800683  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 84643.2us
I20260709 13:01:39.813015  9642 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:01:39.830396  8361 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.855265  8286 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:39.862160  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 55441.6us
I20260709 13:01:39.877451  8361 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.880635  9660 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:39.910159  8367 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:39.911023  8895 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:39.912559  8896 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.913978  9706 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:39.914535  8209 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.901353  9697 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.920086  9647 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:39.923163  8215 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.912487  9575 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.928205  9538 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.948098  8895 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.935684  8363 raft_consensus.cc:2955] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.958902  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8c00c17016841839312c823fcffaf82 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:39.976327  8898 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.986161  8896 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:39.987648  9557 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:39.994283  8289 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:39.995690  8113 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.013019  8114 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 4 to 5, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.033798  8361 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:40.037896  9694 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:40.057963  8289 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:40.058593  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:40.066911  8362 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.067557  9704 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.075690  9557 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:40.084128  8366 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:40.091743  9557 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:40.109354  8209 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.114596  8113 catalog_manager.cc:5697] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.132781  8898 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.112361  9701 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:01:40.187953  8367 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:40.195868  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 52121.1us
W20260709 13:01:40.197335  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 88524.5us
I20260709 13:01:40.215791  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet c8c00c17016841839312c823fcffaf82 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:40.274333  9740 tablet_replica.cc:333] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:40.275532  9740 raft_consensus.cc:2243] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.276376  9740 raft_consensus.cc:2272] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.310042  8115 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.324926  9740 ts_tablet_manager.cc:1916] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:40.328583  8209 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.334105  8285 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.347885  8361 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:40.349151  8286 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.351562  8898 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:40.359890  9740 ts_tablet_manager.cc:1929] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:40.360363  9740 log.cc:1199] T c8c00c17016841839312c823fcffaf82 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/c8c00c17016841839312c823fcffaf82
I20260709 13:01:40.362416  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet c8c00c17016841839312c823fcffaf82 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:40.363067  9704 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:40.367951  8361 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:40.371354  8898 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:40.373016  9709 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:40.372359  9704 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:40.376869  9660 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:40.385462  8896 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:40.386363  8209 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:40.388116  9706 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.388757  8367 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.392721  9709 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:40.392033  9538 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.402318  9701 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:40.406898  8896 raft_consensus.cc:2955] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.413786  8363 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.414484  9702 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.415400  8112 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 4 to 5, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.423699  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c38bdb3838dd476fb824170ffe3fe5e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:40.422962  8209 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.432266  8114 catalog_manager.cc:5697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 1 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.437685  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 457d66c5ca7c4163a642765639bc4f3d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:40.443707  8115 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.451880  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet c38bdb3838dd476fb824170ffe3fe5e2 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:40.452932  9740 tablet_replica.cc:333] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:40.452956  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet b44a898a39ca4aef88c7fc182072ddac with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:40.455715  8898 raft_consensus.cc:2955] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.458776  9740 raft_consensus.cc:2243] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.459590  9740 raft_consensus.cc:2272] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.463340  9740 ts_tablet_manager.cc:1916] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:40.463533  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 457d66c5ca7c4163a642765639bc4f3d with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:40.470862  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b44a898a39ca4aef88c7fc182072ddac with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:40.475227  9744 tablet_replica.cc:333] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:40.476370  9744 raft_consensus.cc:2243] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.477226  9744 raft_consensus.cc:2272] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.481009  9744 ts_tablet_manager.cc:1916] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:40.497442  9744 ts_tablet_manager.cc:1929] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:40.497890  9744 log.cc:1199] T 457d66c5ca7c4163a642765639bc4f3d P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/457d66c5ca7c4163a642765639bc4f3d
I20260709 13:01:40.499610  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 457d66c5ca7c4163a642765639bc4f3d (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:40.502015  8896 raft_consensus.cc:2955] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:40.507258  9743 tablet_replica.cc:333] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:40.511886  9743 raft_consensus.cc:2243] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.512761  9743 raft_consensus.cc:2272] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.520855  9743 ts_tablet_manager.cc:1916] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:40.521282  9740 ts_tablet_manager.cc:1929] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:40.521723  9740 log.cc:1199] T c38bdb3838dd476fb824170ffe3fe5e2 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/c38bdb3838dd476fb824170ffe3fe5e2
I20260709 13:01:40.523263  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet c38bdb3838dd476fb824170ffe3fe5e2 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:40.534557  9743 ts_tablet_manager.cc:1929] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:40.534970  9743 log.cc:1199] T b44a898a39ca4aef88c7fc182072ddac P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/b44a898a39ca4aef88c7fc182072ddac
I20260709 13:01:40.536417  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet b44a898a39ca4aef88c7fc182072ddac (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:40.577150  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:40.614537  8209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:40.615027  8209 raft_consensus.cc:606] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:40.617631  8285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:40.618275  8285 raft_consensus.cc:606] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:40.620711  8209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:40.621268  8209 raft_consensus.cc:606] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:40.622269  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:40.623704  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:40.659366  9642 raft_consensus.cc:993] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:40.659950  9642 raft_consensus.cc:1081] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:40.661769  8896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:01:40.662391  8896 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.662788  8896 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.669631  8896 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.671214  8896 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:40.671830  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:40.672159  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:40.672387  8209 raft_consensus.cc:3055] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.672734  8209 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:40.673596  8367 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.673449  8209 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.674485  8209 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.681386  8209 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:40.682308  8367 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:40.683467  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:40.684649  9632 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.686334  9632 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:40.687136  9632 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.707346  8114 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.845436  9702 raft_consensus.cc:993] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:40.845968  9538 raft_consensus.cc:1081] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:40.847666  8209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39252
I20260709 13:01:40.848407  8209 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.848760  8209 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.854116  8209 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.855721  8209 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:40.856666  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:40.856930  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:40.857254  8285 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:40.857594  8285 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:40.857441  8898 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.858927  8285 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.860101  8285 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.863524  8898 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:40.864889  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:40.865180  8285 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:40.866217  9642 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:40.867430  9642 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:40.868686  9642 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:40.879101  8114 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.026489  9714 raft_consensus.cc:993] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:41.026901  9714 raft_consensus.cc:1081] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Signalling peer ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:41.028141  8367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:42830
I20260709 13:01:41.028654  8367 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:41.028960  8367 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.034739  8367 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:41.036630  8367 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:41.037241  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:41.037765  8209 raft_consensus.cc:3055] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:41.037971  8209 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:41.038234  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:41.038763  8285 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.038648  8209 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:41.039525  8209 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.045116  8209 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:41.045109  8285 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:41.046312  8332 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:41.046957  9733 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:41.047377  9733 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:41.048010  9733 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:41.062661  8114 catalog_manager.cc:5697] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 3, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.163190  8367 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:41.164436  9632 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:41.182200  8209 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:41.194818  9730 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:41.427070  8896 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:41.428144  9714 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:41.440882  8284 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:41.442658  9714 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:41.532790  8363 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:41.539228  8285 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:01:41.539531  8332 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13996684f22f4504bbd9a98a387657e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:41.541154  9736 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:41.542135  8209 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:41.543673  9736 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:41.548771  9736 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:41.550480  8285 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:41.551585  8209 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:41.566954  8285 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:41.570124  8115 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
W20260709 13:01:41.584754  8258 consensus_peers.cc:597] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d19654c841264233b661225cdb0ef14b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:41.587255  8363 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:41.589715  8209 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:41.591416  9538 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:41.595268  9702 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:41.608203  9702 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:41.609993  8367 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:41.622581  8214 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:41.623617  8209 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:41.626659  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:41.633065  8115 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 5, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
W20260709 13:01:41.649288  8183 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d01b1e9908444e55b2b779bb7a18324a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:41.653578  8285 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:41.655284  8367 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:41.657015  9757 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:41.657371  8101 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer ca43983edda443fa9d74c1f80252f1fc from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:41.658306  9642 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:41.668094  9757 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:41.671198  8284 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:41.673930  9761 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:41.682322  8361 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:41.693706  8285 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
W20260709 13:01:41.711117  8164 auto_rebalancer.cc:629] Failed to schedule move for tablet 768b3b358c7c4b1fbbf348a322e1e144: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:41.724170  8115 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.726567  8209 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:41.733906  9736 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:42.002840  9779 ts_tablet_manager.cc:933] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:42.004393  9779 tablet_copy_client.cc:323] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:42.005905  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet 13996684f22f4504bbd9a98a387657e7 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:42.006560  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet 13996684f22f4504bbd9a98a387657e7 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-13996684f22f4504bbd9a98a387657e7
I20260709 13:01:42.012777  8376 tablet_copy_source_session.cc:215] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:42.015635  9779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13996684f22f4504bbd9a98a387657e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:42.031625  9779 tablet_copy_client.cc:806] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:42.032950  9779 tablet_copy_client.cc:670] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:42.040009  9779 tablet_copy_client.cc:538] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:42.053516  9779 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:42.078198  9779 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:42.079102  9779 tablet_bootstrap.cc:492] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:42.079950  9779 ts_tablet_manager.cc:1403] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.009s
I20260709 13:01:42.080152  9782 ts_tablet_manager.cc:933] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:42.083148  9779 raft_consensus.cc:359] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:42.084022  9779 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:42.084630  9779 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:42.088250  9779 ts_tablet_manager.cc:1434] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:01:42.094102  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-13996684f22f4504bbd9a98a387657e7 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:42.094564  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-13996684f22f4504bbd9a98a387657e7 on tablet 13996684f22f4504bbd9a98a387657e7 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:42.097507  9782 tablet_copy_client.cc:323] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:42.099225  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet d19654c841264233b661225cdb0ef14b from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:42.099753  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet d19654c841264233b661225cdb0ef14b from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-d19654c841264233b661225cdb0ef14b
I20260709 13:01:42.107676  8303 tablet_copy_source_session.cc:215] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:42.112115  9782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19654c841264233b661225cdb0ef14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:42.131742  9782 tablet_copy_client.cc:806] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:42.132524  9782 tablet_copy_client.cc:670] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:42.137213  9782 tablet_copy_client.cc:538] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:42.139219  9779 ts_tablet_manager.cc:933] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:42.151427  9782 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:42.151949  9779 tablet_copy_client.cc:323] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:42.153878  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet d01b1e9908444e55b2b779bb7a18324a from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:42.154455  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet d01b1e9908444e55b2b779bb7a18324a from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-d01b1e9908444e55b2b779bb7a18324a
I20260709 13:01:42.162362  8228 tablet_copy_source_session.cc:215] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:42.167340  9779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01b1e9908444e55b2b779bb7a18324a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:42.185310  9782 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:42.186305  9782 tablet_bootstrap.cc:492] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:42.186954  9782 ts_tablet_manager.cc:1403] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.008s
I20260709 13:01:42.203761  9782 raft_consensus.cc:359] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:42.204924  9782 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:42.205837  9782 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:42.208536  9782 ts_tablet_manager.cc:1434] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 13:01:42.210827  8303 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-d19654c841264233b661225cdb0ef14b received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:42.211290  8303 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-d19654c841264233b661225cdb0ef14b on tablet d19654c841264233b661225cdb0ef14b with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:42.213167  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:42.216095  9779 tablet_copy_client.cc:806] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:42.216763  9779 tablet_copy_client.cc:670] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:42.236914  9779 tablet_copy_client.cc:538] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:42.251334  9779 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:42.282188  9779 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:42.283164  9779 tablet_bootstrap.cc:492] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:42.283829  9779 ts_tablet_manager.cc:1403] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.004s
I20260709 13:01:42.286628  9779 raft_consensus.cc:359] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:42.287485  9779 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:42.288100  9779 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:42.291950  9779 ts_tablet_manager.cc:1434] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:42.295351  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-d01b1e9908444e55b2b779bb7a18324a received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:42.295835  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-d01b1e9908444e55b2b779bb7a18324a on tablet d01b1e9908444e55b2b779bb7a18324a with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:42.327307  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:42.327898  8214 raft_consensus.cc:606] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:42.330996  8361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:42.331544  8361 raft_consensus.cc:606] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:42.332552  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:42.333633  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:42.480357  9736 raft_consensus.cc:993] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:42.480950  9761 raft_consensus.cc:1081] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:01:42.482321  8209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39256
I20260709 13:01:42.482734  8209 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:42.482988  8209 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.488622  8209 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:42.491463  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:42.492136  8898 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.491312  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:42.492986  8361 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:42.493139  8209 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:42.493311  8361 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:42.494236  8361 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:42.495216  8361 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.498639  8898 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:42.499928  8183 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:42.500075  8361 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:42.500782  9757 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:42.501264  9757 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:42.502053  9757 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:42.520803  9756 raft_consensus.cc:993] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:42.521440  9756 raft_consensus.cc:1081] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:42.523164  8284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:42.523747  8284 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:42.524077  8284 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.528342  8112 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.530903  8284 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:42.533716  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:42.533859  8284 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:42.534308  8209 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:42.534619  8209 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:42.534878  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:42.535396  8361 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.535478  8209 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:42.536559  8209 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.546132  8361 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:42.548314  8259 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:42.549161  9538 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:42.549590  9538 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:42.551964  8209 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:42.551394  9538 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:42.564675  8115 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.612877  8898 raft_consensus.cc:1217] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:42.623631  8898 raft_consensus.cc:1217] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:01:42.759927  8896 raft_consensus.cc:1217] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:43.053277  8363 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:43.054828  9788 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:43.069461  8896 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:43.072773  9788 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:43.102291  9538 raft_consensus.cc:1064] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:43.105043  9538 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:43.138550  8363 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:43.139204  8896 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:43.140273  8209 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:43.140952  9801 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:43.142935  9801 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:43.144992  9771 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:43.169116  8361 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.171737  9771 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.175869  8212 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.184269  9771 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.192392  9801 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.207547  9798 raft_consensus.cc:1064] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:43.211365  9798 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:43.218711  9736 raft_consensus.cc:1064] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:43.223057  8212 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.227742  9736 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:43.248234  8898 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:43.323945  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 44781.3us
I20260709 13:01:43.303805  8112 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.334494  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:43.400960  8898 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:43.402738  9820 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:43.490152  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 84353.7us
W20260709 13:01:43.486930  9816 log.cc:927] Time spent T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:01:43.517629  9809 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:01:43.552269  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 121949us
W20260709 13:01:43.547258  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 213635us
I20260709 13:01:43.562680  8212 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:01:43.566608  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 75524.9us
I20260709 13:01:43.579155  8361 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.604127  8365 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:43.611225  9798 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:43.612807  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 290934us
I20260709 13:01:43.615872  8285 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:43.612810  8284 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:43.629426  8898 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:43.662949  9736 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:43.660315  9834 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:01:43.669652  9818 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 13:01:43.689872  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 75377.5us
I20260709 13:01:43.726167  9821 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:01:43.739461  9788 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.740690  8284 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.759404  8898 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.765800  8361 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:01:43.777280  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 67328.9us
I20260709 13:01:43.778975  8285 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:43.786669  8116 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.798172  8897 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:43.800002  9842 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:43.808699  8367 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:43.811538  8212 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:43.812671  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 93937.8us
I20260709 13:01:43.821033  8896 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:43.821707  8284 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:43.823274  9839 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:43.825224  9838 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:43.827764  9833 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:43.832399  9834 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.833998  8284 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.855903  9837 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.858510  8894 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.869728  8896 raft_consensus.cc:2955] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.866770  8114 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 1 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.887332  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d19654c841264233b661225cdb0ef14b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:43.892491  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d01b1e9908444e55b2b779bb7a18324a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:43.896301  8365 raft_consensus.cc:2955] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.908355  9736 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.912760  8285 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.926613  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet d01b1e9908444e55b2b779bb7a18324a with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:43.932649  9854 tablet_replica.cc:333] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:43.933908  9854 raft_consensus.cc:2243] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.934767  9854 raft_consensus.cc:2272] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.934947  8212 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.938021  9854 ts_tablet_manager.cc:1916] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:43.939447  8115 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 6 to 7, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.945320  8894 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.957491  8112 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:43.966101  9854 ts_tablet_manager.cc:1929] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:43.966665  9854 log.cc:1199] T d01b1e9908444e55b2b779bb7a18324a P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/d01b1e9908444e55b2b779bb7a18324a
I20260709 13:01:43.968964  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet d01b1e9908444e55b2b779bb7a18324a (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:43.970505  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet d19654c841264233b661225cdb0ef14b with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:43.997803  8367 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:44.001670  9855 tablet_replica.cc:333] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:44.005836  8212 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:44.007308  9849 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:44.008726  8897 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:44.016232  9815 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:44.020491  9849 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:44.023036  9855 raft_consensus.cc:2243] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.025698  9855 raft_consensus.cc:2272] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.025825  8212 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:44.027894  8897 raft_consensus.cc:2955] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:44.112092  9855 ts_tablet_manager.cc:1916] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:44.125545  8112 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 4 to 5, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 2 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:44.133421  9855 ts_tablet_manager.cc:1929] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:01:44.134183  9855 log.cc:1199] T d19654c841264233b661225cdb0ef14b P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/d19654c841264233b661225cdb0ef14b
I20260709 13:01:44.136269  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet d19654c841264233b661225cdb0ef14b (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:44.144639  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet 13996684f22f4504bbd9a98a387657e7 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:44.180539  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13996684f22f4504bbd9a98a387657e7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:44.199667  9856 tablet_replica.cc:333] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:44.207057  9856 raft_consensus.cc:2243] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.212611  9856 raft_consensus.cc:2272] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.216825  9856 ts_tablet_manager.cc:1916] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:44.234768  9856 ts_tablet_manager.cc:1929] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:44.235185  9856 log.cc:1199] T 13996684f22f4504bbd9a98a387657e7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/13996684f22f4504bbd9a98a387657e7
I20260709 13:01:44.236654  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet 13996684f22f4504bbd9a98a387657e7 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:44.505277  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:44.553454  8284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:44.554497  8284 raft_consensus.cc:606] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:44.561079  8212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:44.561851  8212 raft_consensus.cc:606] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:44.563521  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:44.564774  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:44.626902  9838 raft_consensus.cc:993] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:44.627671  9839 raft_consensus.cc:1081] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Signalling peer ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:44.630133  8365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:42830
I20260709 13:01:44.630700  8365 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:44.632278  8365 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:44.641053  8365 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:44.642654  8365 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:44.643541  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:44.644099  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:44.644318  8212 raft_consensus.cc:3055] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:44.644621  8285 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:44.644654  8212 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:44.645695  8212 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:44.647190  8212 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:44.654647  8285 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:44.656404  8332 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:44.657295  9761 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:44.657755  9761 raft_consensus.cc:697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:44.657836  8212 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:44.658847  9761 consensus_queue.cc:237] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:44.677325  8112 catalog_manager.cc:5697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.901103  9858 raft_consensus.cc:993] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:44.901750  9538 raft_consensus.cc:1081] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:44.903268  8897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:01:44.903683  8897 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:44.903923  8897 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.909297  8897 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:44.911557  8897 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:44.913275  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:44.913895  8212 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.913962  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:44.914635  8285 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:44.914947  8285 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:44.915742  8285 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:44.917081  8285 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.922374  8212 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:44.923491  8862 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:44.923640  8285 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:44.924376  9829 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.924749  9829 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:44.925691  9829 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:44.938529  8112 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.130533  8212 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:45.131752  8285 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:45.131939  9864 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:45.134583  9849 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:45.239851  8365 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:45.247462  8285 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:45.248106  8332 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c777a0028400426e8927312e58b8d1c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:45.249250  8211 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:45.249586  9849 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:45.250926  9761 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:45.259068  9761 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.269101  8285 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.272215  8211 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.289722  8114 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 2, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.290023  8211 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:45.303073  8365 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:01:45.305420  8183 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f92a5d6830044936958a95556af24660. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:45.306381  9839 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:45.307061  8285 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:45.309067  9839 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:45.321760  8365 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.319752  9839 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.324546  8284 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.341681  8116 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index -1 to 4, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.342504  8284 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:45.359391  8365 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:01:45.359720  8258 consensus_peers.cc:597] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58573b7fd6d5467ea27aa5185d42aed7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:45.361294  9842 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:45.365646  8211 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:45.369210  9538 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:45.378211  9842 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.380030  8365 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.382782  8211 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.398823  8284 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:45.399942  8116 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.413968  8211 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:45.414115  8367 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:45.415079  8284 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:45.416244  9858 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:45.416404  9829 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:01:45.419750  8258 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54b37780d9694d53a9aa75ce1f7515b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:45.424482  9538 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:45.433532  9842 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.440573  8367 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.454476  8211 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.468158  8212 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:45.469233  8114 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index -1 to 3, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:45.471280  9830 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:45.567144  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:45.713008  9891 ts_tablet_manager.cc:933] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:01:45.718899  9891 tablet_copy_client.cc:323] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.1:41893
I20260709 13:01:45.720980  8228 tablet_copy_service.cc:140] P ca43983edda443fa9d74c1f80252f1fc: Received BeginTabletCopySession request for tablet f92a5d6830044936958a95556af24660 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:39866)
I20260709 13:01:45.721546  8228 tablet_copy_service.cc:161] P ca43983edda443fa9d74c1f80252f1fc: Beginning new tablet copy session on tablet f92a5d6830044936958a95556af24660 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:39866: session id = 4a50f39e2d8e4886a79849938f2272a6-f92a5d6830044936958a95556af24660
I20260709 13:01:45.730288  8228 tablet_copy_source_session.cc:215] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:45.733650  9891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92a5d6830044936958a95556af24660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.751672  9891 tablet_copy_client.cc:806] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:45.752450  9891 tablet_copy_client.cc:670] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:45.762177  9891 tablet_copy_client.cc:538] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:45.774814  9891 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:45.807411  9891 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:45.808808  9891 tablet_bootstrap.cc:492] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:45.809626  9891 ts_tablet_manager.cc:1403] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.006s
I20260709 13:01:45.813380  9891 raft_consensus.cc:359] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:45.814442  9891 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:45.815088  9891 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:45.817730  9891 ts_tablet_manager.cc:1434] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:45.820358  8228 tablet_copy_service.cc:342] P ca43983edda443fa9d74c1f80252f1fc: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-f92a5d6830044936958a95556af24660 received from {username='slave'} at 127.0.0.1:39866
I20260709 13:01:45.820799  8228 tablet_copy_service.cc:434] P ca43983edda443fa9d74c1f80252f1fc: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-f92a5d6830044936958a95556af24660 on tablet f92a5d6830044936958a95556af24660 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:45.823671  9893 ts_tablet_manager.cc:933] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:45.836174  9893 tablet_copy_client.cc:323] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.3:37337
I20260709 13:01:45.838160  8376 tablet_copy_service.cc:140] P ee13752324154b1293a47c9dcd8d6ba5: Received BeginTabletCopySession request for tablet c777a0028400426e8927312e58b8d1c5 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:51072)
I20260709 13:01:45.838752  8376 tablet_copy_service.cc:161] P ee13752324154b1293a47c9dcd8d6ba5: Beginning new tablet copy session on tablet c777a0028400426e8927312e58b8d1c5 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:51072: session id = 4a50f39e2d8e4886a79849938f2272a6-c777a0028400426e8927312e58b8d1c5
I20260709 13:01:45.847754  8376 tablet_copy_source_session.cc:215] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:45.851423  9893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c777a0028400426e8927312e58b8d1c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.869627  9893 tablet_copy_client.cc:806] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:45.870234  9893 tablet_copy_client.cc:670] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:45.874143  9893 tablet_copy_client.cc:538] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:45.882411  9893 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:45.883786  9891 ts_tablet_manager.cc:933] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:45.898728  9891 tablet_copy_client.cc:323] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:45.900981  8303 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet 58573b7fd6d5467ea27aa5185d42aed7 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:45.901476  8303 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet 58573b7fd6d5467ea27aa5185d42aed7 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-58573b7fd6d5467ea27aa5185d42aed7
I20260709 13:01:45.909900  8303 tablet_copy_source_session.cc:215] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:45.910125  9893 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:45.911160  9893 tablet_bootstrap.cc:492] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:45.911906  9893 ts_tablet_manager.cc:1403] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.004s
I20260709 13:01:45.913625  9891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58573b7fd6d5467ea27aa5185d42aed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.915421  9893 raft_consensus.cc:359] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:45.916343  9893 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:45.916988  9893 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:45.923722  9893 ts_tablet_manager.cc:1434] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 13:01:45.925508  8376 tablet_copy_service.cc:342] P ee13752324154b1293a47c9dcd8d6ba5: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-c777a0028400426e8927312e58b8d1c5 received from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:45.925982  8376 tablet_copy_service.cc:434] P ee13752324154b1293a47c9dcd8d6ba5: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-c777a0028400426e8927312e58b8d1c5 on tablet c777a0028400426e8927312e58b8d1c5 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:45.937816  9893 ts_tablet_manager.cc:933] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:45.944042  9891 tablet_copy_client.cc:806] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:45.944686  9891 tablet_copy_client.cc:670] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:45.947455  9893 tablet_copy_client.cc:323] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:45.966820  8302 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet 54b37780d9694d53a9aa75ce1f7515b4 from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:45.967417  8302 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet 54b37780d9694d53a9aa75ce1f7515b4 from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-54b37780d9694d53a9aa75ce1f7515b4
I20260709 13:01:45.969026  9891 tablet_copy_client.cc:538] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:45.976457  9891 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:45.976828  8302 tablet_copy_source_session.cc:215] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:45.980108  9893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b37780d9694d53a9aa75ce1f7515b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.002596  9891 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:46.003687  9891 tablet_bootstrap.cc:492] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:46.004483  9891 ts_tablet_manager.cc:1403] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.003s
I20260709 13:01:46.006104  9893 tablet_copy_client.cc:806] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:46.006922  9893 tablet_copy_client.cc:670] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:46.007892  9891 raft_consensus.cc:359] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:46.008916  9891 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:46.009693  9891 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:46.011900  9891 ts_tablet_manager.cc:1434] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:46.014894  9893 tablet_copy_client.cc:538] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:46.027675  9893 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:46.041136  8302 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-58573b7fd6d5467ea27aa5185d42aed7 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:46.041668  8302 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-58573b7fd6d5467ea27aa5185d42aed7 on tablet 58573b7fd6d5467ea27aa5185d42aed7 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:46.064236  9893 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:46.065167  9893 tablet_bootstrap.cc:492] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:46.065760  9893 ts_tablet_manager.cc:1403] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.003s
I20260709 13:01:46.068521  9893 raft_consensus.cc:359] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:46.069339  9893 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:46.069970  9893 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:46.074579  9893 ts_tablet_manager.cc:1434] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:01:46.078462  8302 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-54b37780d9694d53a9aa75ce1f7515b4 received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:46.078965  8302 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-54b37780d9694d53a9aa75ce1f7515b4 on tablet 54b37780d9694d53a9aa75ce1f7515b4 with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:46.105021  8894 raft_consensus.cc:1217] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:01:46.313944  8897 raft_consensus.cc:1217] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:46.367805  8894 raft_consensus.cc:1217] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:46.531545  8897 raft_consensus.cc:1217] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:46.623557  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:46.673583  8367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:01:46.674096  8367 raft_consensus.cc:606] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:46.675266  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:01:46.676344  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:46.729764  9877 raft_consensus.cc:1064] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:46.733003  9877 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:46.740593  8367 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:46.741981  9905 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:46.741989  8897 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEARNER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:46.743093  8284 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:46.744417  9905 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:46.746485  9877 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:46.760110  9877 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.763698  8894 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.765275  9858 raft_consensus.cc:1064] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:46.765588  8367 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.767910  9858 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:46.790277  9761 raft_consensus.cc:1064] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:46.793036  9761 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:46.801020  8113 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 4 to 5, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.814033  8894 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 LEARNER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:46.815294  8212 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:46.815462  8284 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:46.816056  8289 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.818377  8894 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:46.819730  9842 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:46.823230  9873 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:46.825342  9873 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:46.829000  8209 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:46.834187  9864 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:46.837297  8365 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:46.840292  9858 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:01:46.849169  9538 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:46.878746  9761 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.885268  8897 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.913247  8896 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.939816  9842 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.945389  8367 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.966842  8212 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:46.977245  9842 raft_consensus.cc:1064] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:46.997879  8285 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.011811  9842 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:47.035791  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 58935.7us
I20260709 13:01:47.043530  8212 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.053453  8896 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:47.055783  8214 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:47.056059  9842 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:01:47.058449  9919 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:47.061918  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 99960.2us
I20260709 13:01:47.073082  9761 raft_consensus.cc:993] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:47.073709  9873 raft_consensus.cc:1081] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:47.075838  8285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60542
I20260709 13:01:47.076356  8285 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.076694  8285 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.093060  8285 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:47.100867  8214 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:47.108306  8365 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:47.114216  8894 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:47.113452  9910 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:47.119257  9910 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:47.128302  8115 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 2 to 3, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.132707  8115 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.124128  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:47.135728  9903 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.136807  8214 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.137600  8897 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.145705  8214 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:47.147419  8101 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f92a5d6830044936958a95556af24660 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:01:47.210310  8101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 63003us
I20260709 13:01:47.211011  8257 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:47.152844  8367 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:47.155483  8285 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:47.162128  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:47.172588  8289 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:47.212738  8361 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.213060  8361 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:47.213740  8361 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:47.214850  8361 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.182905  8363 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:47.186671  8112 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index 5 to 6, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.150215  8365 raft_consensus.cc:2955] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.228363  8361 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:47.239627  8209 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:47.240284  9926 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.240844  9926 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:47.241755  9926 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:47.258313  8894 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:47.260026  9924 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:47.276968  9761 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:47.282450  8897 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:47.286132  9761 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:47.289266  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 79404.4us
I20260709 13:01:47.298444  9926 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:47.316834  9899 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.320029  8361 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:47.320299  8112 catalog_manager.cc:5697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.325832  8209 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.325562  9924 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.350528  8278 tablet_service.cc:1558] Processing DeleteTablet for tablet f92a5d6830044936958a95556af24660 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:47.355652  9919 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:47.341373  8894 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.359953  8365 raft_consensus.cc:2955] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.362382  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c777a0028400426e8927312e58b8d1c5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:47.367811  9922 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.377923  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58573b7fd6d5467ea27aa5185d42aed7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:47.394425  8112 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New cstate: current_term: 1 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.396337  8115 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 4 to 5, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.399294  8212 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.407490  8894 raft_consensus.cc:2955] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.426043  8277 tablet_service.cc:1558] Processing DeleteTablet for tablet c777a0028400426e8927312e58b8d1c5 with delete_type TABLET_DATA_TOMBSTONED (TS ecc8d80ac6df4f5b95c8befae4d08ed0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60530
I20260709 13:01:47.427812  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 58573b7fd6d5467ea27aa5185d42aed7 with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:39240
I20260709 13:01:47.430389  9936 tablet_replica.cc:333] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:47.431445  9936 raft_consensus.cc:2243] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.432257  9936 raft_consensus.cc:2272] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.443437  8897 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.445595  9936 ts_tablet_manager.cc:1916] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:47.449553  8365 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.450716  8112 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 3 to 4, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.475193  8285 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:47.494881  8209 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:47.497141  9538 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:47.504611  9538 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.508785  8898 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:47.510144  8209 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.512259  9923 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:47.515934  9936 ts_tablet_manager.cc:1929] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:01:47.516445  9936 log.cc:1199] T f92a5d6830044936958a95556af24660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/f92a5d6830044936958a95556af24660
I20260709 13:01:47.518465  9936 tablet_replica.cc:333] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:01:47.517946  8898 raft_consensus.cc:2955] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:47.520062  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet f92a5d6830044936958a95556af24660 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:47.536317  9939 tablet_replica.cc:333] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:01:47.537866  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 54b37780d9694d53a9aa75ce1f7515b4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:47.538990  9939 raft_consensus.cc:2243] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.539739  9939 raft_consensus.cc:2272] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.549451  8115 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 4 to 5, VOTER ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) evicted. New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.558408  9939 ts_tablet_manager.cc:1916] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:47.562721  9936 raft_consensus.cc:2243] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.563594  9936 raft_consensus.cc:2272] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.567301  8353 tablet_service.cc:1558] Processing DeleteTablet for tablet 54b37780d9694d53a9aa75ce1f7515b4 with delete_type TABLET_DATA_TOMBSTONED (TS ee13752324154b1293a47c9dcd8d6ba5 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42812
I20260709 13:01:47.566818  9936 ts_tablet_manager.cc:1916] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:47.570331  9940 tablet_replica.cc:333] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:01:47.571429  9940 raft_consensus.cc:2243] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.572180  9940 raft_consensus.cc:2272] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.575829  9940 ts_tablet_manager.cc:1916] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:47.584812  9939 ts_tablet_manager.cc:1929] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:47.585287  9939 log.cc:1199] T 58573b7fd6d5467ea27aa5185d42aed7 P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/58573b7fd6d5467ea27aa5185d42aed7
I20260709 13:01:47.588477  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 58573b7fd6d5467ea27aa5185d42aed7 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:47.592320  9936 ts_tablet_manager.cc:1929] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:47.592805  9936 log.cc:1199] T c777a0028400426e8927312e58b8d1c5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/wals/c777a0028400426e8927312e58b8d1c5
I20260709 13:01:47.594416  8102 catalog_manager.cc:5028] TS ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): tablet c777a0028400426e8927312e58b8d1c5 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:47.601608  9940 ts_tablet_manager.cc:1929] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:47.602206  9940 log.cc:1199] T 54b37780d9694d53a9aa75ce1f7515b4 P ee13752324154b1293a47c9dcd8d6ba5: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/wals/54b37780d9694d53a9aa75ce1f7515b4
I20260709 13:01:47.604167  8103 catalog_manager.cc:5028] TS ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): tablet 54b37780d9694d53a9aa75ce1f7515b4 (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
I20260709 13:01:47.632226  8209 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:47.633327  9923 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:47.639132  8365 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:47.641315  9922 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:47.677592  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:49.652765  9949 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:49.653513  9949 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:49.656179  9949 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:49.657521  9949 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:49.658154  9949 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:49.660807  9949 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:49.810221  9957 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:49.811139  9957 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:49.814751  9957 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:49.874436  9952 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.005607  9955 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.006162  9952 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.009021  9952 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:49.890801  9956 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.013404  9956 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.016537  9956 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:49.995743  9963 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:49.997130  9960 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.001027  9959 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:49.897984  9949 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.017957  9964 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.019335  9957 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.022580  9954 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.026612  9958 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.052208  9966 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.060140  9965 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.067477  9962 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.071812  9970 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.072422  9972 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.077605  9952 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.079484  9955 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.090951  9975 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:01:50.096973  8181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.019s	sys 0.022s
I20260709 13:01:50.103024  9968 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.103811  9977 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.109603  9971 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.097010  9979 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.095645  9960 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.110523  9966 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.110953  9954 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.093842  9956 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:01:50.152932  8181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.022s	sys 0.025s
I20260709 13:01:50.169764  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:50.126283  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:50.204753  8287 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
I20260709 13:01:50.210407  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:50.211061  8897 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:50.101879  9967 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.222353  9953 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.106245  9957 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.097325  9959 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.106405  9958 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.102100  9949 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.102424  9964 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.181797  9952 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.187079  9956 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.116745  9965 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.097579  9963 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.154621  9962 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.168884  9975 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.278066  9975 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.278609  9975 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.158766  9970 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.169129  9977 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.187450  9968 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.185945  9972 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.158408  9971 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.195078  9979 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.279731  9973 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.279078  9975 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.313773  9977 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.302505  9961 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.259508  9953 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.279368  9981 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.328527  9953 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.278066  9960 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.325150  9986 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.250515  9967 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.331818  9967 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:50.323530  9984 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.327059  9961 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.279215  9976 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.342586  9990 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.343462  9966 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:50.314534  9968 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.342764  9982 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.314692  9983 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.319021  9979 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.343307  9990 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.328632  9981 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.395924  9993 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.400460  9985 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.401058  9974 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.329416  9986 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.351403  9977 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.423369  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.337692  9984 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.433594 10005 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.418905  9999 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.354132  9960 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.383088  9967 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.432915  8361 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:50.444410 10001 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.467440  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.323544  9973 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.470374  9967 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:50.448472  8101 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer ca43983edda443fa9d74c1f80252f1fc from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:50.463845  9991 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.464218  9958 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.445689 10003 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.470855 10004 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.434365 10005 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.472561  9977 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.425010  9956 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.406810  9959 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.409106  9965 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.422320  9953 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.422451  9980 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.482227  9962 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.469635  9960 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.488992  9964 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.464939  9955 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.511771  9987 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.490746  9958 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.414934  9996 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.474385  9952 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.344471  9976 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.516932  9956 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.518543  9959 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.561259  9970 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.561048  9956 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.561777  9972 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.523656  9977 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.524036  9965 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.473820  9971 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.489723  9990 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.522974  9953 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.424045  9983 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.434794  9999 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.482093  9989 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:01:50.550803  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 148702us
I20260709 13:01:50.560504  9984 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:50.560681  9960 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.560943  9987 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.531435  9967 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:50.535056  9964 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.617189  9964 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.524356  9973 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.601675  9981 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.561269  9959 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.611528  9977 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.482787  9974 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.517722  9991 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.561374  9963 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.523213  9980 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.470173  9985 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.542958  9958 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.413280  9982 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.562899  9975 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.478790  9993 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.519017 10004 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.482545 10001 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.627033  9998 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.628110  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.517634 10003 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.617960  9976 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.603749  9965 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.564656  9996 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.627269  9997 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:01:50.744285  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 128442us
I20260709 13:01:50.620417  9972 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.622305  9990 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.708587  9986 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:50.613970  9994 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.625900  9956 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.755230  9983 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.765157  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:50.748705  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.636814  9966 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.678653  9977 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.756379  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.756693  9987 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.729622  9988 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.723275 10010 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.729012  9952 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:50.757412  9958 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.760399  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.727959 10005 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.628749  9961 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.703227  9999 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.764117  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:50.749043  9963 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.768229  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.771108  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.771592  9966 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.756735  9953 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.735317 10009 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.771974 10002 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.750492  9972 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.756413  9998 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.773332  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.851584  8361 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:50.852736  8215 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:50.854652  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.829694  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.854779  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.856475  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.856647  8215 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:50.629938  9989 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.852375  8365 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:50.844973  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.787436  8211 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:50.765688  9994 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.816673 10001 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.787276  9987 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.870780  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.767481  9964 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:50.813541  9980 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.849316  9959 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.818449  9993 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.835070  9955 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.858809  9986 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:50.868799  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.847455  9974 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:50.749112  9997 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.836139 10013 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.839260  9982 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.762741  9990 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.866945  8257 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:50.837843 10003 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.815086 10004 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.836506  9996 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.869535  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.882241  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.847644  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.871089  9987 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.874877  9955 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.887991  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.868710  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.895009  9977 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.865547  9985 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:50.860641  9952 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.898439  8361 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:01:50.860466  9963 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.860528 10002 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.886348  9965 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.914201  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.909545  8366 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:50.899994 10003 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.912361  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.911531  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.908057  9966 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.888870  9986 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.905920  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.907605  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.869292  9988 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.908420  8360 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:50.861152 10009 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.913786  9972 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:50.915527 10003 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:50.938265  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.905884 10013 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:50.874277 10010 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:50.953171  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.039671  8284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b137d34f34145b18037845635e297eb"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:59426
I20260709 13:01:50.990574  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.075330  8284 raft_consensus.cc:606] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:51.075734  8209 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:51.028126  8289 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:50.916379  9987 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.084470  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.087774  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.084105  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.042872  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.072738  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:50.951323  8211 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:51.078230 10002 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:50.936584  9989 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.078405 10003 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.989784 10011 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.094151  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.095085  8365 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:51.040598 10006 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:51.042299  9999 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:51.077348  9955 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.023366  9958 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:50.936875 10015 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.097457  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.099066  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.100167  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:50.982206  9991 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.089135  9986 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.038921  9998 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.073405  9994 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.103902  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.092880  9963 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.023887 10017 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.114682 10014 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.114818  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.101895 10006 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.101117  9999 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.104914  9958 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.138253 10013 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.116853  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.113692  9955 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:51.116676 10015 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.128465  9988 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.155874  9997 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.139631  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.154389  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.156965  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.150939  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:51.151044  9990 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.158476  8365 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
W20260709 13:01:51.167919  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 69706.1us
I20260709 13:01:51.169986  8331 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:51.171568  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.160385  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.181900  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.180774  8358 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:51.157584  9999 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.157462  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.127981 10010 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.183728  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.136484 10009 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.136286 10011 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.160818  9958 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.168757  9973 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.180774  9987 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.139683 10014 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.200059  9987 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.121413 10016 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:51.176785  9988 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.158190  9955 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.199609  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.196323  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.130308 10017 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.200285 10019 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.206647 10019 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.207031 10019 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.207142  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.200521  9987 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.200297 10015 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.210871  9955 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.213304 10011 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.202505  9973 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.207187  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.203258  9988 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.219959 10017 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.222266  9973 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.220943  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.217478 10006 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:51.224073  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 44888.2us
I20260709 13:01:51.225560  9949 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.230937  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.233093  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.231869  8211 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:51.209762 10016 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.240185  9988 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.241097  9987 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.242228 10003 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.243492  9987 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.244160 10003 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.234516 10014 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.245184  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.245926 10016 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.238932  8211 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:51.246465  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:51.251545 10019 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.253715  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 363) took 1129 ms. Trace:
I20260709 13:01:51.253690 10019 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.254406  8287 rpcz_store.cc:276] 0709 13:01:50.125650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.125882 (+   232us) service_pool.cc:224] Handling call
0709 13:01:51.253531 (+1127649us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b540041d054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:01:51.253639 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53388160}
I20260709 13:01:51.257076  9957 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:51.260763  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 624252us
I20260709 13:01:51.267062  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.267719  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.268306  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.268682  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.268843  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.268729  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.270113  9954 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.271732  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.273187  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.273803  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.274856  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.277293  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.278435  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.280437  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.280496  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.281726  8289 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:51.283912  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.284436  8287 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 2: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:01:51.279784  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.287382  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:01:51.289160  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:51.290655  8284 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.290920  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.292122  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.292284  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.292482  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.294617  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.295446  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.295590  9976 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.296156  9976 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.296911  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.298271  9976 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.298759  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.299022  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.293126  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.300513  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.302636  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.302840  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.303313  8892 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:51.304852  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.304244  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.306339  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.308671  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:01:51.308414  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 83818.3us
I20260709 13:01:51.310226  8896 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
W20260709 13:01:51.310462  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 49060.1us
I20260709 13:01:51.312389  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:51.313289  9994 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.313812  9994 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:51.314184  9994 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.315868  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.317593  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:51.320837  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:51.322944  8184 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:01:51.325230  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.323555  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.326447  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.326810  8257 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:51.327472  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.328533  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.329932  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.330971  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.323832  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.332434  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.332952  8289 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
I20260709 13:01:51.323738  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.333937  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.323414  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.326463  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.324054  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.336925  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.324400  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.338294  9972 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.338714  9972 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.339092  9972 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.339691  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.340353  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.341099  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.343592  8184 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.343904  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.342399  9994 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.344280  8896 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:51.347172  9994 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.351670  8331 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:51.354451  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.354903  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.355381  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.355573  8894 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:51.355895  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:51.356526  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.357656  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.358304  9972 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.358790  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.359303  9998 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.359660  9998 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.360021  9998 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.360139  9995 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.360548  9995 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.360911  9995 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.354487  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.328737  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 520) took 1143 ms. Trace:
I20260709 13:01:51.363965  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.358369  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.319175  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.366243  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:51.367142  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 49618.6us
I20260709 13:01:51.369092  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.369572 10006 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.369967 10006 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.370374 10006 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.372500  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:51.367403  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.373629  9956 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.374015  9956 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.374184  9954 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.374397  9956 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.374675  9954 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.374837  9957 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.375123  9954 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.375932  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:51.376880  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:51.378463  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.364014  8898 rpcz_store.cc:276] 0709 13:01:50.184959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.185100 (+   141us) service_pool.cc:224] Handling call
0709 13:01:50.186253 (+  1153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.266229 (+ 79976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.266257 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.266298 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:50.266323 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.328513 (+1062190us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b5400636354. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:01:51.328557 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.328662 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183395584}
I20260709 13:01:51.379603  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.377923  8332 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:51.380096  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.380878  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.383265  9978 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.383423 10015 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.378196  9957 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:51.384788  9957 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.374243  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.386236  8184 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.386474  8893 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:51.374537  9952 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.387781  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.389483  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.390657  9978 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.391096  9978 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.390327  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.391397 10002 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.390743  9979 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.389410  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.394835  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:51.394958  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.403388  9969 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.403815  9994 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.405277  9984 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.405673  9984 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.405990  9984 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.407867 10002 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.414893 10002 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.415280 10002 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.407817 10003 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:01:51.422639  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.422772  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.424279  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:51.424443  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.428078  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:51.430696  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.434454  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.434724  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.435338  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.435953  8363 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.436439  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.436993  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.437496  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.434593  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.438526  8863 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:51.439340  9952 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.439791  9952 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.439848  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.440214  9952 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.430522  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.442005  8862 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.425534  8864 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.442950  8183 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:51.443403  8184 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.449601  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.450783  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.451182  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.451759  8896 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:51.452293  8894 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.453486  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.455060  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.455221  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.457862  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.458841  8864 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.460201  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.452762  9997 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.466674  9990 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.467115  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.453173 10022 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.469079  9963 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.469458  9963 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.469816  9963 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.458029  8863 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.472764  8864 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.473299  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.473903  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.475127  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.476460  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.477049  8864 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.474393  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.467406  8362 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:51.478014  8863 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.480011  8864 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.481400  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.448660  9960 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.456640 10007 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.478263  9973 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.456950  9981 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.456779  9994 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.470650  9989 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.474731 10022 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.484230  9991 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.485685  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.474422  9949 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.484475  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.485001  8863 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.493664  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.507618  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.507954  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.508447  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.508701  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.509029  8259 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.490213  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.510030 10024 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.511026  9960 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.511574 10019 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.493927  8184 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.484308  9996 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.500226  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.501936  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.485854  9958 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.511303  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.469745  9998 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.493110 10007 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:51.490818 10004 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.478504  9997 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.478864  9990 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.486310  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.488760  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.512926  8259 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.523231  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.522801  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.524206  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.524740  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.535609  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.493379  9979 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.496748  9981 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.515911  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.525816  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.527729  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.530301  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.503353  9972 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.504395  9991 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.538928  8897 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:51.514103 10014 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.488847 10002 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.486384  9967 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:01:51.521234  9987 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.488163  9956 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.521334 10016 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.513974  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.522985  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.528950 10007 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.525427  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.544330  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.571324  8259 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.548460  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.551036 10012 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.553409  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.521708 10018 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.558857 10025 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.559453 10000 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.559324  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.562981  9995 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.533736  9990 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.542673  9991 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.539914  9981 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:51.564538  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 81316.8us
I20260709 13:01:51.566962  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.543081  9958 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.575001  9957 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.575815  9956 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.576151 10016 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.552452  9969 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:51.578397 10002 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.551040  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.578336  9955 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:51.584715  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:51.590502  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.620584  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.590776  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.590919  9978 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.592664  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.621807  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.624588  8896 raft_consensus.cc:1240] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.577625  9952 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.595717  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:51.598811  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.600227  8889 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:01:51.578298 10014 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.604187  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.602130 10006 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.632776  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:51.633035  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.609869  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.613540  8363 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.619081  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.622134  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.603708 10025 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.607018  9990 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.631203  8862 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.635279  9973 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.640601  8361 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.635550 10006 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.626664  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.634517  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.638820  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:51.642386  8864 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.644835  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.643806  9965 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.643693  9993 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.623071  9954 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.648582  8258 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.637820  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.650379  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.650839  8258 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.651325  9958 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.656948  9989 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.639578  9969 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.656992  9998 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.659755  9998 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:51.660480  8285 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:51.653314  8258 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:51.641345 10022 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.654403 10014 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.654897  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.669761  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:51.648039 10011 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.657416  9989 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.640142 10025 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.673122  9989 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.661429  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.663403  8864 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.665397  9969 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:51.665150  8258 consensus_peers.cc:597] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Couldn't send request to peer 4a50f39e2d8e4886a79849938f2272a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 410fe3c36e834265b4c3b139e453a76e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.660902 10001 raft_consensus.cc:3055] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:51.664371  9954 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.666847  9957 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.647260 10006 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.667651  9995 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.665561  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.656708  9988 raft_consensus.cc:3055] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:51.669999 10016 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.672281 10011 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:51.674885  8183 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.675614  9973 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.675263  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:01:51.723788  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 48601.7us
I20260709 13:01:51.725260  8864 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.679569  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:51.678784 10001 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:51.727017 10001 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.728423 10001 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:51.728766  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 192271us
I20260709 13:01:51.729408  8864 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.729705  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.676261  9972 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.731078  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.735415  8864 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.731489  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.736958  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.731977 10027 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.676218  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.738272  8217 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.706212  9978 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.739912  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:51.743228  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:01:51.744248  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 64764.7us
I20260709 13:01:51.746840  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:51.720988  9988 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:51.723537 10011 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.755335  8215 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.750893  8212 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.756278  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.747792  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:51.749372  9937 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.749868 10013 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.732735  9994 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.733150  9949 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.750890 10006 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:51.752702  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.753752 10017 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:51.774384 10017 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.775013  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:51.775889 10013 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.730780 10022 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.757813  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.758791  8287 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:51.758203  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 83382.7us
I20260709 13:01:51.706552  9963 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.734829  9959 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.750304  9955 consensus_queue.cc:1059] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:51.761404  9988 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.763300  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.753957 10024 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.767477 10003 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:51.737883  9995 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.741052 10012 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.776674 10017 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.796320  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.776916  8257 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.786235  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:01:51.793394  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.791821  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.798255  8213 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.800424 10018 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:51.796324  9988 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:51.810110  8388 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3140 after lost signal to thread 7091
I20260709 13:01:51.785465 10006 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.819090  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.801229  9993 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.794901  9984 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.828491  8217 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.802609 10018 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:51.833371  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.815457  9976 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:51.836498  9976 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.839854  8183 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.816468 10017 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.843358  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.843528 10018 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.844296  9963 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.832058  9955 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:01:51.846030  8257 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:51.847407 10032 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.849790  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.836901 10009 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.851052  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:51.835286 10024 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.822666 10003 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:01:51.854660  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.850281 10017 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.856895  9956 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.846110 10027 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:51.852172  8388 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4e80 after lost signal to thread 8150
I20260709 13:01:51.864637  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.871603  8183 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.872279 10002 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.872339 10017 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.872768  8365 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.866308 10026 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.874302  8183 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.875270  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.876434 10016 raft_consensus.cc:3055] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:51.861618  9991 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.878813  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.877068 10016 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:51.888790 10016 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.879879 10026 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.888525  9955 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:51.889590  8259 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.889783 10032 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.891038 10006 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.892527 10007 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.879266 10002 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.872781 10017 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:51.895860 10017 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.896462  8891 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.897722 10009 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.895875  8213 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.894464  8209 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:51.883765  8183 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.869913  9990 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.894495  8217 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:51.848737  9981 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.904491  9954 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.905318  8895 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.906481  9981 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.901914 10000 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:51.908217  8388 debug-util.cc:398] Leaking SignalData structure 0x7b0800323900 after lost signal to thread 8242
I20260709 13:01:51.908277  9954 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:51.909369  9954 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:01:51.909508  8388 debug-util.cc:398] Leaking SignalData structure 0x7b08003383e0 after lost signal to thread 8317
I20260709 13:01:51.909878  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:51.873971 10001 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.911062  8894 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.912061  9990 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.903754  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.914011  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.915207  8183 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:51.915485  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.919260  9984 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.920284  9989 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.922971  8214 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.923110  9969 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.923939  9952 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.924360 10017 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.909714  9954 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:51.929390  8897 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.929690 10030 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.932032  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.930925  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.929991  9954 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:51.916743  9963 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.863807 10034 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.936283 10035 ts_tablet_manager.cc:933] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Initiating tablet copy from peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:51.935312  9954 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.937943  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.941144  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:51.944947  8289 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:01:51.943048  9986 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.945078  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.934371 10023 consensus_queue.cc:1059] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:51.947959  9984 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.948418  9984 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.948956  9984 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.948567  9974 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.937129 10010 consensus_queue.cc:1059] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:01:51.951803  9974 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.952239  9974 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.917011 10001 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.912665 10002 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.956283  9989 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:51.957774 10013 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:01:51.961607  8388 debug-util.cc:398] Leaking SignalData structure 0x7b0800366a80 after lost signal to thread 8391
I20260709 13:01:51.965983  8358 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.942801  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:51.976035 10010 raft_consensus.cc:3055] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:51.950244  9986 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:51.931072 10019 consensus_queue.cc:1059] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:01:51.958051  9991 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:51.965186 10013 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:51.948441 10025 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:51.982018  9986 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.990132  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:51.990132  8360 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.980839  9999 consensus_queue.cc:1059] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:01:52.004531  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:52.004966  9958 raft_consensus.cc:993] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:52.005683  9999 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.003026  8214 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.980816 10010 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:52.006413  9958 raft_consensus.cc:1081] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:01:52.007069 10010 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:52.007501 10013 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:52.008242 10010 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.007783  8114 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc reported cstate change: config changed from index -1 to 5, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:52.010619  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:52.012283 10011 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.013810  8292 raft_consensus.cc:1240] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:52.015924  8892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b137d34f34145b18037845635e297eb"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43630
I20260709 13:01:52.006105  9999 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.016451 10011 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:52.016556  8892 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.016995  8892 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.992066  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:51.980290 10016 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.996919  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:01:51.994781  8388 debug-util.cc:398] Leaking SignalData structure 0x7b0800370a60 after lost signal to thread 8922
I20260709 13:01:51.999625  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:52.002985  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:52.030109 10039 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.018965  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:51.995313 10007 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:52.019773  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:52.015959 10021 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:01:52.003199  8217 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.032773 10038 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.035001 10038 consensus_queue.cc:1059] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.036116 10000 raft_consensus.cc:3055] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.036463 10000 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:52.037292 10000 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:52.038630 10000 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.008785 10013 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.004527 10025 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:52.042829 10018 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.042855  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:52.044277 10011 consensus_queue.cc:1059] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:52.049225  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:52.049536 10011 raft_consensus.cc:3055] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.049903 10011 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.050457 10034 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.028043 10015 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.056097  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56230 (request call id 12) took 1028 ms. Trace:
I20260709 13:01:52.056193  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:52.065610  9955 rpcz_store.cc:276] 0709 13:01:51.026092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.026265 (+   173us) service_pool.cc:224] Handling call
0709 13:01:51.088778 (+ 62513us) log.cc:844] Serialized 492 byte log entry
0709 13:01:51.308614 (+219836us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b180022dec0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:01:52.053371 (+744757us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3917,"raft.queue_time_us":14477,"raft.run_cpu_time_us":1720,"raft.run_wall_time_us":7729,"spinlock_wait_cycles":19295104,"thread_start_us":28075,"threads_started":1,"wal-append.queue_time_us":56547}
I20260709 13:01:52.069583  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.072914  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:52.073827 10012 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:52.043960  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:52.050750 10011 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.017006  9999 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.103294  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.104800  8183 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.085204 10006 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:01:52.116897  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.117084  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:52.120045  8863 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.118317  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.124518  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:52.105401  9952 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:52.106865  8183 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.127305  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.107650  9956 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:52.101236  9954 consensus_queue.cc:1175] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4a50f39e2d8e4886a79849938f2272a6" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:01:52.126901  8863 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.152135  9937 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.127884 10004 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.151139  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.159348 10014 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.169572  9984 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.171156  8367 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:52.171742  9984 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:52.173448 10014 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.144693 10024 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.133200 10007 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.173400  8293 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:01:52.178699  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:52.183625  8863 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.183945  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.186584  8894 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:01:52.192785  9994 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:52.193441  9994 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:52.190927  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.198191  8183 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.197086  9972 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:52.203380  9956 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.204438  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.204870 10035 tablet_copy_client.cc:323] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Beginning tablet copy session from remote peer at address 127.6.236.2:39859
I20260709 13:01:52.206880  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.225008  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:52.228344  9976 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:52.232439  9967 raft_consensus.cc:3055] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.239301  9967 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:52.194480  9994 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.247503 10031 consensus_queue.cc:1059] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:52.235585  9955 consensus_queue.cc:1059] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:01:52.256888  8361 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:52.258524  8895 raft_consensus.cc:1240] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.261106  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:52.245785  9967 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.250754  9974 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.262669 10030 raft_consensus.cc:3055] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.263860 10025 consensus_queue.cc:1059] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:01:52.264133 10010 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.277490  8364 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:52.281579  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.273407 10030 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:52.299721 10030 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.300978 10030 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.275468 10017 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:01:52.288501 10026 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:52.302564 10037 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.279425 10043 consensus_queue.cc:1059] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:01:52.302963 10037 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.287604  8361 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } } }
I20260709 13:01:52.303823 10037 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:52.305030  8302 tablet_copy_service.cc:140] P ecc8d80ac6df4f5b95c8befae4d08ed0: Received BeginTabletCopySession request for tablet 410fe3c36e834265b4c3b139e453a76e from peer 4a50f39e2d8e4886a79849938f2272a6 ({username='slave'} at 127.0.0.1:53342)
I20260709 13:01:52.274892  9986 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.305608  8302 tablet_copy_service.cc:161] P ecc8d80ac6df4f5b95c8befae4d08ed0: Beginning new tablet copy session on tablet 410fe3c36e834265b4c3b139e453a76e from peer 4a50f39e2d8e4886a79849938f2272a6 at {username='slave'} at 127.0.0.1:53342: session id = 4a50f39e2d8e4886a79849938f2272a6-410fe3c36e834265b4c3b139e453a76e
I20260709 13:01:52.307180  9974 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:52.307428  8360 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:52.293414 10019 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:52.288059  9967 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.311364 10019 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.307195  9986 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:52.317777  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.319396  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.311800 10019 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:52.328491 10019 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.332475  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:52.338519  8302 tablet_copy_source_session.cc:215] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:52.339468  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:52.339314  8892 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.343313  8897 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:52.343179 10018 consensus_queue.cc:1059] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:52.343952  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:52.344305  9958 raft_consensus.cc:3055] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.344672  9958 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.345479  9958 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.346975  9958 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.357066  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.358273 10035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410fe3c36e834265b4c3b139e453a76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.362021  8289 raft_consensus.cc:1240] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:52.388103  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 44214us
I20260709 13:01:52.389144  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:52.397902  9979 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.399922  9986 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.402383 10026 consensus_queue.cc:1059] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:52.399755 10006 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.394367 10019 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.406271  8892 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:52.421868  9999 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.422452  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:52.423245  8361 raft_consensus.cc:2393] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 2: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:52.435249  9954 consensus_queue.cc:1059] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:52.441334  8364 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.443522 10006 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:52.444952  9954 raft_consensus.cc:3055] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.445678  9954 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.446200 10009 raft_consensus.cc:3055] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.446645 10009 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.447134  9954 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.447430 10009 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.448683  9954 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.449245 10009 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.451500 10002 raft_consensus.cc:3055] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.452122 10002 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:52.445204 10003 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.453601 10003 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.472361 10003 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.473793 10003 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.464571 10037 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.466035  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:52.467152 10011 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.478185  8291 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:52.457484 10014 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:52.453131 10002 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.485410  8290 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:52.490629 10046 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.516786 10002 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.514526  8113 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 5, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 5 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:52.532063  8863 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.519275 10046 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:52.533305 10046 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:52.534776 10046 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.537622  9997 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:52.538198  9997 raft_consensus.cc:697] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:52.538120  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:52.538846 10014 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.542150 10024 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:52.544691 10024 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:52.546165 10024 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.539196  9997 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.576383  8288 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:52.584395  8863 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.586112  9949 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:52.586621  9949 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:52.587446  9949 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:52.595610 10035 tablet_copy_client.cc:806] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:52.596269 10035 tablet_copy_client.cc:670] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:52.606204 10035 tablet_copy_client.cc:538] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:52.616619 10035 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap starting.
I20260709 13:01:52.671633  8114 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:52.677294  8115 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.679028  8288 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:52.679574  8114 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:52.683522  9949 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:52.696906  8361 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.707396  8361 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:52.708837  9949 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:52.714658 10035 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.715680 10035 tablet_bootstrap.cc:492] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Bootstrap complete.
I20260709 13:01:52.716400 10035 ts_tablet_manager.cc:1403] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Time spent bootstrapping tablet: real 0.100s	user 0.026s	sys 0.025s
I20260709 13:01:52.719466 10035 raft_consensus.cc:359] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:52.720307 10035 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Initialized, Role: LEARNER
I20260709 13:01:52.720995 10035 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: NON_VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: true } }
I20260709 13:01:52.724160 10035 ts_tablet_manager.cc:1434] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.002s
I20260709 13:01:52.730031  8302 tablet_copy_service.cc:342] P ecc8d80ac6df4f5b95c8befae4d08ed0: Request end of tablet copy session 4a50f39e2d8e4886a79849938f2272a6-410fe3c36e834265b4c3b139e453a76e received from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:52.730592  8302 tablet_copy_service.cc:434] P ecc8d80ac6df4f5b95c8befae4d08ed0: ending tablet copy session 4a50f39e2d8e4886a79849938f2272a6-410fe3c36e834265b4c3b139e453a76e on tablet 410fe3c36e834265b4c3b139e453a76e with peer 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:52.764034  8891 raft_consensus.cc:1217] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:01:52.937197 10002 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:52.937754 10002 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:52.940280 10002 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:52.942210  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:52.943025  8364 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 2: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:52.944674  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:52.945348  8288 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:52.947605  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:52.948426 10002 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:52.948824 10002 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:52.949177 10002 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.981031  8364 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.981706 10002 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:52.985394 10002 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:52.985987  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:52.986431  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:52.986814  8361 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 2: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:52.993759  8364 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:52.995411  9997 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:53.006487  8288 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:53.008126  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:53.010869 10002 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:53.012362  8288 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:53.014146  9997 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:53.014092 10002 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:53.017776 10002 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.050390  8288 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:53.052119  9997 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:53.057731  8112 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 2 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.063354  8291 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:53.067215 10002 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:01:53.096652  8364 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:53.102866  9949 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:53.114823  8891 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.122969  8891 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:53.128077 10031 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:53.237936 10046 raft_consensus.cc:1064] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: attempting to promote NON_VOTER 4a50f39e2d8e4886a79849938f2272a6 to VOTER
I20260709 13:01:53.240509 10046 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.249090  8891 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEARNER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:53.251278  9949 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:53.251812  9949 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.254035  9949 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.257817 10016 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:01:53.259196  8217 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:53.269405  8364 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:53.259498  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.255281  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.270797  8361 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:53.271346  8213 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 2: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:53.277449  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:53.279670  9949 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:53.280201  9949 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:53.278381 10016 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:53.284909  9949 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.287396  9979 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.287902  9986 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:53.287916  9979 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.288586  9986 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.290066 10046 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:53.291347  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.292477  8217 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:53.293259  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.293975  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.295006  9984 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.295368  9984 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.295676  9984 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.295742  9986 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.297704  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.298401  8285 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:53.298638  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.301036  8217 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:53.291371  9979 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.299609  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.294008  8288 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:53.304498  9986 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.304903  9986 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:53.305261  9986 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.309410  9984 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.320590  9984 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.327023  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:53.327690  8288 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.317813  9949 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.331626  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:53.332386  8217 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.331328 10016 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:53.351634 10014 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.352252 10014 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.362119  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.363011  8364 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:53.364712  8259 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.367158 10046 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.368271 10046 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.369119 10046 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.374190  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:53.375707 10014 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.382957  8213 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:53.383812  8891 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:53.395443  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:53.406479  9984 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.406904  8211 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 2: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:53.395556 10031 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:53.406966  9984 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.407521 10031 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.409240  9984 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.409448 10031 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.410316  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.410925  8285 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:53.411803  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.412396  8216 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:53.412703  9974 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.413213  9974 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.413594  8332 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.396148  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:53.415655  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.416328  8285 raft_consensus.cc:2393] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 3: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:01:53.416690  9974 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.416832  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.417253  9974 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.417403  8291 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:53.417640  9974 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.418766  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.420104  9974 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.425525  9965 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:53.426384  9965 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.428545  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.429294  8364 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:53.430444  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:53.430574  8217 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:53.431887  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.433084  9994 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:53.389638  8288 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:53.425581  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.456676  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.457394  8364 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:01:53.459019  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 94374.5us
I20260709 13:01:53.393885  9949 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.449874 10031 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.462781  9949 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:53.463467  9949 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.456560  9984 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.455653  9965 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.460625  8115 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.460636 10073 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.481606 10046 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.480545  9984 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.469483 10002 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.470335 10031 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.493114  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.492489 10002 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.496985  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.489367  9984 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.499555 10002 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.489423 10073 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:53.501477 10073 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.502707  9974 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.503822  8361 raft_consensus.cc:2368] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:01:53.504791  8285 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:53.506758  8184 leader_election.cc:400] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:01:53.507104  8184 leader_election.cc:403] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:53.507485 10031 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.492281  9986 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.509424  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.510092  8288 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:53.510300  9986 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.512127 10031 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.517544  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:53.518430  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:53.518692  8892 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:53.519361 10002 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.519914  9984 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.519797 10002 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.521024 10002 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.526546  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:53.527172  8891 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.526746 10046 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.528456  9974 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.519816  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:53.529423  8894 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:53.531457  9949 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.521993  9984 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.532387  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.534849  8361 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 2: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:53.532749  8863 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:53.539361  9949 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.539798  9949 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:53.540166  9949 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.544380  8288 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.546249 10031 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:01:53.489053  9994 raft_consensus.cc:697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:53.546911  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.547652  8285 raft_consensus.cc:2368] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3.
I20260709 13:01:53.548614  8183 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:01:53.549789  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 117966us
I20260709 13:01:53.550896  9963 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.551272  9963 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.551594  9963 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.561995  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:53.562920  8211 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:53.562644  9994 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.564459  9963 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.545042  8361 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:53.561997  9949 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.550541 10002 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.572072  8891 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:53.567224  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:53.569090  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:53.574607  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:53.577021 10031 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:53.577601 10074 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:53.577890 10031 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:53.578358 10031 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:53.578222 10074 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.579227 10031 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.582439  9949 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.582688  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.583443  8364 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 2: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:53.584259  8213 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:01:53.580338 10074 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.578387  8258 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:53.585642 10077 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.586144 10077 raft_consensus.cc:697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:53.613169  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:53.614763  8863 leader_election.cc:400] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3.
I20260709 13:01:53.614514  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.621203  8863 leader_election.cc:403] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:53.586923 10077 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.616127  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:53.621520  8291 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:53.622689  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:53.623361  8288 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.617343  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:53.627012  8364 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.627981  9963 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.629487  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:53.618703  8367 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:53.635890  8286 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:53.640983  8361 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:53.645174  8291 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:53.646569 10014 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.647145 10014 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.649739 10014 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.650146  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:53.650736  8285 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.651116  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.651684  8213 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:53.653707  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:53.654497 10014 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:53.654843 10014 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.655175 10014 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.657090  8285 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:01:53.659238 10078 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.659791  8364 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:53.659731 10078 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.661855 10078 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.662211 10023 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.662688 10023 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.664220  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:53.664745  8894 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.669334 10024 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.670253  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.580716 10002 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.574235 10046 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:53.620740  8892 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.672477 10023 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.673821  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:53.674437  8291 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.675081  8894 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:01:53.679211  8892 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:53.680197 10046 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.680770 10014 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.669919 10024 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.683341  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:53.683627  8286 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:01:53.683898  8213 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.684298 10024 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.685668  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:53.726907  8364 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:53.727733 10031 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.691238 10075 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3.
I20260709 13:01:53.703246  8115 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.704485 10016 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.732604  8288 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:53.735410 10016 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.737553 10016 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.742463  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:53.743211  8894 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:53.745090  8258 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:53.732452  8291 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:53.746127 10016 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.746619 10016 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.747015 10016 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.709440 10072 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.748052  8115 catalog_manager.cc:5697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.749145 10072 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.691821 10014 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.748437  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:53.719493  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.691238  8213 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:01:53.770805 10078 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.771322 10078 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:53.771382  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:53.772325 10014 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:53.772209 10078 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:53.775617  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 56218.1us
I20260709 13:01:53.776353  8332 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.777063  9986 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:53.777525  9986 raft_consensus.cc:697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:53.778457  9986 consensus_queue.cc:237] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:53.708889  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 88434us
W20260709 13:01:53.698798  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 84209.9us
I20260709 13:01:53.783851  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:01:53.723131  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 52134.3us
I20260709 13:01:53.751384 10072 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:53.722061  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 53078.9us
I20260709 13:01:53.719179 10080 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:53.789238 10080 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.683315 10046 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.757160  9984 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.748561  9974 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.753764  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.786517  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.790388  9984 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.790665  9974 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.695454  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:53.787483  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.792840  8213 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:01:53.792320  8291 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:01:53.793298  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.794021  8364 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:53.715698  8891 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:53.798704  8183 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:53.799959  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:53.801565  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:01:53.801532  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 77807.6us
I20260709 13:01:53.803440  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.804085  8364 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:53.805299  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.794462  8115 catalog_manager.cc:5697] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.806174  8364 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:53.784981 10078 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.822299 10090 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:53.810020  8211 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:53.813686 10046 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.826472 10046 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.827265  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:53.828577 10046 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.829107 10046 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.829447 10046 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.829767 10046 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.830657  8892 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:01:53.829782  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.831730  8211 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:53.831980 10078 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:53.833074 10078 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.834656  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:53.825811 10090 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.836833  8863 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:53.811731 10031 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:53.844498 10031 raft_consensus.cc:697] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:53.845301 10031 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.839809  9984 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.811896 10023 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.841324 10080 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.846782 10023 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:53.842931  9974 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.847749 10023 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.848783 10074 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:53.849189 10074 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:53.849521 10074 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.805843 10077 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:01:53.853458 10072 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:53.823535  9986 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.854470  9986 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.848450  8863 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:53.870532  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:53.871142  8364 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.879739  8364 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:01:53.882018  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:53.870296  9994 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:53.883598  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 87925.5us
I20260709 13:01:53.886132  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.886899  8367 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:53.886305  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.887972  8291 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:53.890805  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.893960  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.890044  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.894618  8367 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:53.895020  8364 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:53.899012 10095 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:53.899756 10095 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.902205 10095 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.868791 10090 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.883353 10072 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.845961 10016 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.920316  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.920565  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.893291  9994 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:53.905313  9974 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:53.891937 10014 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:53.922108  8291 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:53.923990  8285 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:53.927693  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.924548  8259 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:53.929090  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.932353  8217 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:53.929935  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:53.933667  8216 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
W20260709 13:01:53.922094  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 120566us
I20260709 13:01:53.937642  8184 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:53.910006  9986 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:53.927407 10088 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.928021  9984 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.931656 10072 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.937269 10031 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.937534 10002 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.959227  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 60847.4us
I20260709 13:01:53.963376  9994 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.970376  9984 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:53.972651  9984 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.973187  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:53.973328 10002 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:53.973940  8291 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:01:53.975348 10002 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:53.976246  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:53.976329 10077 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:53.976466  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:53.976884 10077 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:53.977128  8892 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:01:53.977276 10077 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.941237  9974 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.004189  9974 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:54.004586 10016 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:53.952654 10088 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.939502 10046 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:54.010396  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.955965 10072 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.953773 10092 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:54.016861  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:54.022336  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:54.032958 10074 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.035737 10074 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:54.037205  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:54.037693 10046 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:54.038020  8361 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 2: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:54.026444 10092 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.039799 10092 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.039891  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:54.040462  8216 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.041157  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:53.990823 10031 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.045485 10031 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:54.012105 10088 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.049243  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:54.022890  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 70774.5us
I20260709 13:01:54.028169  8892 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.014963  9974 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:54.029556  8364 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:54.005299 10016 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:54.054905  8291 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:54.063747  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:54.070796  8285 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:54.073328  8216 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:54.074690  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:01:54.078486  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 151383us
I20260709 13:01:54.081702  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:54.082443  8291 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:54.083901  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:54.086819  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:54.087417  8217 raft_consensus.cc:606] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:54.056288  9974 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.068487  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:54.083230 10046 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.054430 10014 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.150542  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:54.104187 10092 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.093329 10097 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:01:54.103355 10090 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.118330  9974 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:54.113682 10088 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.120455  8367 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:54.162916 10088 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:54.122867  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:54.108397 10077 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.165764  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:54.166721  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:54.167629  9984 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:54.168104  9984 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.168478  9984 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.168901 10073 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.169363 10073 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.169050 10077 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:54.120946 10046 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:54.135809  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:54.171675 10046 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.170258  9986 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.174530  9986 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.113806 10024 raft_consensus.cc:993] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:54.154314  8891 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:54.109356  8892 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:54.169690 10073 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.175341  9986 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.176431 10024 raft_consensus.cc:1081] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:54.178002  8258 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:54.157330  8211 raft_consensus.cc:2368] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
I20260709 13:01:54.155187  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:54.181327 10104 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:54.159463 10090 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:54.169581  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:54.171669  8896 raft_consensus.cc:2368] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.133422  8863 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:54.182965  8894 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:01:54.183423  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 50121.6us
I20260709 13:01:54.092922  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:54.185554  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:54.186138  8285 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:54.187670  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 94813.9us
I20260709 13:01:54.116971  8290 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:54.154314 10092 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:54.191610 10076 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.192437 10090 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.196396  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:54.129525  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:54.120167 10072 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.207937 10105 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:01:54.228353  9984 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.210620  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:54.230159  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:54.231216  8211 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.224273  8890 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:54.217449 10076 raft_consensus.cc:697] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:54.211826  8286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:01:54.234133  8286 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.226333 10090 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.234426 10076 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.235217 10090 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:54.219201  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 54870.4us
I20260709 13:01:54.230154  8287 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.216070  8285 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:54.234511  8286 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.242746  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:54.243518 10098 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:54.243957 10098 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:54.244721 10098 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.251549  8286 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.254866  8332 leader_election.cc:400] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.271170  8332 leader_election.cc:403] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.253782  8216 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:54.261793  8287 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:01:54.265597  9984 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:54.266950 10104 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:54.267688  8290 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:54.270417  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:54.288489  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:54.221702  8113 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.294648  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:54.303124  8285 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:54.295390  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 370857us
I20260709 13:01:54.296917  8862 leader_election.cc:400] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
I20260709 13:01:54.304366  8862 leader_election.cc:403] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.294093 10090 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.310168  8286 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:54.315569  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:54.322216  8216 raft_consensus.cc:3055] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:54.322611  8216 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:01:54.323639  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 391251us
I20260709 13:01:54.324321  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:54.324365  8331 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:54.325129 10104 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.326800  8216 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.328166  8216 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.319190  8113 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.218133  8288 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:54.340440  8285 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:54.294104  9974 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.319195  9994 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.361497  8216 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:01:54.362828  8257 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:54.363648 10046 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:54.364339 10046 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:54.365839 10046 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.370738  8895 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:54.370487  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:54.375499  8894 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.374707  9949 consensus_queue.cc:1059] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:54.376912  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 52523.5us
I20260709 13:01:54.333818 10083 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.332758  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 410fe3c36e834265b4c3b139e453a76e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:54.349877 10091 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:54.318766 10073 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.355418 10072 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:54.413264  8894 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:01:54.391582 10083 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.432812  8289 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:54.356232  9986 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.393205  9979 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:54.414575 10091 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:54.434826  9984 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.471807  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:54.483300 10073 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:54.484226 10090 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:54.485322  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:54.538196  8361 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:54.538406  8367 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.539530  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:01:54.523945  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 149844us
I20260709 13:01:54.497339  8211 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:54.505182  8286 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:54.507742  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:54.541553  8216 raft_consensus.cc:2368] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.513880  8290 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:54.542354  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:54.542974  8358 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.543910  9986 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:54.523911 10083 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.522379  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:54.547865  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:54.548101  8287 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.548491  8365 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.549820 10091 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.533555  8217 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:54.551674 10076 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:54.533859  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:54.552985  8214 raft_consensus.cc:2368] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.537135  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:54.556639  8213 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.559337  8367 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:01:54.562711  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:54.565062  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:54.565232  8364 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:54.565910  8363 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:54.565675  8890 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.536163  9984 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.581041  9984 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:54.565654 10075 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:54.583448 10075 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.583818 10075 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:54.584708 10075 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.581925  9994 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
I20260709 13:01:54.585861  9974 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.585903 10075 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.594936 10083 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.597774  8891 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:01:54.601608 10095 raft_consensus.cc:3055] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:54.602593 10095 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:54.605032 10095 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.607177 10083 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:54.607671 10095 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:54.409909  8102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 80800.3us
I20260709 13:01:54.563139  8213 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:54.652783  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:54.655272  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:54.656266  8259 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:54.659250  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:54.660769  8290 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.660887  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:54.661649  8211 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:54.662274  8214 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:01:54.664422  8217 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:54.664867  8217 pending_rounds.cc:85] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 1
I20260709 13:01:54.665201  8217 pending_rounds.cc:107] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:54.665684  8217 raft_consensus.cc:2889] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:54.665846  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 92509.6us
I20260709 13:01:54.678479 10024 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:54.681319  8331 leader_election.cc:400] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.681831  8331 leader_election.cc:403] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.682907 10104 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.689312  8287 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:01:54.690164 10085 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:54.690603  8895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:01:54.680650 10024 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:54.693799  8895 raft_consensus.cc:606] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:54.706643  8365 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:01:54.662963  8184 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:54.714061  8211 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:54.715031 10104 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:01:54.730346  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 80378.9us
W20260709 13:01:54.730762  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 49855.7us
I20260709 13:01:54.731950  9974 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.732743 10002 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.734807 10002 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:54.736848 10002 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.736888  8115 catalog_manager.cc:5697] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 5, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 5 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.743351  8211 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:54.744067  8890 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:54.750613 10085 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:54.752657  8892 raft_consensus.cc:1240] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:54.759246  8896 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:54.763105 10109 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.770845  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:54.772262  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:01:54.773087  8211 raft_consensus.cc:606] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:54.775173  8896 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:54.725126 10104 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.778934  8211 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:54.786087 10046 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:54.793622  9974 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:54.795604  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.812776  8331 leader_election.cc:400] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.813239  8331 leader_election.cc:403] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.814231  8331 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:54.815346 10133 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:01:54.819031 10133 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.819415  9984 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:54.820340 10133 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.820878 10133 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:54.821590  8896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:01:54.822295  8896 raft_consensus.cc:606] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:54.822362 10133 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.820472  8358 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:54.824024 10133 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.819067 10127 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:54.843770  8365 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:54.847400  8112 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.848667  8285 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:54.849368  8112 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.852758  8290 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:01:54.856781 10098 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.857564 10091 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:54.857954  9974 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.860388  9974 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.846275  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:54.875911  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:54.877266 10119 raft_consensus.cc:993] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:54.877769 10119 raft_consensus.cc:1081] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:01:54.864598  8213 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:01:54.875880  9994 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:54.896764  8358 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:54.898018 10089 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:54.905328  8358 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:54.889618 10127 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:54.912040  8289 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:54.912861 10127 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:54.914275  8286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:01:54.914974  8286 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.915319  8286 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.944356  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:54.956203  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:54.958225 10075 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:01:54.898831 10089 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.976115  8367 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:54.978420 10024 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.980103  8217 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:54.992491 10084 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:55.009629  8288 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:55.010383 10016 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:01:55.006029  8286 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:54.997594 10024 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:55.017122  8895 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:01:55.019209  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 87024.9us
W20260709 13:01:55.025244  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.018538  8358 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:55.043546  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.011682 10085 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:01:55.056795  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:55.056282  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:55.062665  8217 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:55.064639 10138 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:01:55.044226  8363 raft_consensus.cc:2955] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:55.066761 10024 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:55.072940 10089 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:55.044371  8290 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:55.061288  8286 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:55.077265  8217 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:55.055989  8114 catalog_manager.cc:5697] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.080102  8257 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:55.084720  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:55.086738 10016 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:55.087462 10016 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:01:55.089130 10016 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.087642  8114 catalog_manager.cc:5697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.107052  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:55.113412 10023 raft_consensus.cc:993] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:55.114030 10023 raft_consensus.cc:1081] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Signalling peer ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:55.101972 10031 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:01:55.121165  8184 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:55.123307  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:55.123986  8895 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.124341  8895 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:55.125149  8895 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.126319  8896 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:01:55.121273  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 49302.3us
I20260709 13:01:55.138607 10031 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:55.099345 10085 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:01:55.143765  8895 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.152478  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:55.140235 10084 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.132861  8114 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 3, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.168705 10077 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:55.163411  8358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:42830
I20260709 13:01:55.178951  8358 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.179414  8358 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.184623 10046 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:55.155418 10105 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:01:55.212859 10101 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:55.213636 10101 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.214622  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:55.215986 10101 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:55.217407 10146 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:55.222978  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:55.226449 10095 raft_consensus.cc:993] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: : Instructing follower ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:55.226912 10095 raft_consensus.cc:1081] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Signalling peer ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:01:55.225670  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:55.217928 10146 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.247004  8285 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:55.249132  8358 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.214630 10076 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:55.276149  8894 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:55.267108 10076 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.338502  8366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:51072
I20260709 13:01:55.340654  8366 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.341063  8366 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.348227 10031 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:55.397253  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:55.377341  8358 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:55.399833  8359 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:55.400368 10145 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:01:55.401254  8359 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:55.404086  8113 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35666 (request call id 371) took 1284 ms. Trace:
I20260709 13:01:55.405788  8114 catalog_manager.cc:5697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.412317 10076 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:55.416021 10031 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.416733  8895 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:55.419467  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:55.423346  8897 raft_consensus.cc:2410] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:55.424125  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:55.428643  8115 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35680 (request call id 395) took 1049 ms. Trace:
I20260709 13:01:55.442925  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:55.449769  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:55.450389 10031 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:55.451577  8288 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:55.446461 10085 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:55.452937 10085 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.455317 10085 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:55.455585 10146 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:55.459295 10024 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:55.446928  8366 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:55.476135  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.481499  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:55.482580  8211 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.482919  8211 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:01:55.485855  8366 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:55.487571  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:55.486994 10023 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:01:55.509377  8362 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:55.493458 10099 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:01:55.429283  8115 rpcz_store.cc:276] 0709 13:01:54.378952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.379088 (+   136us) service_pool.cc:224] Handling call
0709 13:01:54.447487 (+ 68399us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b5400332cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b7090 00007f2efc255f3a 00007f2f0200c1cc 00007f2f0210a37e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc 00007f2f005ca392 00007f2efa58848c 00007f2efa5878c6
0709 13:01:55.428585 (+981098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:54.789074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:54.809726 (+ 20652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:54.809767 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:01:54.809783 (+    16us) tablet.cc:662] Decoding operations
0709 13:01:54.810191 (+   408us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:54.810233 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:54.810265 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:54.810479 (+   214us) tablet.cc:701] Row locks acquired
0709 13:01:54.810493 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:01:54.810653 (+   160us) write_op.cc:270] Start()
0709 13:01:54.810795 (+   142us) write_op.cc:276] Timestamp: P: 1783602114810599 usec, L: 0
0709 13:01:54.810816 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:54.811581 (+   765us) log.cc:844] Serialized 535 byte log entry
0709 13:01:55.424417 (+612836us) op_driver.cc:464] REPLICATION: finished
0709 13:01:55.425872 (+  1455us) write_op.cc:301] APPLY: starting
0709 13:01:55.425950 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:55.426055 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:55.426172 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:55.426430 (+   258us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:55.426595 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:55.426641 (+    46us) write_op.cc:312] APPLY: finished
0709 13:01:55.426828 (+   187us) log.cc:844] Serialized 23 byte log entry
0709 13:01:55.426997 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.427145 (+   148us) write_op.cc:454] Released schema lock
0709 13:01:55.427204 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:55.427531 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.427561 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":7825280,"child_traces":[["op",{"apply.queue_time_us":1239,"apply.run_cpu_time_us":1631,"apply.run_wall_time_us":1632,"num_ops":1,"prepare.queue_time_us":24072,"prepare.run_cpu_time_us":2934,"prepare.run_wall_time_us":30496,"replication_time_us":613460}]]}
I20260709 13:01:55.404556  8113 rpcz_store.cc:276] 0709 13:01:54.119239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.119402 (+   163us) service_pool.cc:224] Handling call
0709 13:01:54.144140 (+ 24738us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b5400332cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b7090 00007f2efc255f3a 00007f2f0200c1cc 00007f2f0210a37e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc 00007f2f005ca392 00007f2efa58848c 00007f2efa5878c6
0709 13:01:54.220216 (+ 76076us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b54002eff90. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9129640 00007f2f02000b76 00007f2f0210ac3e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc 00007f2f005ca392 00007f2efa58848c 00007f2efa5878c6
0709 13:01:55.403826 (+1183610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:54.721230 (+     0us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5400332b28. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f026099e1 00007f2f0260864c 00007f2effc97adc 00007f2effc830a6 00007f2effc82d58 00007f2effc879f1 00007f2effc879a9 00007f2effc87939 00007f2effc87901 00007f2effc86b2d 000000000038f354
0709 13:01:54.721362 (+   132us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:54.736232 (+ 14870us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:54.736304 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:01:54.736347 (+    43us) tablet.cc:662] Decoding operations
0709 13:01:54.737053 (+   706us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:54.737138 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:54.737186 (+    48us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:54.737690 (+   504us) tablet.cc:701] Row locks acquired
0709 13:01:54.737738 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:01:54.737947 (+   209us) write_op.cc:270] Start()
0709 13:01:54.738252 (+   305us) write_op.cc:276] Timestamp: P: 1783602114737864 usec, L: 0
0709 13:01:54.738335 (+    83us) op_driver.cc:348] REPLICATION: starting
0709 13:01:54.739564 (+  1229us) log.cc:844] Serialized 907 byte log entry
0709 13:01:54.879394 (+139830us) op_driver.cc:464] REPLICATION: finished
0709 13:01:55.190978 (+311584us) write_op.cc:301] APPLY: starting
0709 13:01:55.191084 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:55.191211 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:55.191247 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:55.191674 (+   427us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:55.191924 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:55.191981 (+    57us) write_op.cc:312] APPLY: finished
0709 13:01:55.192262 (+   281us) log.cc:844] Serialized 29 byte log entry
0709 13:01:55.192487 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.192575 (+    88us) write_op.cc:454] Released schema lock
0709 13:01:55.192632 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:55.193044 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.193187 (+   143us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":145056256,"child_traces":[["op",{"apply.queue_time_us":285134,"apply.run_cpu_time_us":2038,"apply.run_wall_time_us":2038,"num_ops":2,"prepare.queue_time_us":233464,"prepare.run_cpu_time_us":36936,"prepare.run_wall_time_us":152851,"replication_time_us":140895,"spinlock_wait_cycles":9280896,"thread_start_us":452634,"threads_started":2}]]}
I20260709 13:01:55.493386  8211 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:55.520699  8211 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.524228  8183 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:55.523684  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:55.531644  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:55.532351  8215 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.549079 10014 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:01:55.539415  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:55.583257  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:55.584270 10119 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:55.584319  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 76216.6us
I20260709 13:01:55.591797  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:55.556278 10091 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:55.605693 10074 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:55.639200  8209 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:55.642349  8358 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:55.649030 10109 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:55.651335  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:55.664093  8215 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
W20260709 13:01:55.667578 10169 log.cc:927] Time spent T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:55.679502  8213 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:55.683911  8112 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48060 (request call id 275) took 1036 ms. Trace:
I20260709 13:01:55.686517  8211 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
W20260709 13:01:55.696682  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 201349us
I20260709 13:01:55.703426  9994 consensus_queue.cc:1059] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
W20260709 13:01:55.796141  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 270880us
I20260709 13:01:55.800551  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:55.801870  8364 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:55.802327  8364 pending_rounds.cc:85] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 2
I20260709 13:01:55.802558  8364 pending_rounds.cc:107] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:55.802827  8364 raft_consensus.cc:2889] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.782800 10104 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.684602  8112 rpcz_store.cc:276] 0709 13:01:54.638236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.642360 (+  4124us) service_pool.cc:224] Handling call
0709 13:01:54.755935 (+113575us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b5400332b28. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f0243f331 00007f2f0243a3fc 00007f2f0200c1b4 00007f2f0210a37e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc 00007f2f005ca392 00007f2efa58848c 00007f2efa5878c6
0709 13:01:55.673882 (+917947us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:54.855018 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:54.855692 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:54.855729 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:01:54.855751 (+    22us) tablet.cc:662] Decoding operations
0709 13:01:54.856227 (+   476us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:54.856289 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:54.856323 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:54.856701 (+   378us) tablet.cc:701] Row locks acquired
0709 13:01:54.856724 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:01:54.856851 (+   127us) write_op.cc:270] Start()
0709 13:01:54.856970 (+   119us) write_op.cc:276] Timestamp: P: 1783602114856815 usec, L: 0
0709 13:01:54.856994 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:55.105057 (+248063us) log.cc:844] Serialized 907 byte log entry
0709 13:01:55.276645 (+171588us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400332cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc248e28 00007f2effc83581 00007f2effc82d58 00007f2effc879f1 00007f2effc879a9 00007f2effc87939 00007f2effc87901 00007f2effc86b2d 000000000038f354 000000000038f199
0709 13:01:55.424899 (+148254us) op_driver.cc:464] REPLICATION: finished
0709 13:01:55.427873 (+  2974us) write_op.cc:301] APPLY: starting
0709 13:01:55.427945 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:55.428053 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:55.428192 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:55.428719 (+   527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:55.428872 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:55.428917 (+    45us) write_op.cc:312] APPLY: finished
0709 13:01:55.429378 (+   461us) log.cc:844] Serialized 29 byte log entry
0709 13:01:55.429685 (+   307us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.429775 (+    90us) write_op.cc:454] Released schema lock
0709 13:01:55.429817 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":60,"reported_tablets":2,"spinlock_wait_cycles":68093312,"child_traces":[["op",{"apply.queue_time_us":2794,"apply.run_cpu_time_us":2439,"apply.run_wall_time_us":11646,"num_ops":2,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":11758,"prepare.run_wall_time_us":421806,"replication_time_us":567805,"spinlock_wait_cycles":435118464,"thread_start_us":64328,"threads_started":1}]]}
W20260709 13:01:55.863449  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 339994us
W20260709 13:01:55.874789 10173 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:01:55.928771  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.934386 10104 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:55.820359 10075 raft_consensus.cc:3055] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.822803 10119 consensus_queue.cc:1059] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.208s
W20260709 13:01:56.038972  8285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.054s	sys 0.111s
W20260709 13:01:56.044281  8285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.055s	sys 0.111s
I20260709 13:01:56.041469  9974 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:01:56.076901 10016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.008s	sys 0.018s
W20260709 13:01:56.083145 10016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.009s	sys 0.018s
I20260709 13:01:56.030021 10075 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:01:56.095124 10109 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.134650  9949 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:56.141813  9949 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.094487  9974 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:56.160498  8897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.027s	sys 0.008s
W20260709 13:01:56.160952  8897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.028s	sys 0.008s
I20260709 13:01:56.136080 10074 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.163239  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.013s	sys 0.017s
W20260709 13:01:56.164124  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.014s	sys 0.017s
W20260709 13:01:56.164878  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 640634us
W20260709 13:01:56.163995  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 460582us
I20260709 13:01:56.169498  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:01:56.161613  9984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.014s	sys 0.052s
W20260709 13:01:56.187031  9984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.014s	sys 0.053s
W20260709 13:01:56.193816  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 384759us
W20260709 13:01:56.195700  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.197904  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.162302 10109 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:56.212616  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 511509us
W20260709 13:01:56.230808  8863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.028s
W20260709 13:01:56.231192  8863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.008s	sys 0.029s
W20260709 13:01:56.242623  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 360196us
I20260709 13:01:56.187394 10074 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.249019  8331 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:56.184947 10075 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.257164 10188 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:56.241873  9994 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:56.294389  8331 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:01:56.302515 10181 log.cc:927] Time spent T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:01:56.302733 10179 log.cc:927] Time spent T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:56.306221 10187 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.308501  9984 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.309077  9984 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:01:56.318013  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 65028us
W20260709 13:01:56.333093  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 70691.9us
I20260709 13:01:56.306939 10187 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:56.322752 10084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.014s	sys 0.030s
W20260709 13:01:56.344672 10084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.014s	sys 0.030s
I20260709 13:01:56.343529 10075 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:56.493705  8257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.025s	sys 0.025s
I20260709 13:01:56.343259  9974 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:01:56.508785  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 339331us
I20260709 13:01:56.325018  9994 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.309986  9984 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:56.503527  8257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.025s	sys 0.025s
W20260709 13:01:56.526613  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 716604us
W20260709 13:01:56.530279  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 278021us
I20260709 13:01:56.502517 10016 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:56.496521  9949 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:56.531635  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:56.525735 10084 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.549015  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:56.553318 10195 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.553879 10195 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:56.555181 10198 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:56.556233 10198 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.556095 10195 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:01:55.521049 10024 consensus_queue.cc:1175] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ee13752324154b1293a47c9dcd8d6ba5" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:56.731199  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:56.731942  8895 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:56.733461  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.548074 10176 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.652292  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:56.720629 10192 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.331s	user 0.000s	sys 0.000s
W20260709 13:01:56.682349 10182 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
W20260709 13:01:56.734544  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 200453us
I20260709 13:01:56.738807  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:01:56.746654  9994 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:56.747028  8893 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:56.747772  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:56.661147 10084 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.748474  8889 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:56.749279  8217 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:01:56.750211  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:56.750363  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1323) took 1094 ms. Trace:
I20260709 13:01:56.732390 10046 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:56.751022 10084 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:56.751715 10046 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.753000 10198 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:56.745990 10083 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:56.755286 10083 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.757427 10083 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:56.728209 10200 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.760066  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 220176us
I20260709 13:01:56.766163  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:56.651587 10109 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:56.739562 10187 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:56.734920 10031 consensus_queue.cc:1175] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4a50f39e2d8e4886a79849938f2272a6" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:01:56.742414 10180 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:56.682238 10074 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:56.749282  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:56.750734  8209 rpcz_store.cc:276] 0709 13:01:55.655852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.656004 (+   152us) service_pool.cc:224] Handling call
0709 13:01:55.676629 (+ 20625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.698536 (+ 21907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.698568 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.783209 (+ 84641us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.163629 (+380420us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:56.163667 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.163733 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.750152 (+586419us) raft_consensus.cc:1685] finished
0709 13:01:56.750170 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.750287 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36665,"raft.queue_time_us":14808,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4491,"thread_start_us":358883,"threads_started":1,"wal-append.queue_time_us":521729}
I20260709 13:01:56.551426 10016 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.753975 10046 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:56.760571 10176 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:56.776331 10083 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:01:56.809530  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.814415 10201 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:01:56.815387 10016 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:56.816187  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2024) took 1312 ms. Trace:
W20260709 13:01:56.816041 10174 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.784s	user 0.003s	sys 0.009s
I20260709 13:01:56.776412 10200 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:56.816699 10186 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.450s	user 0.000s	sys 0.001s
W20260709 13:01:56.818780  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 82998.2us
I20260709 13:01:56.798092 10187 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:56.816561  8285 rpcz_store.cc:276] 0709 13:01:55.503386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.503623 (+   237us) service_pool.cc:224] Handling call
0709 13:01:55.510576 (+  6953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.510962 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.510989 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.511445 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.044840 (+533395us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:56.044878 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.044959 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.683961 (+639002us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b480002ff58. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f01176aa1 00007f2f0116db37 00007f2f0116d9ca 00007f2f0126526f 00007f2f01264f37 00007f2f0127955c 00007f2f01279508 00007f2f01279488 00007f2f01279443 00007f2f012786ec 00007f2f001a2a96
0709 13:01:56.815879 (+131918us) raft_consensus.cc:1685] finished
0709 13:01:56.815899 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.816114 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1472,"raft.run_cpu_time_us":12340,"raft.run_wall_time_us":1170458,"spinlock_wait_cycles":13315456,"thread_start_us":521971,"threads_started":1,"wal-append.queue_time_us":667047}
I20260709 13:01:56.817523 10197 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.842643  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.817000 10175 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:56.817740  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 1824) took 1073 ms. Trace:
I20260709 13:01:56.888638  8285 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:56.888566  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 260223us
I20260709 13:01:56.905318  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:56.906272  8285 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:56.848630  8210 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:56.809156 10180 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.897897  8895 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:56.882931 10083 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:56.880652 10187 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.946627 10184 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.135s
I20260709 13:01:56.947896 10203 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:56.948449 10203 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.943606  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 608) took 1464 ms. Trace:
I20260709 13:01:56.952996  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 464) took 1331 ms. Trace:
I20260709 13:01:56.913851  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:56.962139  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:56.929286 10210 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:56.951625  8894 rpcz_store.cc:276] 0709 13:01:55.469456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.471925 (+  2469us) service_pool.cc:224] Handling call
0709 13:01:55.472316 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.472701 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.472729 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.473349 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.589386 (+116037us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:55.589428 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.589499 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.815362 (+1225863us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:01:56.933407 (+118045us) raft_consensus.cc:1685] finished
0709 13:01:56.933428 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.933638 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5714,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":4990,"spinlock_wait_cycles":3742464,"thread_start_us":115579,"threads_started":1,"wal-append.queue_time_us":318657}
I20260709 13:01:56.950917 10203 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:56.955753  8897 rpcz_store.cc:276] 0709 13:01:55.621266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.621475 (+   209us) service_pool.cc:224] Handling call
0709 13:01:55.630982 (+  9507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.653269 (+ 22287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.653296 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.653787 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.161318 (+507531us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:56.161364 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.161437 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.952770 (+791333us) raft_consensus.cc:1685] finished
0709 13:01:56.952789 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.952937 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12632,"raft.queue_time_us":19662,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3089,"thread_start_us":507136,"threads_started":1,"wal-append.queue_time_us":588610}
I20260709 13:01:56.978768 10205 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.979748 10101 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:56.951352 10074 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:56.890925 10197 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.018061 10197 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.019428 10101 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.021507 10101 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:56.929884 10176 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.985065 10180 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:56.891119 10175 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.986768 10200 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:56.998404 10205 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.046545 10205 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:57.002470 10199 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 13:01:57.014369 10074 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:56.880499  8358 rpcz_store.cc:276] 0709 13:01:55.744518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.781879 (+ 37361us) service_pool.cc:224] Handling call
0709 13:01:55.822733 (+ 40854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.017519 (+194786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.028709 (+ 11190us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.076990 (+ 48281us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.327536 (+250546us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:56.334498 (+  6962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.344492 (+  9994us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.817494 (+473002us) raft_consensus.cc:1685] finished
0709 13:01:56.817523 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.817659 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109074,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"thread_start_us":236709,"threads_started":1,"wal-append.queue_time_us":441568}
I20260709 13:01:57.087440 10104 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:57.082566  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.118395 10083 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:57.119270  8890 raft_consensus.cc:2410] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:57.122722 10175 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.048648 10187 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:01:57.051072 10075 consensus_meta.cc:287] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.001s
I20260709 13:01:56.498589  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:57.079878  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.033455 10210 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.073093  8112 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 6 to 7, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:57.160413  8289 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:57.076859  8114 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35686 (request call id 346) took 2214 ms. Trace:
I20260709 13:01:57.165386  8114 rpcz_store.cc:276] 0709 13:01:54.862411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.865023 (+  2612us) service_pool.cc:224] Handling call
0709 13:01:54.879901 (+ 14878us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5400332cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b7090 00007f2efc255f3a 00007f2f0200c1cc 00007f2f0210a37e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc 00007f2f005ca392 00007f2efa58848c 00007f2efa5878c6
0709 13:01:57.076740 (+2196839us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:55.410477 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:55.411017 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:55.411053 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:01:55.411079 (+    26us) tablet.cc:662] Decoding operations
0709 13:01:55.411663 (+   584us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:55.411707 (+    44us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:55.411737 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:55.412184 (+   447us) tablet.cc:701] Row locks acquired
0709 13:01:55.412201 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:01:55.412343 (+   142us) write_op.cc:270] Start()
0709 13:01:55.412447 (+   104us) write_op.cc:276] Timestamp: P: 1783602115412300 usec, L: 0
0709 13:01:55.412463 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:01:55.413053 (+   590us) log.cc:844] Serialized 1677 byte log entry
0709 13:01:55.556825 (+143772us) op_driver.cc:464] REPLICATION: finished
0709 13:01:55.600375 (+ 43550us) write_op.cc:301] APPLY: starting
0709 13:01:55.602241 (+  1866us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:55.603756 (+  1515us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:55.605487 (+  1731us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:55.643389 (+ 37902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:55.643561 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:01:55.643605 (+    44us) write_op.cc:312] APPLY: finished
0709 13:01:55.643846 (+   241us) log.cc:844] Serialized 41 byte log entry
0709 13:01:55.651375 (+  7529us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.651476 (+   101us) write_op.cc:454] Released schema lock
0709 13:01:55.651552 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:55.651898 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.651923 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":235046,"reported_tablets":6,"spinlock_wait_cycles":28719360,"child_traces":[["op",{"apply.queue_time_us":5759,"apply.run_cpu_time_us":5785,"apply.run_wall_time_us":51511,"num_ops":4,"prepare.queue_time_us":251,"prepare.run_cpu_time_us":3146,"prepare.run_wall_time_us":3145,"replication_time_us":139161}]]}
I20260709 13:01:57.172140  8112 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:57.201930  8112 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:57.203706  8112 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 5, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 5 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:01:57.182462 10074 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:57.195014  8896 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:57.180094 10210 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:57.219782  8362 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.015s	sys 0.077s
I20260709 13:01:57.220263 10133 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:57.220834 10133 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:57.223193 10133 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:57.225301 10098 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:57.226256  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.225826 10098 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:57.238201 10188 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.242187  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.242998  8217 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
I20260709 13:01:57.237792 10203 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.262599  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.263315  8213 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:57.225839 10127 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:57.245582  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:57.220304  8362 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.015s	sys 0.077s
I20260709 13:01:57.239289 10146 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.294382  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.263967 10098 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:57.264652 10089 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.297438  8862 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:57.302376 10224 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.303001 10224 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.303294  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.298401  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.309880 10191 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.310525 10191 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.312691 10191 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.313194 10191 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.315219  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.318455  8862 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:57.318989 10200 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.319607 10200 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.313613 10191 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.323117 10187 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.323909 10180 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.324580 10109 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.324420 10180 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:57.325089 10109 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.325886 10197 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.324378 10104 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:57.326527 10197 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.326681 10104 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:57.327752 10074 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.328158 10074 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.328375  8259 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:57.329795 10014 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.330308 10014 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.332876 10196 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:57.328636 10210 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:57.335491 10210 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.335891 10210 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.289136 10127 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.338498  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.339395  8363 raft_consensus.cc:2410] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:57.339927 10127 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.316708 10089 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.343272 10089 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.323699 10187 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.344347  8209 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
I20260709 13:01:57.238852 10188 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.289000 10203 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.295862 10146 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.350864 10203 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:57.351557  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.352906 10188 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:57.353714 10109 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.354607  8862 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:01:57.356689  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 468347us
I20260709 13:01:57.358345  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.346844 10074 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.360713  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.362144  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.348052 10133 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.371424  8364 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:01:57.360795 10188 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:57.376449  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.028s	sys 0.075s
W20260709 13:01:57.386595  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.028s	sys 0.075s
W20260709 13:01:57.386967  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 641234us
I20260709 13:01:57.377190  9974 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.366106 10203 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.362856 10075 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.373678 10133 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.438161 10187 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.387643  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:01:57.452787  8257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.026s	sys 0.001s
W20260709 13:01:57.488433  8257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.026s	sys 0.001s
I20260709 13:01:57.466667 10203 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.385412 10188 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.433168 10189 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:01:57.452675  8861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.009s	sys 0.008s
W20260709 13:01:57.496029  8861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.009s	sys 0.008s
W20260709 13:01:57.490171  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 566391us
W20260709 13:01:57.490890  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.000s	sys 0.018s
I20260709 13:01:57.493287  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.634852 10104 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:57.636449  8890 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:57.651091 10098 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:57.671705 10098 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.672667  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.673524  8214 raft_consensus.cc:2410] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:57.603813  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.673800  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.675468  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:57.676120  8285 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:57.677683  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.674587  8894 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:57.509742 10191 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.679723 10146 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:57.479900 10075 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.684082 10075 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:57.573173 10222 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:01:57.585247 10133 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.634264 10119 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:57.673884 10098 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:01:57.688592  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.000s	sys 0.019s
I20260709 13:01:57.688995  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.687714  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.690129  8209 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:57.691305  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.691655  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.692282  8215 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
I20260709 13:01:57.635317 10226 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.694777  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.573758 10194 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:57.695502  8898 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:57.516211 10188 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.697327  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.697504  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.699023  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.699189  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.699826  8361 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:01:57.700613  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.701035  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.702240  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.687726  8895 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
W20260709 13:01:57.615273  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 227680us
I20260709 13:01:57.703531  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.705518 10200 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.704247  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.695386  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:57.689710 10189 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.704272  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:57.714248  8862 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:57.719713  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:57.777427  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 67711.8us
I20260709 13:01:57.787801  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.787904  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.780550  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:57.788774  8363 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:57.798465  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:57.801236  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 80432.8us
I20260709 13:01:57.804008  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.705466 10207 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:01:57.803992  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 99816.9us
I20260709 13:01:57.804759  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:57.805510  8285 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
I20260709 13:01:57.808153  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:57.816462  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 102304us
I20260709 13:01:57.788100  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1417) took 1269 ms. Trace:
I20260709 13:01:57.817359  8862 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:57.824234  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.804661  9974 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:57.788379  8891 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:01:57.688396 10119 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.838563  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.809305 10191 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.845845  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.846652  8214 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:57.846517 10191 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.841953 10217 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:57.853426  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 72985.9us
I20260709 13:01:57.852010  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:57.817703  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:57.848872 10191 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.983769 10212 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.868664  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:57.980804  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 151474us
I20260709 13:01:57.984239 10212 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.985199 10234 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.985385 10212 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.986003  9963 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.986204 10221 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.986656  8864 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:57.899999  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.821774 10224 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:57.801180 10175 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:01:57.980521  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 163203us
I20260709 13:01:57.829512 10133 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.200s
I20260709 13:01:57.914343  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:57.985767 10234 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.818418 10207 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.072023  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:58.348451  8289 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:58.299093  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:57.984580 10095 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:58.353979  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:58.357134  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:58.168685  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 92646.6us
I20260709 13:01:58.352656  8287 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:01:58.369654  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:58.377960  8291 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
I20260709 13:01:57.826489 10104 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:57.695669 10194 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.060987  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:57.986608  9963 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:57.901146  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.868091  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:01:57.868084  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46691us
I20260709 13:01:58.168550  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:57.984323 10097 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:57.982748 10119 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:57.900655 10091 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:58.228025  9949 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:58.024742  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 615) took 1139 ms. Trace:
I20260709 13:01:57.862764 10195 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:58.437273  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:58.056041 10083 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:58.384442  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 397818us
I20260709 13:01:58.413460  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:58.298509 10200 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:01:58.426342 10188 consensus_meta.cc:287] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.730s	user 0.005s	sys 0.005s
W20260709 13:01:58.214475 10074 consensus_meta.cc:287] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.000s
I20260709 13:01:58.418263  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:58.454938  8286 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:01:58.167964 10089 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:58.054973 10217 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:57.990018 10176 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.390s
I20260709 13:01:58.338297 10187 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:58.321573  8257 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:58.435468  9949 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:58.431067  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:58.135905 10099 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:58.135649  8360 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:01:58.381140 10239 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:58.355486 10125 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:01:58.450039 10083 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:57.986748 10221 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.450887  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:58.488068  8898 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
W20260709 13:01:58.178925 10238 log.cc:927] Time spent T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
I20260709 13:01:58.416672 10196 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:58.452241  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:58.460140  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:58.461099  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:58.462688  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:58.462905  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:58.494230  8896 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:01:58.379799 10095 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.474316  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:01:58.474944  9963 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:58.477605  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:58.458913 10257 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:58.447170  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:58.421077 10104 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.476866 10189 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:58.422160 10097 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.459354 10075 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:58.466101 10217 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:58.496481  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 148538us
I20260709 13:01:58.442032 10091 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.471112  9949 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.459096 10188 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.470268 10191 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:58.483017 10187 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:58.510180  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 642060us
I20260709 13:01:58.475392 10252 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:58.491204 10083 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.825858  8362 rpcz_store.cc:276] 0709 13:01:56.508671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.517036 (+  8365us) service_pool.cc:224] Handling call
0709 13:01:56.539573 (+ 22537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.558520 (+ 18947us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:57.300312 (+741792us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.614017 (+313705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.649808 (+ 35791us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:57.663690 (+ 13882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.668321 (+  4631us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.778161 (+109840us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55129,"prepare.queue_time_us":713303,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1019,"raft.queue_time_us":132278,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":15296,"spinlock_wait_cycles":24406784,"thread_start_us":817876,"threads_started":2,"wal-append.queue_time_us":532189}
I20260709 13:01:58.542526 10188 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:58.442284  8889 rpcz_store.cc:276] 0709 13:01:56.885816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.887955 (+  2139us) service_pool.cc:224] Handling call
0709 13:01:56.933793 (+ 45838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.950622 (+ 16829us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:57.430709 (+480087us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.821389 (+390680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.826331 (+  4942us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:57.834630 (+  8299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.851746 (+ 17116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.989553 (+137807us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58813,"prepare.queue_time_us":1301748,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":56,"raft.queue_time_us":37644,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":152142,"spinlock_wait_cycles":23333248,"thread_start_us":770117,"threads_started":2,"wal-append.queue_time_us":550933}
I20260709 13:01:58.526420 10075 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.461396 10074 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.548780 10075 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:58.549947 10074 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:58.550637  8894 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:01:58.527997 10232 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.377s	user 0.000s	sys 0.001s
I20260709 13:01:58.517423  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:58.471814 10089 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.462359 10200 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:58.510120  8287 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:01:58.461076 10195 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.476276 10099 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.517987  9963 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:01:58.516891  8364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.024s	sys 0.017s
W20260709 13:01:58.555415  8364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.024s	sys 0.018s
I20260709 13:01:58.485538 10239 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:58.523245 10014 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:58.528180 10191 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:01:58.564944  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 243429us
I20260709 13:01:58.518142 10196 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.740262  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:58.741209  8215 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:58.742317  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:58.566984 10191 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:58.518567 10257 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:58.579718 10014 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:58.594408 10207 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:58.552325 10252 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.763418 10252 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:58.644527  9963 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.772490 10239 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:58.773231  9963 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:58.771147  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1418) took 2238 ms. Trace:
I20260709 13:01:58.776160  8365 rpcz_store.cc:276] 0709 13:01:56.533242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.533373 (+   131us) service_pool.cc:224] Handling call
0709 13:01:56.546503 (+ 13130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.840543 (+294040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.840575 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.851909 (+ 11334us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.377002 (+525093us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:57.377039 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.377212 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.770905 (+1393693us) raft_consensus.cc:1685] finished
0709 13:01:58.770925 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.771059 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68585,"raft.queue_time_us":126176,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":220,"thread_start_us":693528,"threads_started":2,"wal-append.queue_time_us":942162}
I20260709 13:01:58.752923 10194 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:58.778149 10109 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:58.794186 10207 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:01:58.884995  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 361573us
W20260709 13:01:58.887828  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 427678us
W20260709 13:01:58.919425  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 338777us
I20260709 13:01:58.778615 10014 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.873970 10109 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.927624  8257 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:58.872308 10234 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:58.883028 10221 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:58.930963  8258 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:01:58.927719 10212 consensus_meta.cc:287] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.939s	user 0.013s	sys 0.000s
I20260709 13:01:58.887591 10264 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:58.887286 10262 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:58.951419  8257 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:01:58.938006 10242 log.cc:927] Time spent T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.431s	user 0.002s	sys 0.000s
I20260709 13:01:58.928752 10109 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.889153 10207 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.889055 10083 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:58.935590 10095 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:59.017083  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 99967.4us
W20260709 13:01:59.010988 10256 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:01:59.016175 10246 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 13:01:58.960429 10234 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.023691 10089 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:58.960317 10269 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:59.025327 10195 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.051219  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:58.959733 10243 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.432s	user 0.001s	sys 0.001s
W20260709 13:01:58.960215 10254 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:01:59.061573  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:59.062397  8214 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 1.
I20260709 13:01:58.954727 10258 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.016307 10091 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:58.952471 10104 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.024817 10257 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:58.952899 10264 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.048173  8184 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:59.026966  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 1846) took 1869 ms. Trace:
I20260709 13:01:59.053396  8331 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:59.051486 10269 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.060181  8209 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:59.021947  9963 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.065299 10270 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:58.950938 10212 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:59.062278  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.023s	sys 0.051s
W20260709 13:01:59.086494  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.024s	sys 0.051s
W20260709 13:01:59.086819  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 547324us
I20260709 13:01:59.032104 10200 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:59.074734  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 113198us
I20260709 13:01:59.075623  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:01:59.075063  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 116864us
I20260709 13:01:59.032243 10187 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.089929  8218 raft_consensus.cc:2410] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:59.064734 10099 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.090005  8257 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:01:59.083931  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.020s	sys 0.071s
I20260709 13:01:59.092334 10266 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:59.093708  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.020s	sys 0.072s
I20260709 13:01:59.095026  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:59.081663 10264 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.088605  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.082998 10269 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.082782 10196 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.102711  8257 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:59.100406 10266 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.105239 10266 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.081038  8290 rpcz_store.cc:276] 0709 13:01:57.157179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.157309 (+   130us) service_pool.cc:224] Handling call
0709 13:01:57.157697 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.320749 (+163052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.320785 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.321312 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.688716 (+367404us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:57.688795 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.688874 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.026693 (+1337819us) raft_consensus.cc:1685] finished
0709 13:01:59.026728 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.026894 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162531,"raft.queue_time_us":163900,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":202628,"threads_started":1,"wal-append.queue_time_us":1118353}
I20260709 13:01:59.110896 10207 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.111227  8257 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:59.094558  9963 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.114631  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.115597  8358 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:01:59.115821 10212 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.096119 10098 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.088625 10277 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:01:59.113807  9963 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.101709 10270 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:59.107594 10200 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:59.122658  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 74579.4us
I20260709 13:01:59.081199 10258 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.129065 10283 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:59.129913  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.107270  8360 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:59.119661 10104 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.100318 10176 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:01:59.124065 10195 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:59.127208 10099 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.157328  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 1847) took 1942 ms. Trace:
I20260709 13:01:59.155684  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:59.159401 10195 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.161258  8292 rpcz_store.cc:276] 0709 13:01:57.158380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.158500 (+   120us) service_pool.cc:224] Handling call
0709 13:01:57.158828 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.321963 (+163135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.321992 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.322460 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.689005 (+366545us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:57.689056 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.689119 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.100645 (+1411526us) raft_consensus.cc:1685] finished
0709 13:01:59.100671 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.100831 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162701,"raft.queue_time_us":163077,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"thread_start_us":241056,"threads_started":1,"wal-append.queue_time_us":1157771}
I20260709 13:01:59.164800 10195 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:59.126569  8358 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 341) took 1412 ms (client timeout 1882 ms). Trace:
I20260709 13:01:59.137419 10200 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:01:59.163141  9949 consensus_meta.cc:287] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.002s
W20260709 13:01:59.166805 10217 consensus_meta.cc:287] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.002s
I20260709 13:01:59.157236 10014 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.128533 10098 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.181211  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.188298  8183 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:01:59.138391 10270 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.195194  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.179268 10083 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.196244  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.179513 10200 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.192016  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.178303 10191 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.207871 10279 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:59.210201  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.194419 10206 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.275002 10272 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:59.215154  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:59.196091 10210 consensus_meta.cc:287] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.860s	user 0.014s	sys 0.000s
I20260709 13:01:59.204689 10207 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:01:59.169341  8358 rpcz_store.cc:269] 0709 13:01:57.712267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.114129 (+1401862us) service_pool.cc:224] Handling call
0709 13:01:59.124343 (+ 10214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:59.202978 10180 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:59.278184 10273 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:01:59.283100 10263 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:59.283538 10271 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:01:59.283919 10249 log.cc:927] Time spent T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:01:59.289001 10288 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:59.186430 10217 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.180051 10276 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.266620 10099 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.186558  9949 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.272369 10289 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.315315  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 614) took 2429 ms. Trace:
I20260709 13:01:59.307698 10191 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.309154  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:59.307389 10244 log.cc:927] Time spent T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.326s	user 0.009s	sys 0.005s
I20260709 13:01:59.280277 10279 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:59.346489  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.347482  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.280146 10210 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.349812  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.290160 10272 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:01:59.352279  8359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 352) took 1552 ms (client timeout 1934 ms). Trace:
I20260709 13:01:59.324860 10263 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:01:59.337965 10283 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.370826  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.290867 10207 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.342512 10234 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.306038 10195 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:59.352325 10290 log.cc:927] Time spent T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:59.372054  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.373304  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.348067 10279 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.342274 10099 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.335511 10288 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.334484 10276 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.323097 10206 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.351220 10289 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.650288 10270 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.376253 10234 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.652549 10234 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.654652  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.379420  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.520812  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:59.656585  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.656852  8287 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:59.657204  8285 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:59.582509  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.370580 10263 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.552073  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:01:59.444800  8183 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.018s (SENT) [suppressed 4 similar messages]
I20260709 13:01:59.658654  8365 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:59.673086  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.378814  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:01:59.520141  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.675889  8367 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
W20260709 13:01:59.656364 10269 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.540s	user 0.004s	sys 0.007s
I20260709 13:01:59.674815  8286 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.679957  8366 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:59.655177 10195 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:01:59.563840 10109 consensus_meta.cc:287] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.546s	user 0.018s	sys 0.000s
I20260709 13:01:59.686630  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:59.668999 10291 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.705221  8259 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:59.684643 10269 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.663655 10217 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.654507  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 511) took 1805 ms. Trace:
I20260709 13:01:59.410224 10098 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:59.711483  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:01:59.712939  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:59.617956 10200 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.701754 10276 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.678030 10176 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.683441 10104 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.688512  8360 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:01:59.335420  8892 rpcz_store.cc:276] 0709 13:01:56.885492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.887911 (+  2419us) service_pool.cc:224] Handling call
0709 13:01:57.044279 (+156368us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:01:57.044982 (+   703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.148642 (+103660us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:57.563298 (+414656us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.981129 (+417831us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.981198 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:57.981257 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.314888 (+1333631us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54007454d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:01:59.314985 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.315179 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1165446,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":156613,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":35083,"spinlock_wait_cycles":251488384,"thread_start_us":509471,"threads_started":2,"wal-append.queue_time_us":1443302}
I20260709 13:01:59.721081 10288 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:59.721240 10289 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.721946 10191 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.710528 10016 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:59.718556  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:01:59.360374  8359 rpcz_store.cc:269] 0709 13:01:57.799546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.800903 (+  1357us) service_pool.cc:224] Handling call
0709 13:01:59.308941 (+1508038us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:01:59.352169 (+ 43228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13544704}
I20260709 13:01:59.706700 10210 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.700050 10279 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:01:59.717384 10264 consensus_meta.cc:287] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
I20260709 13:01:59.742524  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:59.468102 10283 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.734546  8286 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:01:59.744887  8332 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:01:59.723572 10098 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.717231 10277 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:59.735859  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 291039us
I20260709 13:01:59.724217  9949 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.709847 10109 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.710305 10180 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.743136  8259 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:59.745373  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.734004 10276 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.748703 10277 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.749046  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 473) took 2056 ms. Trace:
I20260709 13:01:59.750926 10279 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.755414 10016 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:59.745260  9984 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.754456  8287 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:59.754796  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:01:59.764817  8285 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:59.730407 10176 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.766189 10294 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:59.766670 10294 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.710999  8288 rpcz_store.cc:276] 0709 13:01:57.849207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.863487 (+ 14280us) service_pool.cc:224] Handling call
0709 13:01:58.417309 (+553822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.455124 (+ 37815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.459255 (+  4131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.465263 (+  6008us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:58.467663 (+  2400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.654238 (+1186575us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b54001d6ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:01:59.654288 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.654440 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46579072}
I20260709 13:01:59.742864 10270 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:59.742000 10195 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:59.735253 10104 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.760243 10297 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:59.763275 10099 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.745375 10264 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.764022  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.789270  8291 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:01:59.714982 10291 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.754359 10098 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.758188 10277 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.761605  9984 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.776616 10195 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.757789  8893 rpcz_store.cc:276] 0709 13:01:57.692801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.692912 (+   111us) service_pool.cc:224] Handling call
0709 13:01:57.693765 (+   853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.447438 (+753673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.455052 (+  7614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.459202 (+  4150us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:58.464918 (+  5716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.746776 (+1281858us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54003ce6d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:01:59.748565 (+  1789us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.748931 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702259456}
I20260709 13:01:59.779693 10269 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.780635 10203 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:59.780823 10104 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:59.782152  8894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 620) took 2094 ms (client timeout 2018 ms). Trace:
I20260709 13:01:59.764346 10207 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:01:59.782836 10245 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 1.798s	user 0.005s	sys 0.010s
I20260709 13:01:59.783737 10109 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:01:59.803277  8894 rpcz_store.cc:269] 0709 13:01:57.687984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.688699 (+   715us) service_pool.cc:224] Handling call
0709 13:01:59.781853 (+2093154us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b540024dbd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:01:59.782009 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978813696}
I20260709 13:01:59.783999 10263 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.805575 10263 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.784790 10206 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.759285 10276 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.786579  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 471) took 2096 ms. Trace:
I20260709 13:01:59.780565 10200 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:01:59.788417 10266 consensus_meta.cc:287] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.683s	user 0.000s	sys 0.015s
I20260709 13:01:59.767056 10294 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.792309 10264 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.792910 10098 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:59.807535  8897 rpcz_store.cc:276] 0709 13:01:57.690066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.690225 (+   159us) service_pool.cc:224] Handling call
0709 13:01:57.690508 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.987690 (+297182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.987720 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.987760 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:57.987791 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.786349 (+1798558us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54005154d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:01:59.786390 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.786515 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682941184}
I20260709 13:01:59.808555  8259 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:59.793797  9984 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:59.812341  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46595.4us
I20260709 13:01:59.820336  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:59.822655 10264 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:59.823108 10264 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.823508 10264 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.824239  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.824890  8288 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:01:59.822934  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.828482 10291 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.822629  8259 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:59.813027 10176 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:59.822012 10297 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:59.834542 10297 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.835199 10297 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.829025 10098 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.812686 10266 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.943432  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.944829  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 484) took 1495 ms. Trace:
I20260709 13:01:59.821489 10276 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.942214  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.839884  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.954437  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:59.889837 10189 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.954681  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.941293  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:59.827258 10195 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:59.945128  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.830955 10291 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.847396  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.847815 10119 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:01:59.833452 10109 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:59.836068 10098 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.978067  9984 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:01:59.979527 10283 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.954435  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.957612 10301 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:01:59.981832 10301 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:59.982183 10301 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:01:59.982766 10272 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.982867 10098 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:01:59.983126 10301 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.955551 10189 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.984416 10301 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.955324  8290 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:01:59.980479  9984 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:01:59.987208 10297 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.989578 10189 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.989732  8291 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
W20260709 13:01:59.992092  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.827024 10097 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:01:59.955318  8287 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:01:59.956254  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.989786 10297 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:00.000686  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:59.831725  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:01:59.883558  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:01:59.996273  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.957078 10291 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:01:59.997925 10258 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:00.002715  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.967927  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:59.969849  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:00.165051  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:01:59.968240  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:59.969959  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:01:59.972250  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:00.165848  8217 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.089660  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:00.164986  8209 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
W20260709 13:02:00.088915  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 114163us
W20260709 13:02:00.112978  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 96968.4us
W20260709 13:02:00.059428  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 54848.1us
I20260709 13:02:00.020068  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:00.113957  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:00.171033  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 57180.5us
W20260709 13:02:00.171584  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 340082us
I20260709 13:02:00.174716  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:00.165566  8214 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:01:59.985703 10294 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:00.180624 10294 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:00.181372  8366 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:00.184185 10189 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:00.184880 10189 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.185781 10260 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:00.185894  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:00.186581 10260 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.187731 10097 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:00.188256 10097 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.188733 10097 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.189189  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.189862  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.190667  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.191716 10260 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:00.190577  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.190610  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.190982  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.195860  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:00.196487  8891 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.196648  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.197345  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.197621  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:00.198185  8893 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:02:00.199255  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:00.197379  8897 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:00.192997 10189 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:00.204396  8892 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:00.211740  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:00.213481  8893 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:00.218441  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 43852.5us
W20260709 13:01:59.963639  8863 connection.cc:256] RPC call timeout handler was delayed by -1.5572409570000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:02:00.226444  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 54639.3us
I20260709 13:02:00.228264  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:00.230495  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 52494us
I20260709 13:02:00.234167  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:01:59.956311  8898 rpcz_store.cc:276] 0709 13:01:58.449372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.502517 (+ 53145us) service_pool.cc:224] Handling call
0709 13:01:58.519398 (+ 16881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.519650 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:58.540150 (+ 20500us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.944436 (+1404286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:59.944493 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:59.944550 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.944630 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.944762 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1237315,"prepare.queue_time_us":18222,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1253340,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":90,"thread_start_us":166495,"threads_started":1,"wal-append.queue_time_us":352758}
I20260709 13:02:00.231491  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:01:59.959595 10197 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:00.238829  8863 connection.cc:256] RPC call timeout handler was delayed by -1.2251471329999504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 13:01:59.957810  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.955747 10276 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:00.245533  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:00.170168 10206 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:59.985769  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:01:59.958683 10109 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:01:59.960191 10095 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.286845  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.287551  8898 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 3: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:00.249305  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:00.245157  8863 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:00.252530  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.248873 10189 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.254176 10300 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:00.243047 10184 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:01:59.958334 10119 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.228029 10263 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:00.246850  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 68553.2us
I20260709 13:02:00.248371  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:01:59.960001 10274 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:00.274643  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:00.327414  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 52862.9us
I20260709 13:02:00.228096 10234 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:00.226015 10176 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:00.231534  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:00.341735  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:00.342154 10104 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.342450  8359 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:02:00.300335  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:00.343560  8218 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.343778  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 1837) took 1172 ms. Trace:
I20260709 13:02:00.344224  8360 rpcz_store.cc:276] 0709 13:01:59.170907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.178956 (+  8049us) service_pool.cc:224] Handling call
0709 13:02:00.343596 (+1164640us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400181354. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:00.343714 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930374400}
I20260709 13:02:00.303340 10095 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.247304 10268 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:00.260950 10258 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:00.257726 10303 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:00.302366  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 57300.4us
I20260709 13:01:59.959780 10277 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.305459  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:00.259246 10276 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:00.277662 10207 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:00.312407  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:00.313223  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.392231  8898 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
W20260709 13:02:00.329169  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 80863.2us
I20260709 13:02:00.284559  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:00.289445 10109 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.336946  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:00.337919  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:00.349876  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:00.348320 10175 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:00.364509  8894 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:00.366962  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:00.373040  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.381552  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:00.413334  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:00.472237  8365 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:00.329883 10266 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:00.330341 10289 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:00.285061 10206 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:00.331928 10234 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.351312  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:00.515486  8215 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:00.426724  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 76926.6us
I20260709 13:02:00.463385  8210 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.467245  8212 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.330065 10302 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:00.358894 10258 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:00.358625 10268 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:00.393692 10276 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.310053 10189 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.471947 10104 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:00.349018 10274 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.329517 10184 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.415068 10207 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:00.311101 10300 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.393970 10303 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:00.360533 10176 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.257911  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:01.259775  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:00.583632  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:01.156798  8215 consensus_meta.cc:287] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.003s
W20260709 13:02:01.104899  8212 consensus_meta.cc:287] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.587s	user 0.016s	sys 0.019s
W20260709 13:02:00.892273  8217 consensus_meta.cc:287] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.018s
W20260709 13:02:01.045385  8286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.019s	sys 0.033s
I20260709 13:02:01.262588  8217 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:01.256500  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.264971  8215 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
W20260709 13:02:00.707774  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.262970  8286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.021s	sys 0.037s
I20260709 13:02:01.263680  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:01.257236  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 863273us
I20260709 13:02:01.261906  8212 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
W20260709 13:02:00.847621  8218 consensus_meta.cc:287] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.504s	user 0.000s	sys 0.034s
I20260709 13:02:01.270066  8218 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:00.986986  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:01.279091  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 324349us
W20260709 13:02:01.280233  8332 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.039s	sys 0.083s
W20260709 13:02:01.346769  8332 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.039s	sys 0.083s
I20260709 13:02:01.347002  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:01.347108  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 1.03944e+06us
I20260709 13:02:01.347141  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:01.347666  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39866 (request call id 522) took 1110 ms. Trace:
I20260709 13:02:01.347833  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39866 (request call id 533) took 1004 ms. Trace:
W20260709 13:02:01.348340  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 68516.3us
I20260709 13:02:01.348348  8218 rpcz_store.cc:276] 0709 13:02:00.343617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.346714 (+1003097us) service_pool.cc:224] Handling call
0709 13:02:01.347768 (+  1054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.352120  8217 rpcz_store.cc:276] 0709 13:02:00.163330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.164803 (+  1473us) service_pool.cc:224] Handling call
0709 13:02:01.274066 (+1109263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.244714 10264 consensus_meta.cc:287] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.421s	user 0.010s	sys 0.005s
W20260709 13:02:01.139599 10304 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.293s	user 0.000s	sys 0.000s
I20260709 13:02:01.369772  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:01.370639  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:01.155108 10097 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.966s	user 0.010s	sys 0.020s
I20260709 13:02:01.374843  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 630) took 1029 ms. Trace:
I20260709 13:02:01.375415  8898 rpcz_store.cc:276] 0709 13:02:00.344967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.370369 (+1025402us) service_pool.cc:224] Handling call
0709 13:02:01.374776 (+  4407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.375142  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:01.376567  8212 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.376688  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:00.583150 10234 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.512008 10175 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:00.622186  9974 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:01.381072  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 629) took 1049 ms. Trace:
I20260709 13:02:01.385102  8898 rpcz_store.cc:276] 0709 13:02:00.331503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.376442 (+1044939us) service_pool.cc:224] Handling call
0709 13:02:01.381006 (+  4564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:00.953567 10016 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:00.923174  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:01.277475 10258 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.277570 10268 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.277144 10207 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.690507 10221 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:01.386214  8897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.026s	sys 0.059s
I20260709 13:02:00.932307 10283 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:01.258939 10302 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:01.388005  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.032s	sys 0.081s
I20260709 13:02:01.282187 10119 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:01.282521 10206 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:01.293399 10104 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:01.390961  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:01.369118 10310 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.367231 10252 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:01.380934  8889 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.121s	sys 0.192s
W20260709 13:02:01.397226  8897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.026s	sys 0.059s
I20260709 13:02:01.405339 10291 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.398815  8114 catalog_manager.cc:5697] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.401219  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.404085  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:01.407482  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.033s	sys 0.081s
W20260709 13:02:01.450261  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 1.1219e+06us
I20260709 13:02:00.582580 10289 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:01.417088  8213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.008s	sys 0.049s
W20260709 13:02:01.451053  8213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.009s	sys 0.049s
I20260709 13:02:01.451872  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1346) took 1483 ms. Trace:
I20260709 13:02:01.408985 10302 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.398226  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.382583 10097 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.391171  9974 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.441148  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 622) took 1201 ms. Trace:
I20260709 13:02:01.419831  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 633) took 1074 ms. Trace:
I20260709 13:02:01.453296  8183 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:01.464991  8897 rpcz_store.cc:276] 0709 13:02:00.240208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.240369 (+   161us) service_pool.cc:224] Handling call
0709 13:02:00.240740 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.241030 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:00.463527 (+222497us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.440756 (+977229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.440819 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:01.440871 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.440941 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.441084 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1157251,"threads_started":2}
I20260709 13:02:01.424232 10252 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:01.383083 10264 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.420662 10104 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:01.448208  8889 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.121s	sys 0.193s
I20260709 13:02:01.394675 10016 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.466569  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:01.485224  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 631) took 1140 ms. Trace:
I20260709 13:02:01.485597  8897 rpcz_store.cc:276] 0709 13:02:00.345256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.466326 (+1121070us) service_pool.cc:224] Handling call
0709 13:02:01.485163 (+ 18837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.439141 10310 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.472591  9974 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.488435  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:01.416810 10283 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:01.494212  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 361549us
I20260709 13:02:01.490517  8212 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:01.494942  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1356) took 1148 ms. Trace:
I20260709 13:02:01.495359  8897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:01.491273  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:01.496944  8218 raft_consensus.cc:2368] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:01.492372  8331 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:01.423712 10221 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.486922  8895 raft_consensus.cc:2368] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5.
I20260709 13:02:01.495330  8212 rpcz_store.cc:276] 0709 13:02:00.346924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.348041 (+1001117us) service_pool.cc:224] Handling call
0709 13:02:01.494885 (+146844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.500701  8284 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:01.480046 10252 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.495991  8897 raft_consensus.cc:606] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:01.498514  8358 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.159s	user 0.055s	sys 0.081s
I20260709 13:02:01.476706  8890 rpcz_store.cc:276] 0709 13:02:00.345801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.577928 (+232127us) service_pool.cc:224] Handling call
0709 13:02:01.416252 (+838324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.506181  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:01.494652  8891 consensus_meta.cc:287] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.284s	user 0.024s	sys 0.023s
I20260709 13:02:01.519069  8291 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.483536 10083 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.528261  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:01.527706  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58924 (request call id 2) took 1244 ms. Trace:
I20260709 13:02:01.533246  8897 rpcz_store.cc:276] 0709 13:02:00.278841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.495223 (+1216382us) service_pool.cc:224] Handling call
0709 13:02:01.522916 (+ 27693us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.497807  8210 consensus_meta.cc:287] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.924s	user 0.014s	sys 0.022s
W20260709 13:02:01.500317 10301 consensus_meta.cc:287] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 1.515s	user 0.014s	sys 0.007s
I20260709 13:02:01.522161  8215 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:01.520200  8358 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.055s	sys 0.081s
I20260709 13:02:01.502440  9974 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.517230  8216 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.524885  8891 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:01.495029 10119 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:02:01.542400  8361 raft_consensus.cc:2410] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:01.525151  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 621) took 1285 ms. Trace:
I20260709 13:02:01.555472  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.556908  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.558058  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.552333  8291 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:01.554842  8215 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:01.562585  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 487) took 1373 ms. Trace:
I20260709 13:02:01.562984  8894 rpcz_store.cc:276] 0709 13:02:00.189160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.190770 (+  1610us) service_pool.cc:224] Handling call
0709 13:02:01.562403 (+1371633us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400678c54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:01.562523 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392466688}
I20260709 13:02:01.559151  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.538524  8210 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:01.541625  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 491) took 1347 ms. Trace:
I20260709 13:02:01.573702  8284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 528) took 1608 ms. Trace:
I20260709 13:02:01.574545  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1350) took 1336 ms. Trace:
I20260709 13:02:01.570816  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 1853) took 1569 ms. Trace:
I20260709 13:02:01.572901  8114 catalog_manager.cc:5697] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.578802  8114 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 2 to 3, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.574868  8214 rpcz_store.cc:276] 0709 13:02:00.238407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.241405 (+  2998us) service_pool.cc:224] Handling call
0709 13:02:00.245719 (+  4314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.257537 (+1011818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.257569 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.257627 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:01.257660 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.574395 (+316735us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b5400378cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:01.574424 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.574504 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069682432}
I20260709 13:02:01.576433  8366 rpcz_store.cc:276] 0709 13:02:00.000965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.002272 (+  1307us) service_pool.cc:224] Handling call
0709 13:02:00.002545 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.181848 (+179303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.570589 (+1388741us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540043bf54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:01.570746 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410785152}
I20260709 13:02:01.576817  8284 rpcz_store.cc:276] 0709 13:01:59.965446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.247415 (+281969us) service_pool.cc:224] Handling call
0709 13:02:00.290807 (+ 43392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.505510 (+1214703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.573479 (+ 67969us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400401854. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:01.573644 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781799168}
I20260709 13:02:01.582541  8114 catalog_manager.cc:5697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 2 to 4, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:02:01.559091 10176 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.563582 10184 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.503995 10175 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.566476  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 492) took 1371 ms. Trace:
I20260709 13:02:01.595242  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39866 (request call id 519) took 1582 ms. Trace:
I20260709 13:02:01.601863  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.599421  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 529) took 1256 ms. Trace:
I20260709 13:02:01.581164 10303 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:01.609519  8214 rpcz_store.cc:276] 0709 13:02:00.342528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.597250 (+1254722us) service_pool.cc:224] Handling call
0709 13:02:01.598843 (+  1593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.599054 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.599080 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.599124 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:01.599166 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.599245 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.599357 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.570387 10274 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:01.625730  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1354) took 1279 ms. Trace:
I20260709 13:02:01.630982  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 530) took 1288 ms. Trace:
I20260709 13:02:01.631448  8209 rpcz_store.cc:276] 0709 13:02:00.342831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.609379 (+1266548us) service_pool.cc:224] Handling call
0709 13:02:01.630474 (+ 21095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.630652 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.630678 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.630722 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:01.630752 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.630804 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.630919 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.632722  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.628980  8215 rpcz_store.cc:276] 0709 13:02:00.346300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.346845 (+1000545us) service_pool.cc:224] Handling call
0709 13:02:01.625530 (+278685us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400473bd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:01.625659 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400371072}
I20260709 13:02:01.633850  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.598390 10300 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.641469  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.555358  8892 rpcz_store.cc:276] 0709 13:02:00.239891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.245035 (+  5144us) service_pool.cc:224] Handling call
0709 13:02:00.333563 (+ 88528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.393843 (+1060280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.404981 (+ 11138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.407633 (+  2652us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:01.414065 (+  6432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.503400 (+ 89335us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54005c9ed4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:01.507814 (+  4414us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.522316 (+ 14502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379258752}
I20260709 13:02:01.607317 10189 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:01.642177 10097 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:01.676134  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:01.676503  8209 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:01.606571  8891 rpcz_store.cc:276] 0709 13:02:00.195421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.195573 (+   152us) service_pool.cc:224] Handling call
0709 13:02:01.563691 (+1368118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.641709 10300 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:01.677958  8112 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48060 (request call id 276) took 4779 ms. Trace:
I20260709 13:02:01.678755  8212 raft_consensus.cc:2368] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:01.679728  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 1865) took 1851 ms. Trace:
W20260709 13:02:01.680157  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 402969us
I20260709 13:02:01.686594  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1969) took 1339 ms. Trace:
I20260709 13:02:01.607560  8210 rpcz_store.cc:276] 0709 13:01:59.999666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.164026 (+164360us) service_pool.cc:224] Handling call
0709 13:02:01.573787 (+1409761us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.689023  8863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.025s	sys 0.042s
I20260709 13:02:01.658046 10264 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.682287  8112 rpcz_store.cc:276] 0709 13:01:56.892669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.901743 (+  9074us) service_pool.cc:224] Handling call
0709 13:02:01.671927 (+4770184us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:57.834026 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:58.179638 (+345612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:58.179682 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:01:58.179696 (+    14us) tablet.cc:662] Decoding operations
0709 13:01:58.180376 (+   680us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:58.180442 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:58.180472 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:58.180861 (+   389us) tablet.cc:701] Row locks acquired
0709 13:01:58.180880 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:58.181071 (+   191us) write_op.cc:270] Start()
0709 13:01:58.181200 (+   129us) write_op.cc:276] Timestamp: P: 1783602118181008 usec, L: 0
0709 13:01:58.181219 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:01:58.381883 (+200664us) log.cc:844] Serialized 1662 byte log entry
0709 13:01:59.121823 (+739940us) op_driver.cc:464] REPLICATION: finished
0709 13:01:59.438267 (+316444us) write_op.cc:301] APPLY: starting
0709 13:01:59.438353 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:59.444144 (+  5791us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:59.450580 (+  6436us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:59.451134 (+   554us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:59.486999 (+ 35865us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:01:59.552341 (+ 65342us) write_op.cc:312] APPLY: finished
0709 13:01:59.575606 (+ 23265us) log.cc:844] Serialized 41 byte log entry
0709 13:01:59.575859 (+   253us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:59.575971 (+   112us) write_op.cc:454] Released schema lock
0709 13:01:59.576015 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:59.658601 (+ 82586us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:59.658634 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110132,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":265475,"apply.run_cpu_time_us":3572,"apply.run_wall_time_us":144032,"num_ops":4,"prepare.queue_time_us":511715,"prepare.run_cpu_time_us":15204,"prepare.run_wall_time_us":829510,"raft.queue_time_us":108486,"raft.run_cpu_time_us":57609,"raft.run_wall_time_us":212394,"replication_time_us":940453,"thread_start_us":621311,"threads_started":4,"wal-append.queue_time_us":363513,"wal-append.run_cpu_time_us":23805,"wal-append.run_wall_time_us":1797801}]]}
I20260709 13:02:01.690677  8209 rpcz_store.cc:276] 0709 13:02:00.347194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.652014 (+1304820us) service_pool.cc:224] Handling call
0709 13:02:01.676358 (+ 24344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.686263 (+  9905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.686523 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.682632  8286 rpcz_store.cc:276] 0709 13:01:59.828030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.217458 (+389428us) service_pool.cc:224] Handling call
0709 13:02:00.217769 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.217962 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:01.266968 (+1049006us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.677852 (+410884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.677907 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:01.677954 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.678019 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.679666 (+  1647us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1264680,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4480,"thread_start_us":1432866,"threads_started":2}
I20260709 13:02:01.658481 10289 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:01.694870  8863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.025s	sys 0.042s
I20260709 13:02:01.667032 10016 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.666875 10283 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:01.698707  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 629318us
W20260709 13:02:01.710959  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 244372us
I20260709 13:02:01.713402  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:01.688393 10310 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.452235  8213 rpcz_store.cc:276] 0709 13:01:59.968385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.973384 (+  4999us) service_pool.cc:224] Handling call
0709 13:01:59.973672 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.973876 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:00.276622 (+302746us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.451516 (+1174894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.451576 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:01.451637 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.451703 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.451822 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":608842,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":56,"raft.queue_time_us":129,"thread_start_us":1464283,"threads_started":2}
I20260709 13:02:01.682281 10221 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:01.727547  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 356990us
I20260709 13:02:01.716017  8209 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:01.716512  8212 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:01.716979  8286 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:01.747228  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1970) took 1399 ms. Trace:
I20260709 13:02:01.747790  8212 rpcz_store.cc:276] 0709 13:02:00.347439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.692977 (+1345538us) service_pool.cc:224] Handling call
0709 13:02:01.716328 (+ 23351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.738895 (+ 22567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.747160 (+  8265us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.758982  8361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1448) took 1422 ms (client timeout 1596 ms). Trace:
I20260709 13:02:01.759377  8216 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
W20260709 13:02:01.761379  8895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 497) took 1564 ms (client timeout 1866 ms). Trace:
W20260709 13:02:01.761831  8895 rpcz_store.cc:269] 0709 13:02:00.196893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.199003 (+  2110us) service_pool.cc:224] Handling call
0709 13:02:01.761182 (+1562179us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54006aa754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:01.761316 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2959370496}
I20260709 13:02:01.763288  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 623) took 1522 ms. Trace:
I20260709 13:02:01.774757  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1971) took 1427 ms. Trace:
I20260709 13:02:01.775514  8209 rpcz_store.cc:276] 0709 13:02:00.347854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.694931 (+1347077us) service_pool.cc:224] Handling call
0709 13:02:01.715853 (+ 20922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.753979 (+ 38126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.774676 (+ 20697us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.759622  8361 rpcz_store.cc:269] 0709 13:02:00.336819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.337673 (+   854us) service_pool.cc:224] Handling call
0709 13:02:01.754562 (+1416889us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001810d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:01.758921 (+  4359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565456640}
I20260709 13:02:01.787544  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:01.763746  8896 rpcz_store.cc:276] 0709 13:02:00.240509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.240953 (+   444us) service_pool.cc:224] Handling call
0709 13:02:01.564255 (+1323302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.564440 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.564462 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.564501 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:01.564533 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.564582 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.763107 (+198525us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400678c50. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:01.763226 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3042244992}
I20260709 13:02:01.787654  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:01.790709  8291 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:01.794592  8209 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:01.692034 10300 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:01.808413 10300 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:01.797143  8213 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:01.720520 10184 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.810387 10184 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.813732 10184 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.800925  8202 tablet_service.cc:1558] Processing DeleteTablet for tablet 410fe3c36e834265b4c3b139e453a76e with delete_type TABLET_DATA_TOMBSTONED (TS ca43983edda443fa9d74c1f80252f1fc not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39240
W20260709 13:02:01.823745 10318 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:02:01.827314 10109 consensus_meta.cc:287] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.348s	user 0.012s	sys 0.002s
I20260709 13:02:01.827817 10109 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.800125  8217 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:01.819941 10207 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.830497  8215 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:01.832163  8893 consensus_meta.cc:287] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.618s	user 0.017s	sys 0.001s
I20260709 13:02:01.832679  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 531) took 1489 ms. Trace:
I20260709 13:02:01.833073  8215 rpcz_store.cc:276] 0709 13:02:00.343080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.634765 (+1291685us) service_pool.cc:224] Handling call
0709 13:02:01.635072 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.831140 (+196068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.832375 (+  1235us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540007a154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:01.832606 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448811392}
I20260709 13:02:01.814447 10281 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:01.821491 10277 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.835548  8284 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.841478  8212 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:01.837160  8363 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:01.854192  8184 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:01.861336  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:01.839988  8211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.359s	user 0.004s	sys 0.008s
I20260709 13:02:01.863139  8863 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:01.862421  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:01.886363  8211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.006s	sys 0.010s
I20260709 13:02:01.805596 10258 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.796391  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:01.796499 10221 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:01.832629  8893 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
W20260709 13:02:01.898281  8183 connection.cc:256] RPC call timeout handler was delayed by -1.15611261600003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:02:01.944280  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0589126159999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:02:01.944585  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 82221.6us
I20260709 13:02:01.942118  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:01.897680  8862 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:01.945855  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:01.944696  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0383651369999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:02:01.873106  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 260253us
W20260709 13:02:01.947309  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0292126159999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:02:01.948052  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 226902us
W20260709 13:02:01.888216  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 265903us
I20260709 13:02:01.896015  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1349) took 1669 ms. Trace:
I20260709 13:02:01.928946  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:01.950704  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 265477us
I20260709 13:02:01.951799  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:01.955163  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:01.950233  8211 rpcz_store.cc:276] 0709 13:02:00.226249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.228631 (+  2382us) service_pool.cc:224] Handling call
0709 13:02:00.229072 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.229393 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:00.480419 (+251026us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.895550 (+1415131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.895623 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:01.895689 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.895774 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.895927 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":499914,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":10180,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":35016,"thread_start_us":1631054,"threads_started":2}
I20260709 13:02:01.958547  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:01.960482  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 62895.7us
W20260709 13:02:01.960930  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 79582us
I20260709 13:02:01.870736 10229 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.962378  8214 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:01.961777  8862 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:01.962882  8331 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:01.979741  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.979966  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.982240  8218 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:01.889117 10288 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:01.980868  8258 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:01.983237  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:01.984328  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 121259us
I20260709 13:02:01.984690  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:01.987959  8863 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:01.954283 10310 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:01.954159 10176 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:01.990443  8863 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:01.989428  8862 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:01.991302  8218 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:01.992141  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:01.992712 10202 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:01.988692 10326 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.994488 10258 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.002666  8862 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:01.994972 10119 raft_consensus.cc:2764] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:02:01.861085 10281 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.016577  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 532) took 1673 ms. Trace:
I20260709 13:02:02.017017  8214 rpcz_store.cc:276] 0709 13:02:00.343330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.643129 (+1299799us) service_pool.cc:224] Handling call
0709 13:02:01.651036 (+  7907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.962783 (+311747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.016317 (+ 53534us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400002154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:02.016514 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715507072}
I20260709 13:02:01.872455 10268 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.003376  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:01.886421 10289 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:02:02.033655 10289 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:02.034271 10289 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:02.035094 10289 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.036196 10289 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.037160  8284 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:02.012063  8332 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:02.012858  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:02.039991  8331 leader_election.cc:400] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:02.015617  8291 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:01.996440 10310 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:01.983989  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1449) took 1641 ms. Trace:
I20260709 13:02:01.573179  8889 rpcz_store.cc:276] 0709 13:02:00.192455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.192568 (+   113us) service_pool.cc:224] Handling call
0709 13:02:00.192948 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.193345 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.193379 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.193957 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.366567 (+172610us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:01.494552 (+1127985us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.510257 (+ 15705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.524652 (+ 14395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.526806 (+  2154us) raft_consensus.cc:1685] finished
0709 13:02:01.526823 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.539981 (+ 13158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1147946,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2129,"raft.queue_time_us":143186,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":7916,"thread_start_us":1282834,"threads_started":2,"wal-append.queue_time_us":926028}
I20260709 13:02:02.019930  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:01.995519 10294 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.033551  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:01.991989 10328 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:01.954690  8893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 499) took 1755 ms (client timeout 1596 ms). Trace:
I20260709 13:02:02.037832  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:01.953162 10221 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:01.999327 10109 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:01.999372 10300 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:01.898110 10099 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.986346 10288 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:02.040632  8863 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:02.085224  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 44651.5us
I20260709 13:02:02.086203  8863 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:02.004035 10274 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.040284  8331 leader_election.cc:403] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:02:02.088884  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 49013.8us
I20260709 13:02:02.090634  8331 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:02.002570 10303 raft_consensus.cc:2764] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:02:02.005059 10197 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:02.050299 10083 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:02:02.095129 10197 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.095693 10083 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:02.096333 10294 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:02.004561  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:02.000507 10176 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:02.097615 10176 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.047375  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:02.003847 10016 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:02.063264 10300 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:02.052134  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:02.056104  8292 raft_consensus.cc:2393] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 3: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:02.019104  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:02.022480 10277 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:02.040242 10319 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.043949  9974 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:02.048831 10310 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.067802 10334 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:02.070792 10189 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:02.078217 10328 raft_consensus.cc:697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:02.083246 10268 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.092193  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:02.099177  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 118360us
I20260709 13:02:02.059435 10119 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:02.184934 10197 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.168568 10095 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:02:02.195830 10281 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:02.212416 10234 consensus_meta.cc:287] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.820s	user 0.009s	sys 0.001s
I20260709 13:02:02.213109 10234 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.174793  8889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:02.182462  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:02.136822  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:02.089359  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:02.100835 10274 raft_consensus.cc:697] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:02.063019 10314 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:02.096171 10083 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:02.096063 10184 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.066743 10323 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:02.058145  8893 rpcz_store.cc:269] 0709 13:02:00.198949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.211229 (+ 12280us) service_pool.cc:224] Handling call
0709 13:02:01.953750 (+1742521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.093933 10207 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.094331 10097 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:02.100587 10288 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:02.164535 10322 log.cc:927] Time spent T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:02:02.181874  9974 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:02.182329 10221 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.179425  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:02.165364 10016 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.165597 10300 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.183508 10328 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.183795 10279 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:02.165700 10303 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:02.278556 10329 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:02:02.048023  8257 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:02:02.222098  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 217783us
W20260709 13:02:02.225147  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 134573us
I20260709 13:02:02.222847  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:02.176506 10334 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:02.279521  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:02.279798 10016 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.280153 10334 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.224709 10095 consensus_queue.cc:1059] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:02:02.282259 10343 raft_consensus.cc:993] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:02:02.283190 10340 raft_consensus.cc:1081] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:02:02.225244  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:02.255404 10104 consensus_meta.cc:287] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.003s
I20260709 13:02:02.248821  8285 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:02.251718 10294 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.229125 10202 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:02.255131  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 203037us
I20260709 13:02:02.215588 10319 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:02.175784 10277 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.225478 10314 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:02.270835  8288 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.177374 10189 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:02.280314  8363 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:02.294612 10336 tablet_replica.cc:333] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:02:02.295502 10083 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.297333 10324 raft_consensus.cc:3055] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:02.298211  8862 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:02.303916 10176 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.305776 10234 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:02.309449 10302 consensus_meta.cc:287] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.834s	user 0.008s	sys 0.000s
I20260709 13:02:02.047032  8358 rpcz_store.cc:276] 0709 13:02:00.338683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.338914 (+   231us) service_pool.cc:224] Handling call
0709 13:02:00.339327 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.339586 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:01.539419 (+1199833us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.918504 (+379085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.945796 (+ 27292us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:01.949605 (+  3809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.954430 (+  4825us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.980367 (+ 25937us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11024,"prepare.queue_time_us":395512,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":37478,"raft.queue_time_us":27960,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":35415,"thread_start_us":1493473,"threads_started":2,"wal-append.queue_time_us":493054}
I20260709 13:02:02.314456 10274 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:02.319931 10252 consensus_meta.cc:287] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.798s	user 0.007s	sys 0.003s
W20260709 13:02:02.324810  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 278278us
I20260709 13:02:02.337337 10342 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:02.268796 10276 consensus_meta.cc:287] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.902s	user 0.008s	sys 0.004s
I20260709 13:02:02.393534  8257 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:02.339541  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 59689.4us
I20260709 13:02:02.337740 10016 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:02.269568  8889 raft_consensus.cc:606] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:02.384742 10202 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.325321 10323 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:02.346247  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 167874us
I20260709 13:02:02.365753 10184 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:02.365835 10338 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.230585 10321 consensus_queue.cc:1059] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:02:02.290040  9974 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:02.379247  8289 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:02.332572 10294 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:02.364665 10314 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:02.332594  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 109805us
W20260709 13:02:02.387785  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 89635.2us
I20260709 13:02:02.374644 10344 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:02.399513  8293 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:02.399029  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 1872) took 1141 ms. Trace:
I20260709 13:02:02.443084  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:02.335647 10104 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.379673 10324 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:02.445271  8889 raft_consensus.cc:614] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:02.442708 10016 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:02.445542  9974 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:02.446650  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 53053.7us
I20260709 13:02:02.396651  8257 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:02.440925 10336 raft_consensus.cc:2243] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.446811  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:02.447675  8285 rpcz_store.cc:276] 0709 13:02:01.257534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.257670 (+   136us) service_pool.cc:224] Handling call
0709 13:02:02.398773 (+1141103us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b5400416c54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:02.398955 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257833856}
I20260709 13:02:02.396363 10283 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:02.470489  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:02.478655  8258 leader_election.cc:400] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5.
I20260709 13:02:02.388208 10342 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:02.486524  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 153044us
I20260709 13:02:02.489122  8286 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:02.479116  8258 leader_election.cc:403] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.437388 10277 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.424667 10083 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.450670 10234 raft_consensus.cc:3055] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:02.500865 10234 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:02.384917 10302 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.403728 10341 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.495813 10326 consensus_queue.cc:1059] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:02:02.496615  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:02.491660 10342 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.497481 10332 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.486542 10268 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:02.444535 10310 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.466740 10016 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:02.555904  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.394060 10345 consensus_queue.cc:1059] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:02:02.553951  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:02.560391  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:02.561692  8332 connection.cc:256] RPC call timeout handler was delayed by -2.1904459269999279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:02:02.569500  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:02.463250  8362 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:02.571322  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:02.562701  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 84205.2us
I20260709 13:02:02.567023  8894 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:02.572724  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:02.394502 10252 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.573977 10337 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:02.574591 10337 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:02.486784 10339 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.575431 10339 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:02.575548 10337 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.576400 10339 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.577112  8898 raft_consensus.cc:2393] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:02.474481 10258 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:02.579034  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.579428  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.580060  8895 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:02.581040  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:02.557168  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 161140us
I20260709 13:02:02.437808 10276 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.492561 10264 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:02.488382  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:02.566695 10289 consensus_meta.cc:287] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.003s
I20260709 13:02:02.581856  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.594934  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.595384  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:02.584261  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.586915  8257 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:02.546460 10336 raft_consensus.cc:2272] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.584335  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:02.552656  8890 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:02.595608  8896 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:02.596473  8895 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:02.588290  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:02.404292 10189 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.563593 10302 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:02.475737 10343 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:02:02.555490  8288 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:02.601390  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:02.601639  8332 connection.cc:256] RPC call timeout handler was delayed by -1.9510664219999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 13:02:02.446281 10338 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.566943 10176 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:02.604841  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.605850  8366 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:02.608240  8287 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:02.606892  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:02.589582 10341 raft_consensus.cc:697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:02.394562 10319 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:02.608594  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1280931910000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 13:02:02.610730  8367 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.611387  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:02.612107  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:02.457382 10344 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.593158 10258 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:02.601132  8358 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:02.611968 10189 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:02.652807 10341 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.548632 10234 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.604626  8892 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:02.598483 10264 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:02.567132 10268 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.567333 10334 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.622815  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:02:02.623067  8293 raft_consensus.cc:2393] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:02.603971  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:02.558563 10346 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:02:02.624001  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1154931909999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:02:02.760704  8332 connection.cc:256] RPC call timeout handler was delayed by -1.0667925029999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 13:02:02.611915  8290 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:02.623152 10221 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:02:02.765823 10221 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:02.766355 10221 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:02.767318 10221 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.615768 10337 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:02.769001 10337 raft_consensus.cc:697] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:02.655313  8284 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:02:02.691793  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.774444  8365 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:02.801028 10264 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.728024  8214 raft_consensus.cc:606] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:02.650153  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.732277  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:02.803027 10221 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.599381 10294 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.739687  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1989) took 1118 ms. Trace:
I20260709 13:02:02.740156 10344 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.749884 10258 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:02.750715  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:02.649679 10099 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:02:02.755937  8896 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:02:02.758425  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:02.759552  8894 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:02.813167  8367 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:02.813551  8289 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:02.769930 10337 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.661616 10252 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:02.812212 10176 raft_consensus.cc:3055] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.870435 10176 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:02.802258 10310 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:02.820245  8890 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:02.871830 10176 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.815498  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:02.821264  8293 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:02.803926  8216 rpcz_store.cc:276] 0709 13:02:01.620842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.794099 (+173257us) service_pool.cc:224] Handling call
0709 13:02:01.871244 (+ 77145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.092842 (+221598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.092875 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.400338 (+307463us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b2c000014c8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efab46a11 00007f2efab56372 00007f2efc288a01 00007f2efc24d43a 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2
0709 13:02:02.416203 (+ 15865us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.454208 (+ 38005us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:02.454245 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.490894 (+ 36649us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001aefd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:02.490967 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.739442 (+248475us) raft_consensus.cc:1685] finished
0709 13:02:02.739466 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.739620 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511598592,"thread_start_us":37538,"threads_started":1,"wal-append.queue_time_us":205100}
I20260709 13:02:02.878738 10268 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.822245 10334 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.823993 10289 raft_consensus.cc:3055] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.879911 10276 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.880085 10289 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:02.881137 10289 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:02.829308  8898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 627) took 2549 ms (client timeout 2092 ms). Trace:
W20260709 13:02:02.882261  8898 rpcz_store.cc:269] 0709 13:02:00.279696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.390618 (+1110922us) service_pool.cc:224] Handling call
0709 13:02:02.829053 (+1438435us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54005154d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:02.829216 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662217472}
I20260709 13:02:02.833436  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:02.853137  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.883730  8361 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
W20260709 13:02:02.816254 10288 consensus_meta.cc:287] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 13:02:02.807768  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:02.884593  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 76874.9us
W20260709 13:02:02.886375  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.856413  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.804406 10234 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.869940 10099 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.820339 10294 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.893704 10288 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:02.897117  8363 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:02.897692  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 297351us
I20260709 13:02:02.900831  8257 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:02.902493  8257 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:02.908021  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:02.910245  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:02.896481 10288 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.819258 10104 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:02.919250  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:02.919699  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:02.924825  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:02.934732  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:02.938719  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:02.897516 10099 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:02.917479 10345 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:03.290823  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:02.949126  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:03.286172  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:02.946530  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:03.070092  8364 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:02.954769  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.288996  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:03.149381  8331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.043s	sys 0.058s
W20260709 13:02:03.154579  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.096735  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:03.301776  8331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.043s	sys 0.070s
W20260709 13:02:03.302181  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 851770us
I20260709 13:02:02.954805  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.302620  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:02.913409 10334 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.922590 10268 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:03.198021  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.304330  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.304531 10268 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:03.307787  8258 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:03.306129  8367 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:03.310182  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:03.310827  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:03.311573  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.317677  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.313009  8218 raft_consensus.cc:2393] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 3: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:03.306854  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:03.319133  8213 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.319332  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:03.320466  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:03.320616  8210 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.106298 10083 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:03.068287 10300 consensus_meta.cc:287] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.796s	user 0.011s	sys 0.000s
I20260709 13:02:03.321979  8288 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.321667  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:03.322216 10300 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:03.323850 10342 consensus_meta.cc:287] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.000s
I20260709 13:02:03.298827 10104 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:03.324267 10300 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.324712 10104 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:03.324276 10342 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.326378  8291 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:03.303113  8894 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:03.309661  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:03.068791 10362 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:03.328649  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.283157 10336 ts_tablet_manager.cc:1916] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:03.105209 10332 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.538s	user 0.004s	sys 0.004s
I20260709 13:02:03.333679  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.333936  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.282987 10289 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:03.335601  8894 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:03.334916  8896 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:03.332508  8366 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:03.345044  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:03.012300 10348 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.159756  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.101284 10175 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.094830 10338 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:02.975100  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.094318  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.300724 10345 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:02.963469 10016 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.357107  8212 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
W20260709 13:02:03.487744  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.332484 10268 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:03.382477  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.382897  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.383296  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:03.458959  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 206742us
I20260709 13:02:03.413069  8284 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:03.314219  9963 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:03.340793  8258 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:03.348127  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.511093  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:03.511639  8284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:02:03.378316  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.512629  8363 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:03.512181  8284 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:03.513521  8284 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:03.456578  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.441699  8211 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:03.504065  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 148428us
I20260709 13:02:03.457576  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:03.515527  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 183705us
I20260709 13:02:03.516294  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:03.516245  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.517244  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.518155  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.517270  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.519198  8896 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:03.332962 10083 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.357935 10332 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5.
I20260709 13:02:03.363780  8891 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:03.339133  9974 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.190s
I20260709 13:02:03.360880 10197 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:03.529413  8288 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.530016  8287 raft_consensus.cc:2410] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:03.530247 10083 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.530779  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.520308  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.327929 10334 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:03.536106 10334 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:03.536588 10334 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:03.536813  8898 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
W20260709 13:02:03.537375 10234 consensus_meta.cc:287] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.002s
I20260709 13:02:03.536605  8284 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.509598 10099 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:03.539372 10099 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:03.539764  8284 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.540829  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:03.518288  8894 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
W20260709 13:02:03.527588  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 186837us
I20260709 13:02:03.541886  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:03.547269  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:03.451781  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 368) took 1088 ms. Trace:
I20260709 13:02:03.557956  8286 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:03.538292 10314 consensus_meta.cc:287] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 1.082s	user 0.008s	sys 0.004s
I20260709 13:02:03.450843 10104 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:03.566712  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.332940 10288 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.189s
I20260709 13:02:03.507676 10345 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:03.530674 10258 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:03.575688  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.568825  8284 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.571458  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.570294  8894 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:03.580147  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:03.581008  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.581252  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:03.573365  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 52666.1us
I20260709 13:02:03.433988  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:03.508268 10348 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.566619  8360 rpcz_store.cc:276] 0709 13:02:02.364295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.373951 (+  9656us) service_pool.cc:224] Handling call
0709 13:02:02.445343 (+ 71392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.777837 (+332494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.794244 (+ 16407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.803745 (+  9501us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:02.813968 (+ 10223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.451517 (+637549us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400108e54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:03.451569 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.451707 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498171136}
I20260709 13:02:03.585408  8284 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.531129 10342 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.576380  8361 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:03.578397 10294 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:02:03.587112  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.377454 10276 consensus_queue.cc:1059] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 13:02:03.599761  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.588523 10348 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.521679  9963 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:03.510247 10175 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.567414 10338 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:03.594194  8284 raft_consensus.cc:1240] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.412961 10353 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 13:02:03.605417  8284 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:03.605582  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:03.606765  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.607381  8894 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:03.608489  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:03.596156  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 239007us
I20260709 13:02:03.597357  8257 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:03.593427  8366 raft_consensus.cc:2410] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:03.569077 10016 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.590379  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:03.615125  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 94916.8us
I20260709 13:02:03.595615 10234 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.621490  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:03.598848 10323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.009s	sys 0.024s
W20260709 13:02:03.610364  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.578173 10189 consensus_queue.cc:1059] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:02:03.577865 10274 consensus_queue.cc:1059] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:03.574695 10314 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.630393  8217 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:03.602953 10221 consensus_meta.cc:287] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.797s	user 0.005s	sys 0.006s
I20260709 13:02:03.631215  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:03.603142 10363 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:03.640091  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.634516  8214 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:03.585871 10258 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.641794  8216 raft_consensus.cc:2410] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:03.619264  8288 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.601226 10374 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:03.622356 10323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.009s	sys 0.024s
I20260709 13:02:03.652165  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.646078  8212 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:03.622556 10264 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:03.624140 10234 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:03.647976  8213 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:03.664115  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.665139  8894 raft_consensus.cc:2393] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:03.649335 10314 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.668147  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.666306  9974 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:03.672824 10383 raft_consensus.cc:3055] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:03.673532 10383 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:03.673643 10175 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.672537  9974 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:03.674719 10383 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:03.675942 10383 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:03.676036  9974 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:03.653162 10323 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:03.684706  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.688072  8366 raft_consensus.cc:2393] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:03.663772 10234 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.688570  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.649350 10363 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:03.714131  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.715158  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.671742 10348 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:03.716774  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.666640 10310 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:03.727576  8894 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:02:03.728570  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 49910.4us
I20260709 13:02:03.729420  8184 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:03.665167 10350 consensus_queue.cc:1059] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:02:03.717155  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.739408  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.740108  8360 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:03.741055  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:03.742875 10373 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:03.733929 10310 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:03.746021  8362 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:03.754593  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.748530 10310 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:03.784001  8362 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:03.786983  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 57655.3us
I20260709 13:02:03.784165  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:03.784382  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:03.784525  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 153364us
I20260709 13:02:03.790181 10323 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:03.730307 10302 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:03.658105 10374 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:03.794739  8367 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:03.731114 10340 raft_consensus.cc:3055] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:03.735172  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:03.754935 10324 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:04.042281  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 258160us
I20260709 13:02:04.043236  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:03.797622  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 1881) took 1232 ms. Trace:
W20260709 13:02:03.800609  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 167111us
I20260709 13:02:03.735914  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.732709 10348 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:03.789822  8183 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:03.801769 10353 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:03.792738 10234 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:03.806869 10379 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:03.786049 10372 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:03.896311 10310 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:03.845188  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.814852  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:04.044551  8292 rpcz_store.cc:276] 0709 13:02:02.565293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.565930 (+   637us) service_pool.cc:224] Handling call
0709 13:02:03.755497 (+1189567us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5800155d98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:03.797537 (+ 42040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5214080}
I20260709 13:02:03.815951  8211 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:02:03.831638  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.826768  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:04.045898  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:04.044265  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.047096  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.095997  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:04.047694  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 371) took 1652 ms. Trace:
I20260709 13:02:04.059275  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:04.057085 10189 consensus_queue.cc:1059] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:02:04.060017 10353 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:04.097329  8364 rpcz_store.cc:276] 0709 13:02:02.395457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.395568 (+   111us) service_pool.cc:224] Handling call
0709 13:02:02.395840 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.300831 (+904991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.047463 (+746632us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54001540d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:04.047639 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549994880}
I20260709 13:02:04.035058 10283 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:03.789108  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.057825 10348 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.058776 10083 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:03.816526 10319 raft_consensus.cc:3055] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:03.811347 10258 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:03.807294 10363 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:03.822117 10373 consensus_queue.cc:1243] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer 4a50f39e2d8e4886a79849938f2272a6 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:03.995749 10345 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.096763  8898 raft_consensus.cc:1813] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Handling vote request from an unknown peer ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:03.799067 10302 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.059170 10274 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:03.810796  9963 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:03.804946 10340 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:03.929435  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:04.057651 10386 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:04.101502  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:03.913362  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:04.103502  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 314446us
I20260709 13:02:04.096158  8895 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:04.150655  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 938) took 1549 ms. Trace:
I20260709 13:02:04.105053  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:04.150983  8895 rpcz_store.cc:276] 0709 13:02:02.601015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.602381 (+  1366us) service_pool.cc:224] Handling call
0709 13:02:02.890883 (+288502us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:03.814681 (+923798us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128e9c 00007f2ef9128a5b 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:04.150595 (+335914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126566528}
W20260709 13:02:04.103130  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 57261.7us
I20260709 13:02:04.152153  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:04.055743  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 265942us
I20260709 13:02:04.153419  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:03.999185 10264 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:03.819903 10374 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:04.107219  8285 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.097085 10310 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:04.058903 10350 consensus_queue.cc:1059] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:02:04.099197  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:04.167862  8889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 947) took 1411 ms (client timeout 1709 ms). Trace:
W20260709 13:02:04.168282  8889 rpcz_store.cc:269] 0709 13:02:02.756425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.803260 (+ 46835us) service_pool.cc:224] Handling call
0709 13:02:04.061885 (+1258625us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:04.167761 (+105876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5145344}
I20260709 13:02:04.155230  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 954) took 1385 ms. Trace:
I20260709 13:02:04.170365  8890 rpcz_store.cc:276] 0709 13:02:02.769410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.872657 (+103247us) service_pool.cc:224] Handling call
0709 13:02:03.929197 (+1056540us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:04.153804 (+224607us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172897024}
I20260709 13:02:04.172533  8890 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:04.173249  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 944) took 1417 ms. Trace:
I20260709 13:02:03.821798 10334 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.164099 10340 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.175424 10340 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.175956 10334 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:04.125480  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.099375  8259 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.060485  8358 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.136523  8898 raft_consensus.cc:2410] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:04.107142 10083 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.107577 10372 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:03.972872 10268 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:04.143788  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.169926  8889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d19654c841264233b661225cdb0ef14b"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:04.106773 10391 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.106673 10319 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.106700 10283 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:04.147668  8364 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:04.155186  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:04.155553  8183 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.212499  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 963) took 1295 ms. Trace:
I20260709 13:02:04.212893  8894 rpcz_store.cc:276] 0709 13:02:02.916693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.154225 (+1237532us) service_pool.cc:224] Handling call
0709 13:02:04.212434 (+ 58209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.156226  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:04.213629  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 58157.2us
I20260709 13:02:04.214510  8895 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:04.214919  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 961) took 1341 ms. Trace:
I20260709 13:02:04.215241  8183 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.147323 10386 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:04.145634 10388 consensus_queue.cc:1059] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:02:04.216044 10375 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:04.182266 10389 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:04.216486 10319 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.216933 10389 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:04.217679 10319 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.218351  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 934) took 1670 ms. Trace:
I20260709 13:02:04.184844 10372 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:04.219642 10388 consensus_queue.cc:1243] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:04.219982 10372 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.183616 10334 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:04.220185 10388 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:04.219264  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.221427  8361 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:04.154012  8360 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:04.222338  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.218721  8891 rpcz_store.cc:276] 0709 13:02:02.548513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.551277 (+  2764us) service_pool.cc:224] Handling call
0709 13:02:02.551600 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.528895 (+977295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.218101 (+689206us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b540024dbd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:04.218292 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792528768}
I20260709 13:02:04.225746 10300 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.222371 10396 raft_consensus.cc:3055] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:04.226864 10396 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.226898 10300 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.227890 10396 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.228433  8891 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:04.229032  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.159067 10274 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:04.161952 10378 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.238471 10378 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:04.238389 10274 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.164590 10349 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.238909  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.239372 10349 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:04.240185 10393 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:04.240720 10274 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:04.242143 10349 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:04.226579  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.238973 10378 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.243510  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:04.244591 10389 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:04.245199 10300 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.246451  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.246769  8257 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:04.247246  8367 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:04.248108  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.248679  8367 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:04.243381  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:04.245846 10395 log.cc:927] Time spent T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:04.242291 10345 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.173629  8890 rpcz_store.cc:276] 0709 13:02:02.755502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.171460 (+1415958us) service_pool.cc:224] Handling call
0709 13:02:04.171860 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.172877 (+  1017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.173070 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.107193 10384 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:04.196660  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:04.193092  8293 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:04.198439  8284 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:04.192817  8898 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.207304 10391 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.197685  8289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60538 (request call id 2076) took 2180 ms (client timeout 2239 ms). Trace:
I20260709 13:02:04.259676  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 952) took 1501 ms. Trace:
I20260709 13:02:04.215224  8895 rpcz_store.cc:276] 0709 13:02:02.873856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.156044 (+1282188us) service_pool.cc:224] Handling call
0709 13:02:04.214862 (+ 58818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.158828  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.215998 10386 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.165361 10310 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.229146 10396 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:04.229938  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.185609  9963 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:04.273998  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.231210  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 1875) took 1676 ms. Trace:
I20260709 13:02:04.231237  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:04.231989  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1362) took 1327 ms (client timeout 1748 ms). Trace:
W20260709 13:02:04.276078  8216 rpcz_store.cc:269] 0709 13:02:02.904723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.905013 (+   290us) service_pool.cc:224] Handling call
0709 13:02:04.231624 (+1326611us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54000ed154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:04.231757 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623606016}
I20260709 13:02:04.234131  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:04.220778 10388 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.236263 10348 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.162521 10264 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:04.242563  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 931) took 1695 ms. Trace:
W20260709 13:02:04.186846  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.260083  8898 rpcz_store.cc:276] 0709 13:02:02.757901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.192148 (+1434247us) service_pool.cc:224] Handling call
0709 13:02:04.192635 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.259404 (+ 66769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.259619 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.261420  8897 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
W20260709 13:02:04.261566  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 102796us
I20260709 13:02:04.261739  8896 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
W20260709 13:02:04.259712  8289 rpcz_store.cc:269] 0709 13:02:02.017376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.018030 (+   654us) service_pool.cc:224] Handling call
0709 13:02:04.197476 (+2179446us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54001d51d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:04.197617 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644811136}
I20260709 13:02:04.283550  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:04.267880 10337 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:04.268492  8894 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.184664 10083 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.293975 10302 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.296319 10302 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.230536  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.271972  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.193539 10268 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.273497  8212 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:04.276993  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.277664  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.278148  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.275337  8285 rpcz_store.cc:276] 0709 13:02:02.555314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.560449 (+  5135us) service_pool.cc:224] Handling call
0709 13:02:02.560628 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.161753 (+1601125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.231008 (+ 69255us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400172ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:04.231158 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3556030720}
I20260709 13:02:04.279812  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:04.302474  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:04.284883  8897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 949) took 1527 ms (client timeout 1764 ms). Trace:
I20260709 13:02:04.303778  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:04.267763  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 52632.1us
I20260709 13:02:04.286949  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 953) took 1518 ms. Trace:
I20260709 13:02:04.287523  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.274685  8290 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:04.313035  8360 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:04.315182  8367 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:04.281021 10314 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.316229 10314 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:04.288794  8365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 363) took 2118 ms (client timeout 2061 ms). Trace:
I20260709 13:02:04.316557  8367 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:02:04.318265  8365 rpcz_store.cc:269] 0709 13:02:02.170110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.170230 (+   120us) service_pool.cc:224] Handling call
0709 13:02:04.288549 (+2118319us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400318dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:04.288696 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550430592}
I20260709 13:02:04.303171  8184 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:04.320204  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.320763  8365 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:04.320922 10376 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:04.321311 10376 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.321498  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.282560  8892 rpcz_store.cc:276] 0709 13:02:02.547203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.555755 (+  8552us) service_pool.cc:224] Handling call
0709 13:02:02.556074 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.666915 (+110841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.242302 (+1575387us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54005d39d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:04.242501 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68012928}
I20260709 13:02:04.323238  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:04.323980  8366 raft_consensus.cc:2393] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:04.324331 10302 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:04.291383  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:04.295447 10264 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:04.193320 10176 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:04.270571 10384 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:04.326143  8360 raft_consensus.cc:3055] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:04.289959  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:04.291476 10326 raft_consensus.cc:3055] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:04.266693 10391 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.298023  8292 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:04.300153  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.266215  8889 raft_consensus.cc:606] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.270222 10389 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:04.304900  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.304688  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.304528  8894 rpcz_store.cc:276] 0709 13:02:02.768890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.258554 (+1489664us) service_pool.cc:224] Handling call
0709 13:02:04.268319 (+  9765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.286695 (+ 18376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.286893 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.351565  8285 raft_consensus.cc:2393] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:04.352327  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 47704.3us
I20260709 13:02:04.352497  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:04.350337 10389 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:04.298378 10346 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:02:04.336308 10326 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.308059 10221 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.308750  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.308894  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:04.369827 10374 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:04.370784 10374 consensus_queue.cc:1243] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:04.286526 10234 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.359601 10324 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.371690  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.353905 10341 raft_consensus.cc:3055] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:04.310714  8358 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:04.311132 10283 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:04.321807 10376 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.373813 10348 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.372555 10341 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.375501  8366 raft_consensus.cc:3055] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:04.375908  8366 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:04.375814 10341 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.377055  8366 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:04.180639  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 81450.6us
I20260709 13:02:04.329370  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.332927  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.309747  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 1884) took 1704 ms. Trace:
I20260709 13:02:04.326815  8363 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:04.326565 10276 raft_consensus.cc:3055] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:04.420920 10386 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.421676 10276 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:04.422721 10276 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.423911 10276 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:04.338037  8862 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.340610  8216 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:04.426796  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 88799.9us
I20260709 13:02:04.427105  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.427793  8362 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:04.428623  8216 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:04.280356  9963 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:04.431242 10377 log.cc:927] Time spent T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.713s	user 0.011s	sys 0.010s
I20260709 13:02:04.431792  9963 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:04.432490 10302 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.342161  8290 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:04.435285  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.436708  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.437242  8115 catalog_manager.cc:5697] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 1 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.438324  8215 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:04.321180 10083 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.334666  8360 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:04.442200  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:04.442708  8360 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.343421 10384 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:04.443720 10083 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.344599 10394 raft_consensus.cc:3055] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:04.444411 10394 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.445391 10394 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.445981  8214 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:04.446791 10394 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.446962 10373 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:04.437942  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.449316 10176 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.449792 10176 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:04.450300 10334 consensus_queue.cc:1059] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:04.348484  8292 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:04.449457  8290 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:04.451658 10334 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:04.452118 10334 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:04.348905  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 533) took 1041 ms. Trace:
I20260709 13:02:04.452704  8286 rpcz_store.cc:276] 0709 13:02:03.307566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.321261 (+ 13695us) service_pool.cc:224] Handling call
0709 13:02:03.321512 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.567015 (+245503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.348668 (+781653us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54002747d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:04.348848 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509273984}
I20260709 13:02:04.449466 10376 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.454293  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.455331  8286 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:04.456343  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.452536  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.457369  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.457633  8292 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:04.358016 10375 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:04.357060  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.307744  8288 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:04.361074  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.363373  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.465274  8289 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:04.350879 10314 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:04.364383 10326 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.365188  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58924 (request call id 4) took 1536 ms. Trace:
I20260709 13:02:04.365993  8210 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:04.377388 10341 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.379144 10345 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.469844 10385 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.324134  8184 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:04.471246 10385 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:04.471728  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 147632us
W20260709 13:02:04.381251  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.337719 10319 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.475625  8289 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.391042  8366 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.350029 10336 ts_tablet_manager.cc:1929] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:02:04.387058 10388 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:04.477216  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.477191 10314 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:04.478879 10314 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.478987  8289 raft_consensus.cc:2393] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 2: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:04.468755  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.479255 10314 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.479480  8288 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:04.480598  8288 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.480984  8289 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:04.478731 10336 log.cc:1199] T 410fe3c36e834265b4c3b139e453a76e P ca43983edda443fa9d74c1f80252f1fc: Deleting WAL directory at /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/wals/410fe3c36e834265b4c3b139e453a76e
I20260709 13:02:04.398945  8259 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:04.482697  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 83813.5us
I20260709 13:02:04.483321  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:04.402182  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 69353.9us
I20260709 13:02:04.363304 10389 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.403976  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.404618  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.405870 10396 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:04.407027 10353 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:04.408216 10310 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.469978  8889 rpcz_store.cc:276] 0709 13:02:02.822526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.169508 (+1346982us) service_pool.cc:224] Handling call
0709 13:02:04.358996 (+189488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.484916 10363 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:04.470031 10340 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:02:04.475171 10381 consensus_queue.cc:1059] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:02:04.494969  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.394654 10391 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.410319  8209 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:02:04.495580 10381 consensus_queue.cc:1243] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:04.496706 10353 raft_consensus.cc:3055] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:04.497105 10353 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:04.495743  8362 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:04.497825 10391 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.411228  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.362249 10378 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.414779 10372 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:04.397894  8183 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.647s (SENT)
I20260709 13:02:04.419487  8287 rpcz_store.cc:276] 0709 13:02:02.605413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.611193 (+  5780us) service_pool.cc:224] Handling call
0709 13:02:04.309575 (+1698382us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b5400400e54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:04.309692 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085578112}
I20260709 13:02:04.441653  8862 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.344475  8365 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.347169  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2084) took 1867 ms. Trace:
W20260709 13:02:04.304167  8897 rpcz_store.cc:269] 0709 13:02:02.756958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.852633 (+ 95675us) service_pool.cc:224] Handling call
0709 13:02:04.196496 (+1343863us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:04.284834 (+ 88338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122718080}
I20260709 13:02:04.355306  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:04.450424 10176 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.498951  8217 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:04.499011 10376 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.502591  8287 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:04.503283  8184 leader_election.cc:336] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 1.693s (SENT)
I20260709 13:02:04.464193  8285 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:02:04.503842  8287 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.504492  8285 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:04.505002  8287 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:04.507354  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:04.506964  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:04.495851 10340 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:04.509701 10340 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.503973  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:04.498587  8361 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:04.510653 10319 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.466322 10334 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.508140  8291 rpcz_store.cc:276] 0709 13:02:02.479779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.479927 (+   148us) service_pool.cc:224] Handling call
0709 13:02:02.497960 (+ 18033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.326755 (+828795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.346941 (+1020186us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b5400187c54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:04.347107 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904595200}
I20260709 13:02:04.512794 10340 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.498447 10353 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.514183 10340 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.514458 10353 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:04.515640  8331 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:04.517773  8184 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:04.519378  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:04.439962  8115 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 3, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.464892 10373 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:02:04.469491  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.468727 10326 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.452451  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.443802  8360 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.474113  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:04.464743 10384 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.477748  8215 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:04.484091  8864 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.485170  8293 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:04.485222  8284 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:04.487385  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:04.488874  8367 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.490356 10336 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39240 (request call id 98) took 2796 ms. Trace:
I20260709 13:02:04.490830 10283 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.491888 10396 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.465008 10302 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:02:04.498258  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.499336 10363 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:02:04.524463  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.566900 10334 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.446928  8114 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35680 (request call id 396) took 6770 ms. Trace:
I20260709 13:02:04.543606  8287 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:04.566649  9963 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:04.567620 10391 raft_consensus.cc:2764] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:02:04.605423  9963 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.605873  9963 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:04.589074  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 115044us
I20260709 13:02:04.593729 10337 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:04.586522 10376 consensus_queue.cc:1059] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:02:04.606498 10337 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:04.567909  8359 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:04.606984 10337 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.607300 10376 raft_consensus.cc:3055] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:04.607769 10376 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:04.500329 10378 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.606101 10386 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.458515  8216 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:02:04.597988 10381 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:04.586409 10319 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.602850  8114 rpcz_store.cc:276] 0709 13:01:57.676968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.677162 (+   194us) service_pool.cc:224] Handling call
0709 13:01:58.067251 (+390089us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b5400332cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b7090 00007f2efc255f3a 00007f2f0200c1cc 00007f2f0210a37e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc 00007f2f005ca392 00007f2efa58848c 00007f2efa5878c6
0709 13:02:04.446861 (+6379610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:02.059039 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:02.279151 (+220112us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:02.279189 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:02:02.279205 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:02.279890 (+   685us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:02.279965 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:02.279992 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:02.280386 (+   394us) tablet.cc:701] Row locks acquired
0709 13:02:02.280402 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:02.280548 (+   146us) write_op.cc:270] Start()
0709 13:02:02.280645 (+    97us) write_op.cc:276] Timestamp: P: 1783602122280502 usec, L: 0
0709 13:02:02.280666 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:02.281263 (+   597us) log.cc:844] Serialized 1677 byte log entry
0709 13:02:02.691938 (+410675us) op_driver.cc:464] REPLICATION: finished
0709 13:02:03.502113 (+810175us) write_op.cc:301] APPLY: starting
0709 13:02:03.508552 (+  6439us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:03.557149 (+ 48597us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:03.557301 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:03.568698 (+ 11397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:03.568942 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:02:03.568986 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:03.580190 (+ 11204us) log.cc:844] Serialized 41 byte log entry
0709 13:02:03.580370 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:03.580472 (+   102us) write_op.cc:454] Released schema lock
0709 13:02:03.580525 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:03.580865 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:03.580891 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1552414,"reported_tablets":13,"spinlock_wait_cycles":7551872,"child_traces":[["op",{"apply.queue_time_us":681886,"apply.run_cpu_time_us":2899,"apply.run_wall_time_us":149541,"num_ops":4,"prepare.queue_time_us":428813,"prepare.run_cpu_time_us":29786,"prepare.run_wall_time_us":348137,"raft.queue_time_us":128826,"raft.run_cpu_time_us":26119,"raft.run_wall_time_us":605294,"replication_time_us":351232,"thread_start_us":883517,"threads_started":4,"wal-append.queue_time_us":197649,"wal-append.run_cpu_time_us":22387,"wal-append.run_wall_time_us":2120116}]]}
W20260709 13:02:04.622042  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.623724 10388 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:04.624203 10388 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:04.625097 10388 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:04.630264  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.630676  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 189058us
I20260709 13:02:04.630862  8291 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:02:04.631474  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.633006  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 235098us
W20260709 13:02:04.633931  8183 leader_election.cc:336] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.654s (SENT)
I20260709 13:02:04.522362  8115 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 3, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.637362  8212 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:04.634271  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 150203us
I20260709 13:02:04.639384  8864 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.632315  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.640774  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:04.635234  8183 leader_election.cc:336] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.018s (SENT)
I20260709 13:02:04.643361  8183 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:04.635495  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 148168us
W20260709 13:02:04.644290  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 136809us
I20260709 13:02:04.647616  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.646821  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:04.650862  8862 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.651808  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.653077  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 1866) took 1082 ms. Trace:
I20260709 13:02:04.653538  8359 rpcz_store.cc:276] 0709 13:02:03.570324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.576682 (+  6358us) service_pool.cc:224] Handling call
0709 13:02:04.652913 (+1076231us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b5400067cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:04.653019 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899054464}
I20260709 13:02:04.662024  8366 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:04.598266 10384 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:04.669275  8183 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.112s (SENT) [suppressed 52 similar messages]
I20260709 13:02:04.604920 10083 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:02:04.671371 10234 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:04.673578 10382 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:04.693763  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.694101  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:04.676781 10373 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.695262 10373 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:04.695681 10373 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.684106 10388 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.678970  8360 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:04.657616  8259 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.684427  8332 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:04.687026  8862 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.650691 10302 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.688167 10083 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:04.689004 10338 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:04.689625 10323 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:02:04.691789 10384 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:04.692214 10288 consensus_queue.cc:1059] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:04.682473 10264 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.649822 10375 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.667235 10363 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.637725 10381 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:04.703691  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 46126.1us
I20260709 13:02:04.726356  8215 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:04.705981  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 65290.6us
W20260709 13:02:04.732074  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.739297  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:04.740015  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 53071.5us
I20260709 13:02:04.741169  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.656457 10378 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:04.667801 10319 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.658828 10310 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:04.833104  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.837042  8291 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
W20260709 13:02:04.839527  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 100277us
I20260709 13:02:04.841156  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.842500 10384 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:04.842944 10384 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:04.843847  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 103627us
I20260709 13:02:04.845217  8864 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:04.843767  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 92850.5us
I20260709 13:02:04.740728 10083 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:04.667541 10274 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:02:04.834939  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:04.843334 10384 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:04.705598 10283 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.737339 10372 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:04.838500  8863 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:04.850754  8864 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:04.749549  9974 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:02:04.699534 10386 consensus_queue.cc:1059] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
W20260709 13:02:04.864946  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.852252  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:04.854295 10346 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:04.751142  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:04.695873 10396 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:04.857736  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 188489us
I20260709 13:02:04.874255  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:02:04.848783  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 144703us
I20260709 13:02:04.741647 10394 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.750063 10374 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:04.738039 10338 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:04.835876 10189 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:04.870110  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:04.845360 10350 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:04.775612  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.586534 10336 rpcz_store.cc:276] 0709 13:02:01.720932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.796285 (+ 75353us) service_pool.cc:224] Handling call
0709 13:02:02.294131 (+497846us) ts_tablet_manager.cc:1151] Deleting tablet 410fe3c36e834265b4c3b139e453a76e
0709 13:02:02.294257 (+   126us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:03.914753 (+1620496us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:04.335541 (+420788us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:04.490061 (+154520us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80126,"tablet-delete.queue_time_us":429749,"thread_start_us":205343,"threads_started":1}
I20260709 13:02:04.867820  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.897773  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.856864 10380 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.877998 10323 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:02:04.861858  8359 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:04.742272 10382 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 13:02:04.861128 10264 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:04.925508  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:04.839370 10375 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:04.860745 10397 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:04.851027 10302 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:02:04.922490 10342 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:04.862823 10385 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:04.914773  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 44769.9us
I20260709 13:02:04.870653 10346 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:04.857780 10324 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:02:04.908303 10234 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:04.874356 10363 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:04.738701 10376 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:04.866657  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:04.898576 10374 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:04.927752 10350 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:04.988098 10350 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.988500 10350 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.883227 10394 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:04.947794  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.873397 10341 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:02:04.926860 10399 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:02:04.901641 10189 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.923198 10400 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:02:04.931360 10302 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:04.927470 10310 raft_consensus.cc:3055] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:04.932135 10083 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:04.926048 10264 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:04.926442 10382 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:05.014038 10176 consensus_meta.cc:287] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.011s
I20260709 13:02:04.991832 10394 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.930492 10397 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:05.000967 10314 consensus_meta.cc:287] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.014s
I20260709 13:02:04.931511 10375 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:05.002550 10189 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.931416 10342 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:04.940418 10374 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.936269 10324 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:05.006748 10310 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:05.018502 10353 consensus_meta.cc:287] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.501s	user 0.017s	sys 0.002s
I20260709 13:02:05.020732 10397 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:05.024215 10389 consensus_meta.cc:287] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.531s	user 0.027s	sys 0.002s
I20260709 13:02:05.023483 10382 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:04.926620 10381 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.043990 10389 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.047056 10382 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.048740 10389 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:05.081674  8213 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:05.084919  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 212746us
I20260709 13:02:05.090029  8101 catalog_manager.cc:5028] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): tablet 410fe3c36e834265b4c3b139e453a76e (table test-workload [id=a858ff8b383240be847ce6d8a3fa5fa2]) successfully deleted
W20260709 13:02:05.095256  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.932935  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:05.100081  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 167066us
W20260709 13:02:05.101641  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.102769  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.105324  8332 leader_election.cc:336] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.874s (SENT)
W20260709 13:02:05.015589  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 164881us
W20260709 13:02:05.109400  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 259370us
I20260709 13:02:05.111212  8864 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:04.936240  9963 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.115455  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:05.117034  8367 raft_consensus.cc:2410] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:05.023762 10083 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:05.020042 10176 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.125293 10176 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:05.127345  8363 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:05.139577 10326 consensus_meta.cc:287] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.553s	user 0.017s	sys 0.011s
I20260709 13:02:05.024817 10324 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:05.142349 10324 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.145516 10324 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.111527  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:05.150256 10414 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:02:05.137267  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:05.154489 10389 consensus_queue.cc:1059] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:05.145895  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.159176  8897 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:04.934993 10346 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.162045  9963 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.145932 10283 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:05.162388 10408 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:05.162983 10283 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:05.163487 10283 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.163728 10346 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.168082 10300 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.174512  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:05.183733 10234 consensus_queue.cc:1059] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:05.186281 10348 raft_consensus.cc:3055] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:05.186894 10348 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.187175 10413 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:05.187683 10340 raft_consensus.cc:3055] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:05.188206 10340 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:05.021356 10314 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.188481 10348 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:05.191973  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.127117 10264 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.194459 10300 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.198727 10300 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:05.191817 10348 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.187848 10413 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:05.210822 10345 consensus_queue.cc:1059] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:02:05.211410 10342 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:05.211804  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 106619us
I20260709 13:02:05.194221 10408 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:05.209791  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.212100 10345 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:05.212882 10363 raft_consensus.cc:3055] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:05.217118 10363 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:05.219784 10363 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.186546 10319 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:05.222914 10176 raft_consensus.cc:3055] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:05.223798 10310 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.228046 10376 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:05.231601  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.214149 10413 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.168301 10385 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:02:05.234719  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 60569.1us
W20260709 13:02:05.238511  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 364102us
I20260709 13:02:05.230388 10176 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:05.229271 10319 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:05.253149 10319 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.261723  8897 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
W20260709 13:02:05.264055  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 117848us
W20260709 13:02:05.264583  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.271450 10314 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:05.274245 10340 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.275413 10310 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:05.276448 10340 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.279105  8361 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:05.279232 10234 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:05.276293 10363 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:05.274142  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.278849  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.269047 10319 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.283825  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:05.288807  8216 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.011s	sys 0.015s
I20260709 13:02:05.294028  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.294667 10176 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.296126 10176 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.300747  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:05.301697  8361 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.303964  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:05.287634 10234 consensus_queue.cc:1243] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:05.293895 10338 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.319187  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.319456  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.320519  8890 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:05.324631  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:05.325338  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:05.326648  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.327235  8214 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:05.328697  9963 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:05.329682 10408 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.330353 10408 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.330559  9963 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:05.331952  9963 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:05.332497  9963 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.324684  8365 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:05.337817  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:05.341665 10338 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.332785 10406 raft_consensus.cc:3055] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:05.338918 10385 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:05.354908  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:05.356770  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.361677 10189 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.366824  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:05.376327  8366 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.363639 10406 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.371204 10408 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:05.383200 10345 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.383517  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:05.383797  8894 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 1.
I20260709 13:02:05.384251  9974 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.386044 10394 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.395031  8290 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:05.401259  8863 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:05.396803  9974 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:05.406641  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 55110.4us
W20260709 13:02:05.409437 10373 consensus_meta.cc:287] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.011s
I20260709 13:02:05.410037 10373 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.411556 10189 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:02:05.413417 10373 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:05.415254  8367 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:05.418550  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.420073  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.421715  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:05.422194 10388 consensus_meta.cc:287] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.008s
I20260709 13:02:05.427614  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:05.428213  8216 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:05.428802  8365 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 2: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:05.430792  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:05.431298  9974 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:05.431891  9974 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.433456 10408 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:05.433892 10408 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.434226 10408 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.443569  9963 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.457617  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:05.459771  8361 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
W20260709 13:02:05.460282  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 193470us
I20260709 13:02:05.466563 10419 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:05.466256 10406 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.467053 10419 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:05.460319  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:05.470525 10381 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.475610 10337 consensus_meta.cc:287] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.006s
I20260709 13:02:05.476430  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.476241 10337 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.480180  8890 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:05.484433 10083 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:05.486987  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 106138us
I20260709 13:02:05.488525  8365 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:05.487692  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:05.489142  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:05.487236 10420 log.cc:927] Time spent T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:02:05.490502  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.490749 10372 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:05.492082 10422 log.cc:927] Time spent T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:02:05.492620 10394 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.497128  8864 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:05.504245  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:05.506462 10374 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.507783  8360 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:05.507972 10413 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:05.492158 10421 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:05.496338 10406 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.508553 10394 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:05.498580  8184 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:05.499637  8362 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:05.510037 10372 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:05.510984 10372 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.512075 10372 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.510694 10376 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:05.513191 10376 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.514137 10376 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.515844  8216 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:05.517911 10348 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:05.518450 10348 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:05.495204 10083 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:05.495147 10283 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.503830 10324 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:05.518996  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 50972.7us
I20260709 13:02:05.471410 10381 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.522320  9974 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:05.538880  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.541316  8364 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:02:05.509016 10374 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:05.540771  8331 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:05.541639  8364 pending_rounds.cc:85] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 1
W20260709 13:02:05.544713  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.545256  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.545367  8366 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:05.546957  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:05.546026 10324 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.548537 10408 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.526831 10348 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.550936 10283 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.552970 10381 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:05.553190  8184 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:05.554299 10375 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:05.554944 10375 raft_consensus.cc:697] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.555954 10375 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.558638  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.560362 10408 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:05.560488  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.561081  8287 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:05.554205 10350 consensus_meta.cc:287] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.008s
I20260709 13:02:05.563902 10413 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.522413 10083 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.564914  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.538806 10319 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:02:05.563655 10350 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.543816  8364 pending_rounds.cc:107] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:02:05.566959  8364 raft_consensus.cc:2889] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:05.568615  8287 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:05.573527  8863 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:05.574211  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.574460 10388 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:05.574707  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.574975 10388 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:05.575620  8290 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.576565 10388 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:05.568801 10424 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:02:05.569321 10397 consensus_meta.cc:287] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.526s	user 0.000s	sys 0.017s
I20260709 13:02:05.571380  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:05.579978  8291 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:05.579517 10397 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.581009  8896 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:05.581327  8897 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:05.582098 10397 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.582262  8863 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:05.571584 10324 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:05.569851 10419 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.583333 10324 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:05.583777 10324 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:05.583974 10419 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.584234 10324 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.587317 10382 consensus_queue.cc:1059] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:05.588518 10382 raft_consensus.cc:3055] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:05.588892 10382 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.590289 10314 consensus_queue.cc:1059] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:05.591482 10384 consensus_meta.cc:287] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.007s
I20260709 13:02:05.589893 10382 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.574693  8285 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:05.596411  8863 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:05.597353 10348 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.598021  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.598762  8289 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.648362 10413 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:02:05.591992 10384 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:05.621582  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.592046 10314 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:05.656550  8363 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:05.602648  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 56800.4us
W20260709 13:02:05.636739  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 117356us
W20260709 13:02:05.603163  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 62468.1us
I20260709 13:02:05.546697 10372 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.601290  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:05.635170  9974 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:05.672910  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:05.657629 10363 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.621414 10374 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.650172 10397 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:05.656665 10314 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.601598 10389 consensus_queue.cc:1059] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:02:05.675276  9974 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.675787 10350 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.697314  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.698194  8897 raft_consensus.cc:2368] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:05.677232 10348 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.688410  9963 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:05.704418  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.705118  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.706285 10396 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.699486 10319 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.706959 10396 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.707144 10319 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.708791  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:05.709530  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 108325us
I20260709 13:02:05.711352  8894 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:05.711210 10314 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.712162  8285 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:05.712551 10314 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.701458 10388 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:02:05.713833  8892 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:05.709419 10319 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.715044  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.715809  8889 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:05.720139  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.720613 10083 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:05.721803  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.689550 10413 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:02:05.722466 10337 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:05.723065  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.723507  8211 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:05.702143 10363 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.730472  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.731252 10363 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:05.734195  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:05.734968  8215 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:05.736093  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.737643  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.738694  8210 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:05.739820  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:05.740443  8210 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:05.740605  8290 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:05.741132  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.743094  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.743849  8896 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:05.744760  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.709321 10396 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.746436  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.747277  8892 raft_consensus.cc:2368] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:05.741699  8891 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.748179  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.722252  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.750663  8893 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:05.751652  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.752811  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.699568 10397 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:05.755131  8889 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:05.755319 10083 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:05.756390  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.757155  8889 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:05.740499  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.745891  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.741776  8895 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.694806  9974 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.767988  8331 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:05.741847  8210 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:02:05.772665  8289 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:05.774328  8894 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:05.774166  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.753881  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.779062 10346 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:05.779620  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:05.783105  8863 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:05.785576  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:05.786474  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:05.811080 10346 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.790567  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:05.813846 10346 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.815618 10310 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:05.815985  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.817862 10418 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.818315 10384 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:05.818457 10418 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.819044 10338 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:05.819371  8898 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:05.820381  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.811836  8214 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:05.821354  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.821914  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.793041  8892 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:05.794893  9963 consensus_queue.cc:1059] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:05.795372  8891 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:05.799652  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.865196  8894 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:05.800827  8115 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35686 (request call id 347) took 7052 ms. Trace:
I20260709 13:02:05.801600  8113 catalog_manager.cc:5697] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 4, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.802634  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:05.802645  8890 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:02:05.803325  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.803944  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:05.802896  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:05.775003 10176 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:02:05.810392  8895 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:05.787700  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:05.822031  8898 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:05.824527  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.817476  8259 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:05.826376  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 116043us
W20260709 13:02:05.827121  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 44105.3us
W20260709 13:02:05.836124  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.863903  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:05.806180 10349 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:05.871097  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:05.755012 10397 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:05.866456  8167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 53671.3us
W20260709 13:02:05.890136  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 72729.1us
I20260709 13:02:05.886164  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.888434  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.866739 10396 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:05.893810 10419 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:05.903743  8292 raft_consensus.cc:1240] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:05.889156  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.903849  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.905047  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.905723  8898 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.890975  8259 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:05.802021 10324 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.893211  8289 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:05.896863  8895 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:05.894006  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.959251  8894 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.903281  8286 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:05.902730  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:05.960676  8367 raft_consensus.cc:2410] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:05.902566  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.939934  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:05.900684  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.961719  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:05.888331  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:05.901818  8183 leader_election.cc:336] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.975s (SENT)
W20260709 13:02:05.955900  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.956493  8896 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:05.898888  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:05.958941  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 81093.2us
I20260709 13:02:05.898181  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.902601  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:05.906388  8889 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:05.877960 10349 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:05.963371  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:05.970818  8897 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:05.957701  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:05.972900  8366 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:05.875231 10384 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:05.975584  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.968390  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:05.976745  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:05.978045  8361 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:05.897265  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.906452  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:05.988761  8291 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.980552  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.902236 10396 raft_consensus.cc:697] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:05.903219  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:05.976263 10421 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:02:05.990792  8897 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:05.992326  8287 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:05.995728  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:05.996589  8895 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:05.997192  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:05.997984 10430 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:05.998320  8892 raft_consensus.cc:2376] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3. Re-sending same reply.
I20260709 13:02:05.998838  8894 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
W20260709 13:02:05.997219 10433 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:02:05.994526  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:06.002771  8365 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:06.003333  8360 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:02:06.003733  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:06.004443  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:06.005139  8360 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:06.005971  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:05.994311 10264 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:06.007104  8332 leader_election.cc:400] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:06.008239 10319 consensus_queue.cc:1059] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:06.009110 10319 raft_consensus.cc:3055] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:06.009475 10319 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:06.010785 10310 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:05.902665 10376 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:02:06.012954  8358 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:06.014679  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 122129us
I20260709 13:02:06.015260 10346 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:06.015969  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.016796  8258 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.017355 10346 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.017520  8215 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:06.018431 10349 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:05.998836 10300 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.019255 10419 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:06.019140  8367 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:06.021435  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:06.020205  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:06.022394 10418 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.023057 10350 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:06.023451 10350 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.023813 10350 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.865602  8115 rpcz_store.cc:276] 0709 13:01:58.748298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.748448 (+   150us) service_pool.cc:224] Handling call
0709 13:02:05.800607 (+7052159us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:04.840412 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:04.840978 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:04.841008 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:02:04.841026 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:04.841531 (+   505us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:04.841615 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:04.841642 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:04.841967 (+   325us) tablet.cc:701] Row locks acquired
0709 13:02:04.841984 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:02:04.842144 (+   160us) write_op.cc:270] Start()
0709 13:02:04.842257 (+   113us) write_op.cc:276] Timestamp: P: 1783602124842094 usec, L: 0
0709 13:02:04.842282 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:04.843000 (+   718us) log.cc:844] Serialized 1285 byte log entry
0709 13:02:05.245280 (+402280us) op_driver.cc:464] REPLICATION: finished
0709 13:02:05.481386 (+236106us) write_op.cc:301] APPLY: starting
0709 13:02:05.481557 (+   171us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:05.481787 (+   230us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:05.518540 (+ 36753us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:05.548299 (+ 29759us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:05.548626 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:02:05.548684 (+    58us) write_op.cc:312] APPLY: finished
0709 13:02:05.549059 (+   375us) log.cc:844] Serialized 35 byte log entry
0709 13:02:05.549264 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:05.549414 (+   150us) write_op.cc:454] Released schema lock
0709 13:02:05.549468 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:05.549940 (+   472us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:05.549968 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86115,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":235644,"apply.run_cpu_time_us":3853,"apply.run_wall_time_us":68544,"num_ops":3,"prepare.queue_time_us":136411,"prepare.run_cpu_time_us":34115,"prepare.run_wall_time_us":202571,"raft.queue_time_us":169359,"raft.run_cpu_time_us":45362,"raft.run_wall_time_us":219887,"replication_time_us":402711,"thread_start_us":636465,"threads_started":4,"wal-append.queue_time_us":202738}]]}
I20260709 13:02:06.004518  8365 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:06.009904  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:06.031292  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 140377us
I20260709 13:02:06.020157  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:06.033515  8291 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:06.044100  8896 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:06.048592  8290 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:06.045113 10436 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:06.051610  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 149825us
W20260709 13:02:06.052361  8183 leader_election.cc:336] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.071s (SENT)
I20260709 13:02:06.052779  8183 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.055264  8898 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:06.058038  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:05.987079 10384 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.061231  8898 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.064685  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:06.067605  8217 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:02:06.070041  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.054996 10374 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:06.061349  9963 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:06.073395 10338 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:06.066915 10418 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:06.075661  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 65879.9us
I20260709 13:02:06.076493  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:06.075127  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 55060.8us
I20260709 13:02:06.080322  8258 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.080683  8898 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:06.068908 10349 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.085950  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.087657  8211 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.063035 10419 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:02:06.083441  8358 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:06.090166  8332 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:06.084898  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.070785 10300 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:06.087594  8259 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:06.076668  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:06.094280  8898 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.095623  8217 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.076395 10264 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:02:06.096174  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:06.096729 10382 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:06.097101  8183 leader_election.cc:336] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.092s (SENT)
I20260709 13:02:06.097594  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:06.098991  8183 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.233s (SENT)
I20260709 13:02:06.091183 10363 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:06.099269 10314 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:06.081866 10338 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.100996  8359 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:06.101445 10338 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.092731 10300 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.102475 10389 raft_consensus.cc:3055] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:06.102927 10389 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:06.103739 10389 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:06.103911  9974 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:06.098992 10432 log.cc:927] Time spent T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.279s	user 0.000s	sys 0.004s
I20260709 13:02:06.106523  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:06.095007  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:06.112649  8898 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:06.113848  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.117589  9974 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.117995 10384 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.102452 10300 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.056305  8896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:06.119001  8898 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.099170 10324 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:06.122484  8896 raft_consensus.cc:606] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:06.105710  8360 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:02:06.124025  8896 raft_consensus.cc:614] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:06.133787  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 46240us
I20260709 13:02:06.111438  8889 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:06.104691 10350 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:06.154186  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 73938.6us
I20260709 13:02:06.132185 10338 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.199589  8894 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:06.131074 10418 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:06.202454  8897 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:06.123557 10374 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.123359 10176 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.135178 10438 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.088837 10396 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:06.212285  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 122233us
I20260709 13:02:06.135362 10346 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:02:06.213364  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:06.200639 10338 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.203071 10418 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.215706  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:06.219224  8217 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:06.153584 10234 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:02:06.217893  8212 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:06.210879  8892 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:06.208509 10372 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:06.220476 10418 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:06.226723  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 127779us
I20260709 13:02:06.227377 10176 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.253191  8215 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:06.219666 10338 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.264561  8217 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:06.272428  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:06.214917 10384 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:02:06.222102  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:06.301851  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:06.303072  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:06.307996  8898 raft_consensus.cc:2393] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:02:06.316356  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.318435 10283 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:06.319200 10283 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:06.321272 10283 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:06.322270  8258 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:06.323316  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:06.326458  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.288007 10388 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:06.324947  8363 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.331388  8895 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
W20260709 13:02:06.334811  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 85332.6us
I20260709 13:02:06.325573  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:06.305327 10346 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.278767 10372 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.287359 10324 consensus_queue.cc:1059] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:02:06.344298  8364 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:06.347134  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:06.324456  8359 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:06.350023  8365 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 2: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:06.333045 10388 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.389382  8363 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:06.389981  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:06.390662  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 111681us
I20260709 13:02:06.391413  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.392596  8363 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:06.393065  8209 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:06.390100 10324 consensus_queue.cc:1059] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:02:06.392639  8258 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.394232 10324 raft_consensus.cc:3055] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:06.394639 10324 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:06.394796  8258 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:06.395661 10324 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.396102  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.396929 10419 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.397290 10264 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:06.397683 10419 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.397814 10264 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:06.398706 10176 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.398921 10264 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:06.402199  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.392818 10234 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:06.353060 10337 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:06.403563 10337 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:06.404470 10337 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.405149  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:06.405856  8290 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:06.406193 10419 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.406531 10413 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.407035 10413 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.407696  8258 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:06.408964  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:06.409231 10413 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:06.410825 10444 log.cc:927] Time spent T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:06.412990  8363 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:06.413286 10447 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:06.414251 10419 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:06.406898  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:06.415621  8363 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:06.347513 10283 consensus_queue.cc:1059] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:02:06.325260 10319 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.351948 10388 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.386916 10396 raft_consensus.cc:3055] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:06.343909 10346 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.396963 10324 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:06.448449  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.449812  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:06.471131  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:06.492784  8365 raft_consensus.cc:2410] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:06.470139 10447 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:06.494688 10447 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.448967 10396 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:06.499049  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 176832us
I20260709 13:02:06.501748  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:06.427060 10234 consensus_queue.cc:1059] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:02:06.446746 10413 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:06.472280 10350 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:06.500833 10408 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.450665 10382 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:02:06.465538 10406 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:02:06.502389 10319 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:06.490542 10436 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:06.519146 10408 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.529265 10408 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:06.530659 10442 log.cc:927] Time spent T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:02:06.532292  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:06.506736 10418 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.540987  9974 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:06.541507  9974 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:06.542364  9974 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:06.543565  9974 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.522295  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:06.519608 10419 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:06.553551  8332 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:06.555897  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:06.515741 10300 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.533169 10264 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:06.526415 10396 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.579514 10396 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.583069  8259 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:06.585323 10459 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:06.585855 10459 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:06.586062  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:06.586553 10459 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.587409  8862 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:06.573693 10455 raft_consensus.cc:3055] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:06.591177 10350 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:06.591770 10436 raft_consensus.cc:2764] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:02:06.589956  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.597470  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:06.605885  8209 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:02:06.606792  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.592769 10441 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.540s	user 0.006s	sys 0.000s
I20260709 13:02:06.590521 10264 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:06.615330  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 76268.6us
I20260709 13:02:06.617071  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:06.606660 10450 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:06.617889 10450 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:06.618301 10450 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.604553 10413 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.620675  8331 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:06.593025 10455 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:06.624260 10381 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:06.620060 10264 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.626642 10381 raft_consensus.cc:697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:06.627559 10381 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.628284 10389 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.623715  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:06.624054  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 88617.6us
I20260709 13:02:06.641768  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:06.642599  8361 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:06.646432  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 59110.4us
I20260709 13:02:06.621136 10408 raft_consensus.cc:2764] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:02:06.650158  8332 leader_election.cc:400] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:06.653213  8332 leader_election.cc:403] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:02:06.650334  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 205887us
I20260709 13:02:06.626510 10300 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.621779 10413 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:06.658196 10413 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.659124 10465 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:06.659590 10465 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:06.652804  8862 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.657362  8210 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:06.662528  8361 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:06.619364 10419 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.664767  8211 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.619439 10338 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.651611 10384 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:06.666496  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:06.651481  9974 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.669492  8862 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.621779 10445 consensus_queue.cc:1059] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:06.674136 10346 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.676613 10334 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:06.673031 10300 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.680083  8286 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:06.625054 10455 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.686898 10300 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:06.688834  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 47084.8us
I20260709 13:02:06.686460 10418 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.672362 10350 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.700891 10471 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.701560 10471 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.702124  8361 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:06.703913 10471 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.706471 10372 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.708604 10459 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.709367  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.698743 10363 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:06.710489 10363 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:06.711517 10363 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:06.712723 10363 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.714169 10346 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.725008  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:06.723981  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:06.727519  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.696990 10176 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:06.688859  9963 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:06.673702  9974 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.660578 10465 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.697124 10397 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:06.740228  8862 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.741724 10463 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:06.734426 10466 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:06.734871 10372 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:06.743737  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:06.746563  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:06.743884  8183 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.743430  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:06.753916  8290 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.743508  8358 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:06.753548  8293 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:06.758942 10384 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:06.759364  8210 raft_consensus.cc:3055] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:06.744791 10460 consensus_queue.cc:1059] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:02:06.746392 10455 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.761951  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:06.774870  8211 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:06.763464  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:06.764070  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:06.741858  9963 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:06.723066 10447 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:06.764894  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:06.748605 10463 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.788812  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:06.727859 10346 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:06.759991 10471 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:06.790251 10438 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:06.756117 10372 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:06.826462  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 100557us
W20260709 13:02:06.831305  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 100363us
I20260709 13:02:06.831670  8212 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:06.790424 10418 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:06.759829  8210 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:06.836411  8366 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.773571 10397 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:06.785519  9963 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:06.840294  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 96493.7us
I20260709 13:02:06.843230  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:06.844949  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:06.845675  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:06.846421  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:06.850054  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:06.866636  8894 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:06.825245 10463 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.831077 10445 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:06.879298  8290 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:06.880532  8898 raft_consensus.cc:2410] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:06.834407 10465 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:06.833248 10319 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.897121  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:06.839207  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:06.835891 10372 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.858435  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:06.890965 10396 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.910344  8209 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:06.870733 10438 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:06.864290 10478 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.922857  8290 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:02:06.906571  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 159293us
I20260709 13:02:06.907626  8897 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:06.894426 10459 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:06.931989  8366 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:06.925029  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:06.927929  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:06.935796  8894 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:06.934880  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 44150us
I20260709 13:02:06.904642  8893 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:06.940595  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.884548 10471 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:06.890352 10388 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.949044  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.946796  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:06.929700  8891 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.925006 10324 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:06.969256  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 132249us
I20260709 13:02:06.970702  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:06.901814 10319 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.935427 10349 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:06.901834 10445 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.943042 10348 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.929184 10396 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:06.934851 10176 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:02:06.902016 10384 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:07.003315  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:07.003860  8896 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:06.969161 10234 raft_consensus.cc:3055] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:07.016158  8898 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:07.009474  8894 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:06.972236 10406 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.948848 10314 consensus_queue.cc:1059] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 13:02:06.998947 10410 log.cc:927] Time spent T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:07.024470  8366 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:06.989909  9974 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:07.021283 10468 log.cc:927] Time spent T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:02:07.058692  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 154803us
I20260709 13:02:06.993623 10300 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.067162  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:06.992197 10397 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:06.935777 10478 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.014358 10467 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.015805 10234 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:07.030297  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:07.067981  8898 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:06.967283 10479 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.228s
I20260709 13:02:06.990140 10324 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.075431  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:07.077494  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 77098.6us
I20260709 13:02:06.939321  8210 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.001483 10348 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:07.000952 10310 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:02:07.076442  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 129726us
I20260709 13:02:07.086418  8862 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:07.076982  8894 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:07.082015  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:07.080403  8898 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:07.059070 10438 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.109110  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:07.082496 10406 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:07.098182 10474 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:02:07.098970 10464 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:02:07.122792  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.123600  8366 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:07.124866  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.097831  8210 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.099540 10473 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.128280  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.150935  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.130282  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.150878 10473 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.151798  8291 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:07.149299 10314 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:02:07.152910  8210 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:02:07.153366  8210 pending_rounds.cc:85] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 5
I20260709 13:02:07.099143 10477 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.098739 10489 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:02:07.079885 10456 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.225s
I20260709 13:02:07.133916 10481 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.102826 10319 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:07.091267 10349 raft_consensus.cc:697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:07.126711  8258 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:07.135426 10348 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:07.136201  8891 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:07.136339 10388 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:07.137274 10463 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:07.138280 10470 log.cc:927] Time spent T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:02:07.139739  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:07.179327  8293 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.140019  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.181011 10372 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.140549  8893 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:07.140857  8889 raft_consensus.cc:2410] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:07.141400 10234 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.142853  8217 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:07.102826 10396 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:07.146714 10471 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:07.085304 10310 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:07.147367 10492 raft_consensus.cc:3055] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:07.098049 10485 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:07.165563 10497 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.099102 10397 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.083570 10467 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:07.131860 10478 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.078044 10490 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:02:07.138284  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:07.156630  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 94459.4us
I20260709 13:02:07.075335 10264 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:07.202735  8332 leader_election.cc:336] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.723s (SENT)
I20260709 13:02:07.202576 10310 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:07.203711  8332 leader_election.cc:336] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.764s (SENT)
I20260709 13:02:07.203925 10310 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.204428 10349 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.206174 10467 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:07.206351  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:07.206712 10372 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.207221  8893 raft_consensus.cc:2393] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:07.208142  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:07.209362  8893 raft_consensus.cc:2410] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:02:07.211187  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.156035  8210 pending_rounds.cc:107] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 13:02:07.164357  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 168815us
I20260709 13:02:07.167665 10455 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:07.117940 10350 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:07.158475 10465 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.153195 10473 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:07.172488  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 101851us
I20260709 13:02:07.227072  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:07.182751  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 57976.2us
W20260709 13:02:07.184751  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 102837us
I20260709 13:02:07.168677 10481 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:07.150156 10324 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:07.190894  8217 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:07.195775  8894 raft_consensus.cc:2410] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:07.194252 10234 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:07.197017 10496 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.198741 10487 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:07.199218 10476 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:07.199574 10486 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:07.200232 10495 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:07.159550  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:07.214804  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.186621  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:07.214416  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:07.212690  8210 raft_consensus.cc:2889] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.193878 10485 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.218302  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:07.219432 10413 consensus_meta.cc:287] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.003s
I20260709 13:02:07.219899  8893 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:07.190467 10492 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:07.230587  8183 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:07.231889  8258 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:07.232237  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:07.253648  8216 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:07.289667  8364 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:07.289448  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 53552.3us
W20260709 13:02:07.289450  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 57638.7us
I20260709 13:02:07.250818  8293 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:07.232437  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:07.293659  8211 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:07.232856  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.267962  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.290830 10476 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.297857 10476 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.288484  8218 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
W20260709 13:02:07.303234  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.234452  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.294401  8367 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
W20260709 13:02:07.307389  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 76865.2us
I20260709 13:02:07.308763  8331 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.309283  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:07.292593  8212 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:07.312525  8894 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:02:07.313786  8898 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:07.315650  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:07.294366 10450 consensus_meta.cc:287] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.003s
W20260709 13:02:07.318596  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 114985us
I20260709 13:02:07.259388 10446 raft_consensus.cc:3055] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:07.291790 10495 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.321933  8214 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:07.233690  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:07.323982  8216 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:07.302836 10456 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.293205 10490 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.264648 10346 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:07.346895  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.311005 10497 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.374341  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:07.386304 10492 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.387456 10488 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:07.387818 10492 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.309758 10496 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.331962 10450 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.391009 10481 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:07.392077 10450 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.392871  8359 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:07.378589  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:07.330595 10495 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.384078 10490 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.326185 10446 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:07.404505 10491 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.331s	user 0.003s	sys 0.000s
I20260709 13:02:07.320649 10363 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:02:07.406517  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.407370  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.407727  8293 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:07.380851  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:07.294564 10413 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.310979 10419 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:07.304248 10487 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.327099 10396 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:07.226516 10455 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.394243  8362 raft_consensus.cc:1240] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:07.379069 10505 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:07.233938  8101 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer ca43983edda443fa9d74c1f80252f1fc from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:02:07.447690  8101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 213773us
I20260709 13:02:07.395720 10497 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:07.394423 10348 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:07.401837  8364 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:07.415814  8183 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:07.427026  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:07.333293  9963 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.394928 10488 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.451444  8209 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:07.466050  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.426775  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:07.468396  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:07.468868  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:07.474751  8285 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:07.467284 10488 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.482350  8364 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:07.467206  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:07.482681  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 157491us
I20260709 13:02:07.479743  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.485100  8291 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:07.485209  8183 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:07.487311 10497 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:07.470343 10505 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:07.472237 10350 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:07.447232 10396 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.516470  9963 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.522936  8293 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:07.515951 10505 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.515786  8285 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.539222  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:07.539248  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.541532  8291 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:07.404776 10446 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.482350 10473 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:07.551688  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 68065.6us
I20260709 13:02:07.470546 10348 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.542310 10456 raft_consensus.cc:697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:07.514186 10349 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:07.564754  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 98930.2us
I20260709 13:02:07.522524  8360 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:07.546007  8890 raft_consensus.cc:1813] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Handling vote request from an unknown peer ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:07.575338 10455 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:07.576951  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 91814.1us
I20260709 13:02:07.524631 10496 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.556124 10350 raft_consensus.cc:697] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:07.577751  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:07.578462  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.564775  8288 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:02:07.579993  8259 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.617250  8183 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:07.614176  8890 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:07.589527 10455 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.613296 10349 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:07.588017 10337 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.635090 10337 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.627410 10501 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.628273 10507 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.636075  8890 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:07.636464 10507 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.637295 10337 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.637570  8890 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:07.638753 10507 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:07.629503  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:07.639835  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.640352  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:07.634399 10496 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:07.641464  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:07.614562 10314 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.618170 10342 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:02:07.629225 10510 log.cc:927] Time spent T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:07.635587 10348 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.652774  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:07.653386  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.653805  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.652889  8293 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:07.619537 10283 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:02:07.642840  9963 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.661609  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:07.662343  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.655015 10481 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:07.666673  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.666898 10349 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.656610 10346 raft_consensus.cc:2764] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:02:07.671546  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.676817  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:07.642306 10455 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.648800 10501 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:02:07.678535  8332 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.680145 10467 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:07.670439 10348 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:07.665025 10342 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:07.673482 10419 raft_consensus.cc:697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:07.665371 10389 consensus_queue.cc:1059] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:02:07.694391  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:07.668438  9963 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.680406 10374 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.743928 10494 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:07.744937 10406 consensus_meta.cc:287] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 13:02:07.745455  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.677804 10481 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:07.680639 10438 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:02:07.772351 10514 log.cc:927] Time spent T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:02:07.774305  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.774983  8289 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:07.775878  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.776568  8289 raft_consensus.cc:2393] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:07.764334 10310 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:07.778759 10310 raft_consensus.cc:697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:07.779124  8890 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:07.779750 10310 consensus_queue.cc:237] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:07.780746  8890 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:02:07.781113  8290 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:07.784296 10406 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.785090 10406 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.785602 10406 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.787943 10406 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.685273 10467 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.687819 10348 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:07.743839 10513 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:07.658171 10350 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.665447 10456 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:07.761775  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 67451.8us
I20260709 13:02:07.674341 10520 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:02:07.695230 10487 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:07.687408 10478 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:07.768517 10524 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:02:07.769241  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 564) took 1361 ms. Trace:
I20260709 13:02:07.747394 10396 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:07.759719  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.838516  8293 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:07.835937  8286 rpcz_store.cc:276] 0709 13:02:06.403318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.406188 (+  2870us) service_pool.cc:224] Handling call
0709 13:02:06.406481 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.684043 (+277562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.764763 (+1080720us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400400e54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:07.764945 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628683008}
I20260709 13:02:07.795158 10348 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.781181  8890 pending_rounds.cc:85] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 4
I20260709 13:02:07.824994  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.751096 10397 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.793356 10467 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:07.743758 10342 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.833624  9963 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.846757  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.836256 10478 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.792011 10476 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:07.851977  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.849735 10346 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:07.854347 10346 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.854725 10346 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:07.847035  8890 pending_rounds.cc:107] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:02:07.848031 10501 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:07.849843 10396 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.768415 10481 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:07.866381 10234 consensus_meta.cc:287] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.007s
I20260709 13:02:07.872807  8284 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:07.855770 10374 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:07.856633 10478 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:07.793748 10419 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.868654  8890 raft_consensus.cc:2889] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.868000 10501 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:07.871709 10396 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.881552 10487 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.914397 10487 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.914939 10396 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:07.916764 10487 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:07.878176 10374 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.925668 10374 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:07.927366  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.928090  8364 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:07.929404  8259 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:07.930298 10447 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:07.930723 10447 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.931099 10447 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.935364 10396 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.935957 10396 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.936709 10445 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:07.913729 10501 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.938709 10396 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:07.852460 10397 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.969485 10501 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.972051 10467 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:07.973126  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1000) took 1112 ms. Trace:
I20260709 13:02:07.976260 10397 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:07.976999 10492 consensus_meta.cc:287] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.000s
I20260709 13:02:07.979323  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:07.989467  8364 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.987439  8896 rpcz_store.cc:276] 0709 13:02:06.844857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.845444 (+   587us) service_pool.cc:224] Handling call
0709 13:02:07.957591 (+1112147us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54005b54d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:07.957719 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316089600}
I20260709 13:02:07.983496 10413 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:07.924602 10495 consensus_meta.cc:287] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 13:02:07.928478 10314 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.992259  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.001498  8293 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.998823  8290 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
W20260709 13:02:07.994199  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 109906us
I20260709 13:02:08.012336  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:07.981710 10374 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.017410  8863 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:08.024902  8292 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:07.988891 10349 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.025794 10492 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:08.049033 10502 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.671s	user 0.001s	sys 0.009s
I20260709 13:02:08.050436  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.050865 10397 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.054921  8216 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:08.062528  8293 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:02:08.080714  8183 leader_election.cc:336] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.112s (SENT)
I20260709 13:02:08.001169 10495 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:08.201787  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.211750  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:08.308030  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 227337us
I20260709 13:02:08.271411  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.218360  8364 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:08.206004  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:08.307276  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.014202 10455 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:08.311223  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 92105us
I20260709 13:02:08.309664  8290 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:08.318281  8292 raft_consensus.cc:2393] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:08.203408 10488 consensus_meta.cc:287] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.005s
I20260709 13:02:08.338526  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:08.201539 10413 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:08.351552  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.243896 10487 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:02:08.146763 10346 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.156703 10406 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:08.282043 10348 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.316372 10350 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:02:08.309664 10374 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:08.356244  8209 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:08.157018 10497 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:08.358651 10447 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.280390 10467 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.094669 10492 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.170342 10314 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:08.307122 10529 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:08.281116 10526 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.218184 10485 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:08.316933 10530 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:08.330041 10389 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:08.401726  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 419) took 1689 ms. Trace:
I20260709 13:02:08.403262 10406 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.332762 10456 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:08.144366 10349 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.409027 10492 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.375516 10476 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.419091  8361 rpcz_store.cc:276] 0709 13:02:06.703639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.704169 (+   530us) service_pool.cc:224] Handling call
0709 13:02:06.704651 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:06.705056 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.705090 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:06.731482 (+ 26392us) log.cc:844] Serialized 52 byte log entry
0709 13:02:07.157441 (+425959us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:07.157483 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.157548 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.048554 (+891006us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b2400200168. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef8fe69c4 00007f2ef8fe4acb 00007f2ef919fdc9 00007f2ef919fa55 00007f2ef919f09d 00007f2efbdd110e 00007f2efbde888c 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221
0709 13:02:08.376441 (+327887us) raft_consensus.cc:1685] finished
0709 13:02:08.376464 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.390759 (+ 14295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21428,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":4583,"spinlock_wait_cycles":8355584,"thread_start_us":402278,"threads_started":1,"wal-append.queue_time_us":577236}
I20260709 13:02:08.366707 10488 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.243081 10397 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:08.425684 10478 consensus_meta.cc:287] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 13:02:08.440353 10478 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.441409  8365 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:08.426488  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 683) took 1112 ms. Trace:
I20260709 13:02:08.442198  8889 rpcz_store.cc:276] 0709 13:02:07.313643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.905007 (+591364us) service_pool.cc:224] Handling call
0709 13:02:07.905406 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.916175 (+ 10769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.916211 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.916766 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.998845 (+ 82079us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:08.014707 (+ 15862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.403959 (+389252us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5400387f54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:08.407409 (+  3450us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.408422 (+  1013us) raft_consensus.cc:1685] finished
0709 13:02:08.408437 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.426412 (+ 17975us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1291,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":23653632,"thread_start_us":73014,"threads_started":1,"wal-append.queue_time_us":63267}
I20260709 13:02:08.445118 10348 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.420660 10314 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.447784 10314 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.408455 10497 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.424880 10342 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.428840 10455 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.451712 10314 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.423867 10389 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.466002 10314 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.468788 10314 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.415541 10529 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.475281  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.430624 10520 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:02:08.451905 10338 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.423115 10530 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:08.502671  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 1.21066e+06us
I20260709 13:02:08.427068 10456 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.476406  8288 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:08.419714 10526 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.428368 10539 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:02:08.499390  8863 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:08.510401  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 133505us
I20260709 13:02:08.453151 10342 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.459563 10455 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.605355  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:08.583420  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.597302  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:08.586462  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.609787  8216 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:08.576911  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:08.606601  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 297282us
I20260709 13:02:08.611294  8894 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 1.
I20260709 13:02:08.612190  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1003) took 1299 ms. Trace:
W20260709 13:02:08.608122  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 122570us
I20260709 13:02:08.512449  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.616245  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:08.616971  8285 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.612540  8894 rpcz_store.cc:276] 0709 13:02:07.312406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.596963 (+1284557us) service_pool.cc:224] Handling call
0709 13:02:08.612130 (+ 15167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:08.499887 10540 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:08.620172  8292 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:08.627961  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:08.623811  8897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 996) took 1781 ms (client timeout 1794 ms). Trace:
W20260709 13:02:08.583027 10541 log.cc:927] Time spent T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:02:08.633654  8897 rpcz_store.cc:269] 0709 13:02:06.842841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.842964 (+   123us) service_pool.cc:224] Handling call
0709 13:02:08.623602 (+1780638us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b540024dbd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:08.623744 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95107328}
I20260709 13:02:08.593140 10349 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.579640 10389 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.577792 10406 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.642778  8894 raft_consensus.cc:1240] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:08.648448  8896 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:08.648752  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.591111 10447 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.618736 10338 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.588418 10456 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.589618 10497 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.646781  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.618736 10348 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:08.570649 10350 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.623032 10374 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.650574  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:08.668468  8285 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:08.646405 10476 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:02:08.671176  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:08.669672  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:08.610028 10530 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.654388  8257 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:08.651686 10551 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.649860 10419 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.648417  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:08.661585 10348 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:08.802523 10348 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:08.802825  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.803439  8216 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
W20260709 13:02:08.803794  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 149556us
I20260709 13:02:08.749660  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:08.805557  8214 raft_consensus.cc:2410] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:08.801446  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.756914  8331 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:08.807873  8285 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:08.802038  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:08.809358  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:08.748497  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 546) took 1907 ms. Trace:
I20260709 13:02:08.810109  8897 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:08.809625  8183 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:08.813180  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.739765  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2112) took 1267 ms. Trace:
I20260709 13:02:08.672290  8894 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.804673  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:08.814056  8287 rpcz_store.cc:276] 0709 13:02:07.472673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.472807 (+   134us) service_pool.cc:224] Handling call
0709 13:02:07.473177 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.480523 (+  7346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.480556 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.489271 (+  8715us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.970728 (+481457us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b1800392f80. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1 00007f2efc208a0f
0709 13:02:08.024869 (+ 54141us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:08.414814 (+389945us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.415554 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.415638 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.739516 (+323878us) raft_consensus.cc:1685] finished
0709 13:02:08.739595 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.739708 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2824,"prepare.queue_time_us":565520,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":23344,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":27462,"spinlock_wait_cycles":3635584,"thread_start_us":321423,"threads_started":2,"wal-append.queue_time_us":857177}
I20260709 13:02:08.810416  8895 rpcz_store.cc:276] 0709 13:02:06.841347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.841459 (+   112us) service_pool.cc:224] Handling call
0709 13:02:07.961867 (+1120408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.974002 (+ 12135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.974034 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.974526 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.200416 (+225890us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:08.200462 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.200559 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.468302 (+267743us) raft_consensus.cc:1685] finished
0709 13:02:08.468323 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.748225 (+279902us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54005b54d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:08.748414 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5908,"spinlock_wait_cycles":2487619840,"thread_start_us":214548,"threads_started":1,"wal-append.queue_time_us":457313}
I20260709 13:02:08.824990  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:08.825596  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.825888  8287 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:08.825975  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.828397  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.828820  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:08.832660  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.670855  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:08.833542  8216 raft_consensus.cc:2393] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 2: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:08.834291  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:08.817170 10550 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:02:08.837101  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.843786 10526 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.749150 10529 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.746531 10495 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.847038  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.847368  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.801728 10342 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.723624 10556 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.726511 10300 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:08.744024 10397 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:08.884428 10556 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.704720 10374 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.890044 10300 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.891381 10488 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.892063 10488 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:08.892874 10300 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:08.893924  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2041) took 2131 ms (client timeout 1995 ms). Trace:
I20260709 13:02:08.669732 10338 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.850497  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 573) took 1397 ms. Trace:
I20260709 13:02:08.864486  8890 raft_consensus.cc:2393] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:08.826265 10471 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:08.865226  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.900434  8218 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:08.884598 10497 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:08.901355  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.761221 10264 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.826860 10382 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:08.727499 10456 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:02:08.909397 10473 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:08.909948 10473 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.892539 10488 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.913368  8287 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:08.739501 10555 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:08.894387  8215 rpcz_store.cc:269] 0709 13:02:06.762342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.763826 (+  1484us) service_pool.cc:224] Handling call
0709 13:02:08.893668 (+2129842us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400129654. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:08.893821 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084770688}
I20260709 13:02:08.727218 10337 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:02:08.854210  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:08.916620  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:08.892457 10374 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:08.912941  8218 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:02:08.923048 10523 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.174s	user 0.003s	sys 0.001s
I20260709 13:02:08.834172 10545 raft_consensus.cc:2764] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:02:08.890631 10556 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.935235  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 1925) took 1867 ms. Trace:
I20260709 13:02:08.935784  8362 rpcz_store.cc:276] 0709 13:02:07.068269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.069206 (+   937us) service_pool.cc:224] Handling call
0709 13:02:07.069443 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.448287 (+378844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.934953 (+1486666us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54003174d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:08.935159 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746503040}
I20260709 13:02:08.932237  8289 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:02:08.939595  8284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 569) took 1834 ms (client timeout 1879 ms). Trace:
W20260709 13:02:08.940083  8284 rpcz_store.cc:269] 0709 13:02:07.105553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.105686 (+   133us) service_pool.cc:224] Handling call
0709 13:02:08.939339 (+1833653us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54001d6ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:08.939492 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590412544}
I20260709 13:02:08.943300 10487 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.943791 10487 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:08.944710 10487 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.946764 10485 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.947310 10485 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.949636 10485 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.822183 10551 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:08.954200  8216 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:08.681077 10350 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.821463 10419 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:08.916729  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 62589.8us
I20260709 13:02:08.962473 10529 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.803572 10492 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.962983 10529 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.965430 10492 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.966151  8366 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:08.966933  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1497) took 1649 ms. Trace:
I20260709 13:02:08.968230  8214 raft_consensus.cc:2368] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5.
I20260709 13:02:08.910319 10473 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.902163 10397 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.917646  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.917886 10520 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.969210 10419 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.970054  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:08.970743  8215 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.917546 10382 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:08.899186  8210 rpcz_store.cc:276] 0709 13:02:07.452768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.453325 (+   557us) service_pool.cc:224] Handling call
0709 13:02:07.453782 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.614159 (+160377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.615853 (+  1694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.619618 (+  3765us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:07.621656 (+  2038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.850228 (+1228572us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400129154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:08.850279 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.850427 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307891584}
I20260709 13:02:08.922550 10488 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.922801 10396 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:08.925000 10338 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.928576  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:08.932397  8287 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:08.958772  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:08.994777  8287 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:08.995044  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:08.967243  8366 rpcz_store.cc:276] 0709 13:02:07.317869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.318000 (+   131us) service_pool.cc:224] Handling call
0709 13:02:08.965706 (+1647706us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:08.965934 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.966654 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.966855 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6841088}
I20260709 13:02:08.960348 10485 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.969347 10520 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.979803 10382 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:08.980435 10349 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.960186 10487 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.984594 10490 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:08.984834  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:08.982823 10397 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:08.996872  8215 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:09.012284  8894 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:08.973208 10497 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:02:08.990041 10530 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.018054  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:09.030700  8287 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.031948 10520 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.991626 10389 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:09.016983  8285 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:08.960510 10555 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.006248  8889 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 1.
I20260709 13:02:09.026122  8210 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:09.018152 10529 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:08.994505 10396 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.019191 10509 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.059307  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.059544  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.060024  8362 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:09.060381  8365 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:09.041572 10419 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.006038 10485 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.047132 10471 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:09.047232  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.081916  8285 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:09.040714  8287 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:09.034214 10551 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.061738  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.016942 10349 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.070815 10563 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:02:09.074738  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.094717  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.061347  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.043582  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:09.027719 10490 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:02:09.041800 10530 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.084429 10492 consensus_queue.cc:1059] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:09.085408 10463 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.081349  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:09.086344  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.086870  8365 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:09.110266 10396 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.087056 10500 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.083884  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:09.120898  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:09.034438 10389 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.078398 10539 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.102852  8215 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:09.073959 10479 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.128275  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.105031 10555 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.105923  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.125892  8212 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:09.130005  8287 raft_consensus.cc:2410] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:09.118983 10492 raft_consensus.cc:3055] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:09.083963 10553 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.137192  8218 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:09.138850  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.142171  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.133322 10539 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.128311 10520 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:09.128743 10551 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:09.071964 10382 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.082647 10529 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:02:09.146806  8365 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:09.088339 10419 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.155668  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.118782 10500 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.133525 10492 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:09.148453 10463 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:09.151180 10551 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.147786 10350 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.147426 10479 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.158390 10520 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:09.171967 10551 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:09.150876 10553 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:09.186182 10531 log.cc:927] Time spent T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.994s	user 0.003s	sys 0.000s
I20260709 13:02:09.199244 10496 raft_consensus.cc:3055] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:09.199832 10496 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:09.203961 10455 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.212334  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1415) took 1159 ms. Trace:
I20260709 13:02:09.214289  8217 rpcz_store.cc:276] 0709 13:02:08.052408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.055382 (+  2974us) service_pool.cc:224] Handling call
0709 13:02:08.055745 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.056218 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.056267 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.205116 (+148849us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.426993 (+221877us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:08.427033 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.427100 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.205013 (+777913us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b2400110918. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef8fe69c4 00007f2ef8fe4acb 00007f2ef919fdc9 00007f2ef919fa55 00007f2ef919efb0 00007f2efbe15488 00007f2efbe15be8 00007f2efbded398 00007f2efbde876a 00007f2efbde7bb6
0709 13:02:09.211971 (+  6958us) raft_consensus.cc:1685] finished
0709 13:02:09.211998 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.212254 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1576,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"spinlock_wait_cycles":13772544,"thread_start_us":148490,"threads_started":1,"wal-append.queue_time_us":351455}
I20260709 13:02:09.223938  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:09.224747  8217 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:09.238554  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:09.220921 10176 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.221232 10490 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:09.227830 10350 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.252252  8285 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:09.253645 10562 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.229817 10346 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.260267  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.261438  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:09.260476  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.266130  8362 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:09.266589  8361 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:09.265885  8366 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:09.069525 10509 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.185243 10492 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.302652  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.209452 10496 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.257074 10176 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.260711 10490 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.352681  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.298870 10562 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:09.353637  8861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.023s	sys 0.019s
I20260709 13:02:09.257413 10520 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.351915  8362 raft_consensus.cc:2393] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:09.352543 10481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.019s	sys 0.024s
W20260709 13:02:09.367830 10481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.019s	sys 0.025s
I20260709 13:02:09.368027 10539 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:09.360402  8861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.023s	sys 0.019s
I20260709 13:02:09.300956 10530 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.347865 10492 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:09.364198  8184 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:09.379093  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:09.265384 10350 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:09.351902 10372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.015s	sys 0.026s
I20260709 13:02:09.371356  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:09.372175  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.320011 10479 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:09.348104 10389 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.403481  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.407878  8361 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:09.381892  8366 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:09.369885 10509 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:09.323410 10473 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.369246  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.360062 10562 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.413314 10176 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.414837  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:09.372912 10561 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:09.373129 10496 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:09.418627  8362 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:09.384558  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:09.422406 10473 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.424892  8358 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:09.426426 10490 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:09.428265 10478 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.434253 10349 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.382948 10529 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:09.455752 10529 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.456171 10529 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:09.408689 10372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.015s	sys 0.026s
I20260709 13:02:09.404004  8210 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:09.404153 10539 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:09.395279 10563 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.381537  8331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.001s	sys 0.024s
W20260709 13:02:09.463779  8331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.001s	sys 0.024s
I20260709 13:02:09.443512 10500 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:09.415230 10564 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.373296 10555 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:02:09.448283 10509 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:09.448611 10176 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:09.445396 10479 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:09.451526  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 67056.6us
I20260709 13:02:09.473884 10176 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.444164 10481 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:09.401055 10507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.013s	sys 0.052s
I20260709 13:02:09.520185 10176 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.520504  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:09.521128  8896 raft_consensus.cc:2376] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6. Re-sending same reply.
I20260709 13:02:09.523440 10350 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.524686 10397 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:09.418404 10556 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.463332 10539 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:09.470031 10564 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.472931 10509 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:09.471761  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.473507  8184 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:09.534415 10544 consensus_queue.cc:1059] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:09.538275 10349 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:09.464130  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 707204us
I20260709 13:02:09.492976 10479 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.450409 10497 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:09.533545 10556 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.534039 10539 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:09.541910  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 68476.8us
I20260709 13:02:09.557286  8331 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:09.557960  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:09.457551 10419 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.542850  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:09.546381  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:09.543212 10555 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.545934 10543 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.893s	user 0.001s	sys 0.002s
W20260709 13:02:09.532552 10507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.014s	sys 0.052s
I20260709 13:02:09.534289 10438 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:09.593276 10438 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:09.457244 10561 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.561976  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.565239  8331 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:09.565999  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:07.427872  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:09.587316 10555 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:09.567653 10487 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:02:09.568827  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:09.572717  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.573674  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1422) took 1477 ms. Trace:
I20260709 13:02:09.536253 10564 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.576628 10497 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:09.551748 10485 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
W20260709 13:02:09.581815 10348 consensus_meta.cc:287] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.779s	user 0.006s	sys 0.005s
I20260709 13:02:09.539708 10509 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:09.592777 10560 log.cc:927] Time spent T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.311s	user 0.003s	sys 0.000s
I20260709 13:02:09.589340  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.598124  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1421) took 1544 ms. Trace:
I20260709 13:02:09.465579 10563 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.614120  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.518729 10481 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.616503  8209 rpcz_store.cc:276] 0709 13:02:08.095888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.401205 (+305317us) service_pool.cc:224] Handling call
0709 13:02:08.411705 (+ 10500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.504291 (+ 92586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.504326 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.504369 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:08.504412 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.573409 (+1068997us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b5400423954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:09.573460 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.573612 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212341632}
I20260709 13:02:09.622561  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.627622  8211 rpcz_store.cc:276] 0709 13:02:08.054028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.361087 (+307059us) service_pool.cc:224] Handling call
0709 13:02:08.361467 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.431015 (+ 69548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.431047 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.431098 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:08.431139 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.594213 (+1163074us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b5400378cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:09.597895 (+  3682us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.598032 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159389056}
I20260709 13:02:09.632457  8291 raft_consensus.cc:2410] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:09.627841  8292 raft_consensus.cc:2393] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:09.651191  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.623543 10497 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:09.564018 10551 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:09.655540  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.629683  8358 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:09.608486 10479 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:09.605980 10561 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.615046  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.619401 10467 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:09.662883  8257 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:09.664759  8331 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:09.654233 10497 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:09.661890 10408 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.020s	sys 0.058s
I20260709 13:02:09.698017  8331 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:09.706036  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:09.713860  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:09.719139  8212 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:09.724512  8184 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:09.630566 10348 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:09.706884 10408 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.020s	sys 0.058s
I20260709 13:02:09.690709 10479 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.631027 10471 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:02:09.719424 10561 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:09.734722  8863 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:09.739859 10446 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:09.744303  8113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35666 (request call id 372) took 11646 ms (client timeout 15000 ms). Trace:
I20260709 13:02:09.721215 10499 consensus_queue.cc:1059] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:09.747192  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.731065 10555 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:09.670743 10176 consensus_queue.cc:1059] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:02:09.726720 10478 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:09.717442 10467 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:09.607203 10438 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.727238 10507 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:09.717834 10528 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:09.815977  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:09.776404  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.019s	sys 0.044s
I20260709 13:02:09.732440 10530 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:09.816834  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.019s	sys 0.044s
I20260709 13:02:09.773624  8360 raft_consensus.cc:2410] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:09.726629 10413 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:02:09.824828  8364 raft_consensus.cc:2410] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 7 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:09.765865  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:09.771898 10561 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.829710  8896 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:02:09.832293  8862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.023s	sys 0.040s
W20260709 13:02:09.832743  8862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.023s	sys 0.040s
I20260709 13:02:09.790897 10467 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:09.801316  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:09.790565 10349 raft_consensus.cc:3055] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:09.806571 10563 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:09.774621 10556 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:09.811168 10562 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:09.732255  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.031s	sys 0.035s
W20260709 13:02:09.858920  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.031s	sys 0.035s
W20260709 13:02:09.822902  8289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.015s	sys 0.020s
I20260709 13:02:09.762539 10479 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.808571 10539 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:09.827397  8363 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.000s	sys 0.037s
W20260709 13:02:09.898727  8363 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.000s	sys 0.038s
I20260709 13:02:09.829373  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.792999  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:09.803498 10553 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:09.824759 10363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.008s	sys 0.031s
W20260709 13:02:09.861326  8289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.016s	sys 0.020s
I20260709 13:02:09.856492  8258 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:09.923178  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 66758.5us
I20260709 13:02:09.816892 10478 raft_consensus.cc:697] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:09.824364 10456 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.822863 10530 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.823709 10569 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.895839  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.896817  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.947548  8284 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:09.948383  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:09.858479  8293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.010s	sys 0.049s
W20260709 13:02:09.949441  8293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.011s	sys 0.049s
I20260709 13:02:09.825907 10507 raft_consensus.cc:697] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:09.900650  8361 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:09.900322  8291 raft_consensus.cc:2410] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:09.900660 10555 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.011365  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:10.021577  8285 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:09.919533  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:10.022843  8895 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
W20260709 13:02:09.920166  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.024174  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.827912 10528 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:09.852761 10561 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:09.858287 10515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.023s	sys 0.027s
I20260709 13:02:09.827459 10419 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:09.927567  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:09.900285 10176 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:09.935738  8258 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:09.935513 10463 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:09.854888 10234 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:02:09.890743  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:09.858752 10349 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:02:09.901118  8213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.034s	sys 0.039s
I20260709 13:02:09.949798  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:10.050169  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 122658us
I20260709 13:02:10.050594  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:09.773677  8113 rpcz_store.cc:269] 0709 13:01:58.097774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.097915 (+   141us) service_pool.cc:224] Handling call
0709 13:01:59.705465 (+1607550us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54002eff90. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef91290b2 00007f2f020a2a89 00007f2f0203ada6 00007f2f0200c088 00007f2f0210a37e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc
0709 13:02:09.744194 (+10038729us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:06.408973 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:06.409575 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:06.409631 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:02:06.409650 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:06.410090 (+   440us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:06.410179 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:06.410224 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:06.410521 (+   297us) tablet.cc:701] Row locks acquired
0709 13:02:06.410568 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:02:06.410727 (+   159us) write_op.cc:270] Start()
0709 13:02:06.410890 (+   163us) write_op.cc:276] Timestamp: P: 1783602126410665 usec, L: 0
0709 13:02:06.410910 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:06.411605 (+   695us) log.cc:844] Serialized 535 byte log entry
0709 13:02:06.540057 (+128452us) op_driver.cc:464] REPLICATION: finished
0709 13:02:06.673473 (+133416us) write_op.cc:301] APPLY: starting
0709 13:02:06.678385 (+  4912us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.688458 (+ 10073us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.714180 (+ 25722us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.714435 (+   255us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.725507 (+ 11072us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:06.730874 (+  5367us) write_op.cc:312] APPLY: finished
0709 13:02:06.748121 (+ 17247us) log.cc:844] Serialized 23 byte log entry
0709 13:02:06.755303 (+  7182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.766562 (+ 11259us) write_op.cc:454] Released schema lock
0709 13:02:06.773328 (+  6766us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.862676 (+ 89348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.880460 (+ 17784us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1690987,"reported_tablets":13,"spinlock_wait_cycles":67266304,"child_traces":[["op",{"apply.queue_time_us":123373,"apply.run_cpu_time_us":2302,"apply.run_wall_time_us":162066,"num_ops":1,"prepare.queue_time_us":122489,"prepare.run_cpu_time_us":2967,"prepare.run_wall_time_us":5664,"replication_time_us":114273,"thread_start_us":203788,"threads_started":2}]]}
I20260709 13:02:10.051476  8897 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:09.852336 10460 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:02:10.006758 10481 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.984930  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.946695 10530 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.930204  8359 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:09.927299 10397 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.054919  8284 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:10.007467 10348 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:09.928602 10476 consensus_queue.cc:1059] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
W20260709 13:02:10.042362  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 106697us
I20260709 13:02:10.062686  8258 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:10.039276 10490 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.029013 10471 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:09.923516 10363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.008s	sys 0.031s
I20260709 13:02:10.069718  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:10.052457  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:10.070935  8895 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
W20260709 13:02:10.050531  8213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.034s	sys 0.039s
W20260709 13:02:10.050320  8183 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.024s	sys 0.026s
W20260709 13:02:10.039678 10515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.023s	sys 0.028s
W20260709 13:02:10.027480 10310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.243s	user 0.022s	sys 0.060s
I20260709 13:02:09.975138 10408 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.082811  8365 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.008s	sys 0.022s
W20260709 13:02:10.083195  8365 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.008s	sys 0.022s
I20260709 13:02:10.058506 10500 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:10.059165  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:09.920789 10495 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.063920  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:10.086051  8258 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:10.028234 10551 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:10.063992  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:09.974283  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:10.059883 10566 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.073066  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:10.065389 10463 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:10.060271 10176 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:09.950543 10456 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.060105  8889 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:10.073719 10349 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.074762  8291 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:10.075233 10479 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:10.075392 10562 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:10.051501 10419 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:10.076547  8183 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.025s	sys 0.026s
W20260709 13:02:10.116017  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 938580us
I20260709 13:02:10.061756 10467 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:10.078159  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:10.061981 10397 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.095548  8897 raft_consensus.cc:2410] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:10.101431 10459 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.084815  8284 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:10.040462 10555 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:10.093755 10310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.310s	user 0.022s	sys 0.061s
I20260709 13:02:10.010723 10478 consensus_queue.cc:237] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:10.104136 10500 raft_consensus.cc:697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:10.081447 10471 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:10.125288  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:10.160202  8894 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
W20260709 13:02:10.112232  8217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.004s	sys 0.022s
W20260709 13:02:10.118664  8183 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.999s (SENT) [suppressed 19 similar messages]
I20260709 13:02:10.099022 10460 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:10.120463 10382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.012s	sys 0.015s
W20260709 13:02:10.108438 10334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.304s	user 0.016s	sys 0.030s
I20260709 13:02:10.077135 10490 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:10.161721  8217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.004s	sys 0.022s
I20260709 13:02:10.176561  8285 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:10.130692  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:10.128167  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2054) took 1292 ms. Trace:
I20260709 13:02:10.105921  8890 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.974586 10569 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.124215  8891 raft_consensus.cc:2368] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
I20260709 13:02:10.107671 10566 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.098428 10408 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.100710 10495 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.103066 10337 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:02:10.106750 10528 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.020182 10507 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.403419  8862 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:10.384047  8361 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:10.261880  8215 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.034s	sys 0.025s
I20260709 13:02:10.417157  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:10.185787  8286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.548s	user 0.030s	sys 0.033s
I20260709 13:02:10.199122  8863 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:10.209802  8366 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:10.415797  8287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.013s	sys 0.010s
I20260709 13:02:10.287329  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2134) took 1459 ms. Trace:
W20260709 13:02:10.341917  8218 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.011s	sys 0.021s
I20260709 13:02:10.371977  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:10.420596  8218 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.013s	sys 0.022s
W20260709 13:02:10.418363  8215 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.039s	sys 0.030s
I20260709 13:02:10.354549  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:10.419701  8286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.783s	user 0.035s	sys 0.041s
W20260709 13:02:10.214111  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.424081  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:10.426033  8291 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:10.427140  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:10.198884  8896 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:10.213589  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2133) took 1575 ms. Trace:
I20260709 13:02:10.178063  8212 rpcz_store.cc:276] 0709 13:02:08.836152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.166756 (+330604us) service_pool.cc:224] Handling call
0709 13:02:09.556439 (+389683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.727942 (+171503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.833031 (+105089us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54000587d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:10.127959 (+294928us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000587d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:10.128110 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220894208}
W20260709 13:02:10.436293  8362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.007s	sys 0.028s
W20260709 13:02:10.436767  8362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.007s	sys 0.028s
W20260709 13:02:10.352914  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 190164us
W20260709 13:02:10.420197  8287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.013s	sys 0.010s
I20260709 13:02:10.420944  8289 rpcz_store.cc:276] 0709 13:02:08.828382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.938214 (+109832us) service_pool.cc:224] Handling call
0709 13:02:08.938543 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.999984 (+ 61441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.000014 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.016569 (+ 16555us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.921317 (+904748us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:09.921358 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.921421 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.287052 (+365631us) raft_consensus.cc:1685] finished
0709 13:02:10.287077 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.287255 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60276,"raft.queue_time_us":62327,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":13965,"thread_start_us":875415,"threads_started":1,"wal-append.queue_time_us":1178863}
I20260709 13:02:10.428687  8293 rpcz_store.cc:276] 0709 13:02:08.638698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.834800 (+196102us) service_pool.cc:224] Handling call
0709 13:02:08.835155 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.835387 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.835412 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.835899 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.949804 (+1113905us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:09.949872 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.949937 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.213370 (+263433us) raft_consensus.cc:1685] finished
0709 13:02:10.213390 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.213522 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1039420,"threads_started":1,"wal-append.queue_time_us":1307461}
I20260709 13:02:10.125217 10459 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:10.508540  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.522403  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 105320us
I20260709 13:02:10.125600 10349 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:10.523155  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:10.389818 10520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.011s	sys 0.020s
W20260709 13:02:10.175947 10334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.016s	sys 0.030s
I20260709 13:02:10.525859  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:10.534843  8897 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:02:10.216301 10564 consensus_meta.cc:287] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.004s
W20260709 13:02:10.353792 10496 consensus_meta.cc:287] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.905s	user 0.011s	sys 0.001s
W20260709 13:02:10.328243 10529 consensus_meta.cc:287] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.001s
W20260709 13:02:10.177990 10382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.012s	sys 0.016s
W20260709 13:02:10.389427 10372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.011s	sys 0.019s
I20260709 13:02:10.524920 10459 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:10.522161  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 80896.4us
W20260709 13:02:10.531247  8214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.019s	sys 0.040s
W20260709 13:02:10.558712  8214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.019s	sys 0.040s
I20260709 13:02:10.531814  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:10.163661 10551 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.404217 10438 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:10.540316  8367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.012s	sys 0.016s
W20260709 13:02:10.562085  8367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.012s	sys 0.016s
I20260709 13:02:10.562197  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:10.403614 10577 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:02:10.352680 10515 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.573911  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.287791 10460 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:10.392221 10539 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:10.340986 10363 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:10.547809  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:10.611097  8366 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.184487 10413 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:10.613564 10413 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.615687 10413 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:10.616225 10413 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.423903  9963 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.617033  9963 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:10.619050 10497 consensus_meta.cc:287] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.893s	user 0.009s	sys 0.000s
I20260709 13:02:10.619516  9963 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:10.208608  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:10.551872  8895 raft_consensus.cc:2376] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5. Re-sending same reply.
I20260709 13:02:10.445598 10553 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:10.535415 10520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.011s	sys 0.024s
W20260709 13:02:10.537467 10581 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260709 13:02:10.559789  8894 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.541908  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:10.531214 10565 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:10.579170  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:10.630271  8897 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:10.576982 10551 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.565802 10384 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:10.590333 10467 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:10.577572 10176 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:10.591998 10583 log.cc:927] Time spent T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:10.521366 10389 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:02:10.578655 10530 consensus_meta.cc:287] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:02:10.599881 10490 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:10.601306 10566 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:10.606145 10456 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:10.608187 10446 consensus_meta.cc:287] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.832s	user 0.007s	sys 0.003s
I20260709 13:02:10.550665 10564 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:10.557518 10372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.012s	sys 0.019s
W20260709 13:02:10.623015  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 62859us
I20260709 13:02:10.619488 10497 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:10.640947  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:10.564765 10496 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.629719  8210 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.590687  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:10.628494  8889 consensus_meta.cc:287] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:02:10.557729 10529 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.354771 10500 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.972064  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 448) took 1428 ms. Trace:
W20260709 13:02:10.899474  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.858572  8363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.028s	sys 0.023s
W20260709 13:02:10.715806  8288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.031s	sys 0.048s
W20260709 13:02:11.039741  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.009s	sys 0.024s
W20260709 13:02:10.845798  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.017s	sys 0.048s
I20260709 13:02:11.200824  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 571) took 1312 ms. Trace:
I20260709 13:02:10.767665  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1433) took 1522 ms. Trace:
I20260709 13:02:10.752950  8897 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:11.215914  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:11.232192  8366 consensus_meta.cc:287] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.007s
I20260709 13:02:10.820720  8894 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
W20260709 13:02:11.038192  8290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.424s	user 0.007s	sys 0.020s
W20260709 13:02:11.149374  8215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.003s	sys 0.012s
I20260709 13:02:11.217022  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1007) took 1186 ms. Trace:
W20260709 13:02:11.194379  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.702993  8292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.042s	sys 0.040s
W20260709 13:02:11.297827  8288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.643s	user 0.038s	sys 0.063s
W20260709 13:02:10.909376  8209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.008s	sys 0.034s
I20260709 13:02:11.205847  8115 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:11.232225  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.191234  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 1948) took 1824 ms. Trace:
W20260709 13:02:11.296972  8363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.398s	user 0.028s	sys 0.041s
I20260709 13:02:11.157852  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:11.298528  8215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.006s	sys 0.013s
I20260709 13:02:11.196619  8284 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:11.296363  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.550s	user 0.019s	sys 0.065s
I20260709 13:02:11.046015  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1431) took 2121 ms. Trace:
W20260709 13:02:11.301213  8209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.365s	user 0.016s	sys 0.036s
I20260709 13:02:11.297976  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1013) took 1265 ms. Trace:
W20260709 13:02:11.298892  8292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.579s	user 0.042s	sys 0.055s
I20260709 13:02:11.299377  8895 rpcz_store.cc:276] 0709 13:02:10.030860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.077871 (+ 47011us) service_pool.cc:224] Handling call
0709 13:02:11.216815 (+1138944us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54003ce6d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:11.216956 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993462656}
I20260709 13:02:11.296586  8896 rpcz_store.cc:276] 0709 13:02:09.888568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.888744 (+   176us) service_pool.cc:224] Handling call
0709 13:02:10.156483 (+267739us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:10.156728 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.428421 (+271693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.200539 (+772118us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54004c86d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:11.200756 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105303168}
I20260709 13:02:11.296787  8217 rpcz_store.cc:276] 0709 13:02:09.244974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.245899 (+   925us) service_pool.cc:224] Handling call
0709 13:02:09.246259 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.246619 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.246646 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.252960 (+  6314us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.176447 (+923487us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:10.176490 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.176573 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.767449 (+590876us) raft_consensus.cc:1685] finished
0709 13:02:10.767470 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.767603 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":466,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6638,"thread_start_us":872923,"threads_started":1,"wal-append.queue_time_us":1464144}
W20260709 13:02:11.299494  8290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.685s	user 0.012s	sys 0.023s
W20260709 13:02:11.298889  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.297528  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.297969  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.017s	sys 0.028s
I20260709 13:02:11.299706  8366 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:11.297876  8898 raft_consensus.cc:2368] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
W20260709 13:02:11.305902  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 1.25428e+06us
I20260709 13:02:11.299450  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1009) took 1268 ms. Trace:
I20260709 13:02:11.301785  8894 rpcz_store.cc:276] 0709 13:02:10.032224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.428052 (+395828us) service_pool.cc:224] Handling call
0709 13:02:11.297914 (+869862us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:11.300958  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 143204us
I20260709 13:02:11.308626  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:11.309211  8894 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:11.310606  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1515) took 1094 ms. Trace:
I20260709 13:02:11.310879  8366 rpcz_store.cc:276] 0709 13:02:10.216734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.445494 (+228760us) service_pool.cc:224] Handling call
0709 13:02:11.310552 (+865058us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.316802  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1008) took 1285 ms. Trace:
I20260709 13:02:11.320161  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1513) took 1133 ms. Trace:
I20260709 13:02:11.307313  8897 rpcz_store.cc:276] 0709 13:02:10.031324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.553799 (+522475us) service_pool.cc:224] Handling call
0709 13:02:11.299386 (+745587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.343413  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1427) took 2508 ms. Trace:
I20260709 13:02:11.343955  8215 rpcz_store.cc:276] 0709 13:02:08.835443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.138417 (+302974us) service_pool.cc:224] Handling call
0709 13:02:09.149762 (+ 11345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.149971 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:10.422001 (+1272030us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.342998 (+920997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.343061 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.343117 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.343190 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.343341 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42172,"prepare.queue_time_us":798174,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":6232,"thread_start_us":2140267,"threads_started":2}
W20260709 13:02:11.346616  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.317276  8898 rpcz_store.cc:276] 0709 13:02:10.031101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.215570 (+1184469us) service_pool.cc:224] Handling call
0709 13:02:11.316734 (+101164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.320585  8364 rpcz_store.cc:276] 0709 13:02:10.187103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.187280 (+   177us) service_pool.cc:224] Handling call
0709 13:02:11.319473 (+1132193us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128e9c 00007f2ef9128a5b 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:11.319639 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.319819 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.319843 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.319881 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:11.319924 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.319978 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.320106 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3082496}
I20260709 13:02:11.302537  8115 catalog_manager.cc:5697] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 4, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.299297  8362 rpcz_store.cc:276] 0709 13:02:09.544110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.577520 (+ 33410us) service_pool.cc:224] Handling call
0709 13:02:09.577997 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.578444 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.578474 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.584740 (+  6266us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.437146 (+852406us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:10.437193 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.437286 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.971821 (+534535us) raft_consensus.cc:1685] finished
0709 13:02:10.971843 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.971993 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2224,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":8818,"thread_start_us":767143,"threads_started":1,"wal-append.queue_time_us":1344214}
I20260709 13:02:11.348438  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.353413  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:11.354051  8218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.029s	sys 0.028s
I20260709 13:02:11.353956  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:11.300009  8367 rpcz_store.cc:276] 0709 13:02:09.367105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.367254 (+   149us) service_pool.cc:224] Handling call
0709 13:02:09.383126 (+ 15872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.383531 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.383559 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.384019 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.563043 (+1179024us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:10.563137 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.563236 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.190996 (+627760us) raft_consensus.cc:1685] finished
0709 13:02:11.191020 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.191165 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25364,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2859,"thread_start_us":1122403,"threads_started":1,"wal-append.queue_time_us":1625523}
I20260709 13:02:11.355760  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:11.353411  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.357136  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:11.357517  8365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.261s	user 0.000s	sys 0.024s
I20260709 13:02:11.358872  8896 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.359035  8362 raft_consensus.cc:2393] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:11.359489  8218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.029s	sys 0.028s
W20260709 13:02:10.843575 10283 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.004s	sys 0.044s
I20260709 13:02:11.360559  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:11.352538  8115 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 2 to 3, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:10.707507 10509 consensus_meta.cc:287] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.041s	user 0.010s	sys 0.000s
I20260709 13:02:10.639849 10565 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:10.846203  8359 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.006s	sys 0.054s
I20260709 13:02:11.301434  8214 rpcz_store.cc:276] 0709 13:02:08.924250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.193303 (+269053us) service_pool.cc:224] Handling call
0709 13:02:09.193598 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.193992 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.194020 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.208809 (+ 14789us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.559258 (+1350449us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:10.559304 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.559377 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.045748 (+486371us) raft_consensus.cc:1685] finished
0709 13:02:11.045769 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.045937 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13890,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":19665,"thread_start_us":1313514,"threads_started":1,"wal-append.queue_time_us":1741123}
W20260709 13:02:11.186906 10593 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:02:11.362021  8287 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.011s	sys 0.015s
I20260709 13:02:10.768628 10408 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:11.358894  8365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.001s	sys 0.025s
I20260709 13:02:11.360962  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:11.231499 10397 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:10.627137  8890 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
W20260709 13:02:11.144824 10576 log.cc:927] Time spent T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
W20260709 13:02:11.189066 10587 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:02:10.938405  8893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.013s	sys 0.039s
I20260709 13:02:11.360415  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 431) took 2259 ms. Trace:
I20260709 13:02:11.356662 10310 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:11.385370  8359 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.010s	sys 0.069s
I20260709 13:02:10.629684 10555 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:11.196338 10349 consensus_meta.cc:287] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.000s
I20260709 13:02:10.766515 10234 raft_consensus.cc:3055] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:11.199323  8892 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:11.396745  8363 rpcz_store.cc:276] 0709 13:02:09.088749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.088955 (+   206us) service_pool.cc:224] Handling call
0709 13:02:09.089264 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.089487 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:09.899256 (+809769us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.347367 (+1448111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.347420 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.347472 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.347547 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.347654 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1142081,"prepare.run_cpu_time_us":174,"prepare.run_wall_time_us":173,"raft.queue_time_us":55845,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":13812,"thread_start_us":2201053,"threads_started":2}
I20260709 13:02:11.385530 10565 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.186616 10473 raft_consensus.cc:3055] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:11.370868  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:11.410239  8215 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:11.410815  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:11.371609  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.375387  8216 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:11.362635  8115 catalog_manager.cc:5697] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 4, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 4 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
W20260709 13:02:11.412328  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.412676  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.412573  8115 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 4, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:11.384514  8287 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.011s	sys 0.016s
I20260709 13:02:11.362936  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:10.688596 10334 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:11.184403  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:10.793500 10471 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:11.386317  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:10.821931 10460 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:10.969828 10495 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:11.185950  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 450) took 1456 ms. Trace:
I20260709 13:02:10.820304 10551 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:11.387351  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:11.387351  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:11.388221  8895 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:11.421919  8364 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:11.365257  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:10.627352 10363 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.426124  8897 raft_consensus.cc:2393] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:10.767719 10569 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:10.624652 10515 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.355020  8891 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.346576 10556 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:11.348932 10447 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.367290 10283 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.428s	user 0.012s	sys 0.044s
I20260709 13:02:11.346290 10419 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:11.391100  8862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.016s	sys 0.008s
I20260709 13:02:11.394410  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:11.438606  8862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.016s	sys 0.008s
I20260709 13:02:11.438838  8366 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:11.394057  8896 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
W20260709 13:02:11.439261  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 916011us
I20260709 13:02:11.439728  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1022) took 1277 ms. Trace:
I20260709 13:02:11.366791  8362 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:11.294787  8889 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:11.360270 10300 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:11.366647 10492 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:11.399878  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 438) took 2242 ms. Trace:
I20260709 13:02:11.408949 10310 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.423558  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 567) took 1588 ms. Trace:
I20260709 13:02:11.371987 10456 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:11.384176 10476 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.403956 10478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.000s	sys 0.042s
I20260709 13:02:11.390010 10389 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.644225 10413 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.347044 10530 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:11.346423 10496 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:11.398481  8893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.458s	user 0.014s	sys 0.054s
W20260709 13:02:11.398716 10348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.012s	sys 0.027s
I20260709 13:02:11.407238  8894 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:11.508275  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1014) took 1475 ms. Trace:
I20260709 13:02:11.508677  8894 rpcz_store.cc:276] 0709 13:02:10.032443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.308399 (+1275956us) service_pool.cc:224] Handling call
0709 13:02:11.508204 (+199805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.454105 10349 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:11.411463  8363 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
W20260709 13:02:11.466852 10478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.000s	sys 0.042s
I20260709 13:02:11.414741  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 588) took 1829 ms. Trace:
I20260709 13:02:11.519770  8287 rpcz_store.cc:276] 0709 13:02:09.585587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.585718 (+   131us) service_pool.cc:224] Handling call
0709 13:02:09.586400 (+   682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.586759 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.586786 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.610968 (+ 24182us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.444076 (+833108us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.414340 (+970264us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.414521 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.414571 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.414599 (+    28us) raft_consensus.cc:1685] finished
0709 13:02:11.414605 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.414692 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9331,"prepare.queue_time_us":1067159,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":9392,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"thread_start_us":1626724,"threads_started":2,"wal-append.queue_time_us":1348898}
I20260709 13:02:11.416584  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1418) took 3363 ms. Trace:
I20260709 13:02:11.398909 10372 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.401268 10384 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:11.401435  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 568) took 1548 ms. Trace:
I20260709 13:02:11.403270 10234 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:11.530417 10234 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.420522  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.384970 10509 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.534991 10509 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:11.386529  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:11.421767  8863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.013s	sys 0.019s
W20260709 13:02:11.535804  8863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.013s	sys 0.019s
I20260709 13:02:11.535985  8367 raft_consensus.cc:2393] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:11.536347  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 1.33709e+06us
I20260709 13:02:11.428148  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1023) took 1025 ms. Trace:
I20260709 13:02:11.539019  8897 rpcz_store.cc:276] 0709 13:02:10.402441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.364981 (+962540us) service_pool.cc:224] Handling call
0709 13:02:11.428092 (+ 63111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.409890 10473 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:11.413980 10571 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:11.433277  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46003.4us
I20260709 13:02:11.440107  8862 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:11.439996  8896 rpcz_store.cc:276] 0709 13:02:10.162306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.353150 (+1190844us) service_pool.cc:224] Handling call
0709 13:02:11.439670 (+ 86520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.440586  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1517) took 1049 ms. Trace:
I20260709 13:02:11.444399  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:11.513451 10348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.012s	sys 0.028s
I20260709 13:02:11.448515  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 564) took 1627 ms. Trace:
W20260709 13:02:11.367475 10507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.009s	sys 0.019s
W20260709 13:02:11.443650 10573 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 13:02:11.459627  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.457482  8895 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
W20260709 13:02:11.572214  8895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1011) took 1540 ms (client timeout 2052 ms). Trace:
W20260709 13:02:11.572669  8895 rpcz_store.cc:269] 0709 13:02:10.031771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.304458 (+1272687us) service_pool.cc:224] Handling call
0709 13:02:11.572147 (+267689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.469889 10476 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:11.445755  8365 rpcz_store.cc:276] 0709 13:02:09.214978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.226094 (+ 11116us) service_pool.cc:224] Handling call
0709 13:02:09.226456 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.226687 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:10.083527 (+856840us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.398197 (+1314670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.398249 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.399625 (+  1376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.399699 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.399820 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3439,"prepare.queue_time_us":1138326,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":35994,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4355,"thread_start_us":2139887,"threads_started":2}
I20260709 13:02:11.450913 10300 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:11.474774 10389 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.476649 10497 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:11.391449  9963 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.512362  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1436) took 1947 ms. Trace:
I20260709 13:02:11.545639 10610 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:11.413790  8115 catalog_manager.cc:5697] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.441978 10447 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.527717 10384 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.528239  8363 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:02:11.528664  8211 raft_consensus.cc:2368] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5.
I20260709 13:02:11.529016  8890 rpcz_store.cc:276] 0709 13:02:09.850448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.854021 (+  3573us) service_pool.cc:224] Handling call
0709 13:02:11.398361 (+1544340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792}
I20260709 13:02:11.472724 10598 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:11.543084  8894 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 13:02:11.538004 10553 consensus_meta.cc:287] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.911s	user 0.006s	sys 0.003s
I20260709 13:02:11.545557 10496 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:11.547015  8286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.117s	user 0.065s	sys 0.074s
W20260709 13:02:11.596664  8286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.066s	sys 0.074s
I20260709 13:02:11.445214 10551 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.521880  8213 rpcz_store.cc:276] 0709 13:02:08.053291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.150696 (+ 97405us) service_pool.cc:224] Handling call
0709 13:02:09.086211 (+935515us) spinlock_profiling.cc:243] Waited 908 us on lock 0x7b5800002798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:09.086427 (+   216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.086784 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.086909 (+   125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.092689 (+  5780us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.072284 (+979595us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:10.072328 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.072398 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.407297 (+1334899us) raft_consensus.cc:1685] finished
0709 13:02:11.407318 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.416532 (+  9214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4424,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5535,"spinlock_wait_cycles":2089344,"thread_start_us":945253,"threads_started":1,"wal-append.queue_time_us":1229857}
I20260709 13:02:11.547962  8364 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:11.575870 10413 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:11.547068  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:11.551551  8291 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:11.556821  8896 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:11.605572  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 58582.5us
I20260709 13:02:11.515950 10349 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.454383 10492 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.545454 10564 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:11.526711 10561 consensus_meta.cc:287] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.481s	user 0.012s	sys 0.002s
W20260709 13:02:11.568833  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 128795us
I20260709 13:02:11.625715  8862 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:11.466351 10456 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.630060  8210 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:11.580322  8365 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:11.602454 10553 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:11.569475 10507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.009s	sys 0.019s
I20260709 13:02:11.586202  9963 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.582222  8216 rpcz_store.cc:276] 0709 13:02:09.565385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.565501 (+   116us) service_pool.cc:224] Handling call
0709 13:02:09.565787 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.412177 (+1846390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.512085 (+ 99908us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400128754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:11.512294 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4160815872}
I20260709 13:02:11.597456  8894 pending_rounds.cc:85] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 4
I20260709 13:02:11.678020  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:11.678097  8894 pending_rounds.cc:107] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:02:11.679487  8894 raft_consensus.cc:2889] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.547694  8362 rpcz_store.cc:276] 0709 13:02:10.391900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.366220 (+974320us) service_pool.cc:224] Handling call
0709 13:02:11.366500 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.440244 (+ 73744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.440528 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.451363  8892 rpcz_store.cc:276] 0709 13:02:09.833334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.849971 (+ 16637us) service_pool.cc:224] Handling call
0709 13:02:11.198705 (+1348734us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:11.198927 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.406958 (+208031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.421905 (+ 14947us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36521856}
I20260709 13:02:11.603901  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.684510  8366 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:11.605876  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1019) took 1524 ms. Trace:
I20260709 13:02:11.547310 10372 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.427246  8358 rpcz_store.cc:276] 0709 13:02:09.729123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.731467 (+  2344us) service_pool.cc:224] Handling call
0709 13:02:11.185066 (+1453599us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:11.185307 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.185528 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.185565 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.185610 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.185660 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.185733 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.185881 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51202944}
W20260709 13:02:11.611688  8259 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.025s	sys 0.075s
I20260709 13:02:11.559068 10571 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:11.697214  8259 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.025s	sys 0.075s
I20260709 13:02:11.617950  8361 raft_consensus.cc:2410] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:11.601953 10598 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:11.628223  8862 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:11.628837 10609 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.557287  8889 rpcz_store.cc:276] 0709 13:02:09.820932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.823023 (+  2091us) service_pool.cc:224] Handling call
0709 13:02:11.445241 (+1622218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896}
I20260709 13:02:11.465178  8891 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:11.606483 10551 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.715281  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:11.628155  8364 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:11.545552 10473 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.594266 10529 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:11.630982 10561 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:11.678977  8365 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.685750  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 594) took 1989 ms. Trace:
I20260709 13:02:11.685359  8896 rpcz_store.cc:276] 0709 13:02:10.081345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.547768 (+1466423us) service_pool.cc:224] Handling call
0709 13:02:11.548046 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.605585 (+ 57539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.605790 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.690013  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:11.763677  8216 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:11.691983  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.692426  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 306364us
I20260709 13:02:11.630292 10363 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:11.623883 10300 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:11.695351  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1010) took 1663 ms. Trace:
W20260709 13:02:11.697544  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 1.03861e+06us
I20260709 13:02:11.698796  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:11.597018 10610 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:11.700644  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:11.796380  8214 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:11.630689 10492 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:11.626245 10348 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:11.709338  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 81197.8us
W20260709 13:02:11.791291  8259 connection.cc:256] RPC call timeout handler was delayed by -1.1247591139999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:02:11.820586  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:11.630707 10476 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:11.703676  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:11.711710  8891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1017) took 1658 ms (client timeout 1885 ms). Trace:
W20260709 13:02:11.822692  8891 rpcz_store.cc:269] 0709 13:02:10.053335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.555095 (+501760us) service_pool.cc:224] Handling call
0709 13:02:11.711650 (+1156555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.823293  8862 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:11.424847 10334 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:11.712746  8213 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:11.667099  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1439) took 1433 ms. Trace:
I20260709 13:02:11.718222  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:11.722968  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:11.829628  8362 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.611640 10349 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.764593  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:11.819032 10612 log.cc:927] Time spent T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:02:11.779117  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:11.780300  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:11.838762  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:11.781499  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:11.711756 10509 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:11.714377 10624 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.789212  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.790201  8894 rpcz_store.cc:276] 0709 13:02:10.031552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.518695 (+1487143us) service_pool.cc:224] Handling call
0709 13:02:11.519008 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.695069 (+176061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.695295 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.792305  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1512) took 1636 ms. Trace:
I20260709 13:02:11.851759  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:11.873551  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:11.792819  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 485424us
I20260709 13:02:11.792711  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.761802  8292 rpcz_store.cc:276] 0709 13:02:09.696601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.699730 (+  3129us) service_pool.cc:224] Handling call
0709 13:02:09.700082 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.700324 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:11.302887 (+1602563us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.685136 (+382249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.685454 (+   318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.685512 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.685579 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.685697 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1750071,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5542,"thread_start_us":1963779,"threads_started":2}
I20260709 13:02:11.693638 10478 consensus_queue.cc:1059] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:02:11.796895  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1020) took 1695 ms. Trace:
I20260709 13:02:11.714599 10515 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:11.794595  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.793867  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.825697 10473 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:11.794641 10596 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:02:11.813421 10627 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.824241  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:11.820794  8259 connection.cc:256] RPC call timeout handler was delayed by -1.0671459409999784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27740000000000004s for a response
W20260709 13:02:11.822773  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 119142us
I20260709 13:02:11.837081 10555 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:11.832851  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1435) took 2291 ms. Trace:
I20260709 13:02:11.833705  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:11.768072  9963 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:11.833757  8216 raft_consensus.cc:2410] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:11.835726  8862 leader_election.cc:400] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5.
W20260709 13:02:11.837779  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.796870  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:11.842240  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:11.811054 10530 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:11.869896  8892 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:11.867827  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:11.868340 10571 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:11.827246 10495 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:11.810245  8285 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:11.876161  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:11.936745  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 60659.2us
I20260709 13:02:11.937390  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:11.937929  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:11.827385 10556 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:11.834578 10628 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:11.877792  8896 rpcz_store.cc:276] 0709 13:02:10.101556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.774287 (+1672731us) service_pool.cc:224] Handling call
0709 13:02:11.796390 (+ 22103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.796571 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.796594 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.796631 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.796692 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.796747 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.796840 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.880388  8366 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:11.883929  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:11.901780  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.940308  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:11.941195  8292 raft_consensus.cc:2410] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:02:11.840320 10603 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.294s	user 0.001s	sys 0.001s
I20260709 13:02:11.885145  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:11.907804  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.942379  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.907071  8862 leader_election.cc:403] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:11.944288  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:11.945513  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:11.941905  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 56825us
I20260709 13:02:11.884605 10622 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:11.911335  8287 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:11.854791  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:11.894811 10620 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:02:11.895278 10613 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:02:11.877978 10600 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:02:11.928175  8284 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
W20260709 13:02:11.928908  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.829355  8210 rpcz_store.cc:276] 0709 13:02:10.198438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.208247 (+  9809us) service_pool.cc:224] Handling call
0709 13:02:11.630648 (+1422401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.886157 10544 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:11.948400  8215 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:12.005331  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:12.004455  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:11.886833 10561 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:11.885267 10446 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:11.952731  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 122500us
I20260709 13:02:11.954481  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:11.909682  8365 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:11.886420 10572 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:02:11.906383  8218 rpcz_store.cc:276] 0709 13:02:09.541223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.553933 (+ 12710us) service_pool.cc:224] Handling call
0709 13:02:09.554254 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.554454 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:10.430291 (+875837us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.832523 (+1402232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.832570 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:11.832630 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.832695 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.832796 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35444,"prepare.queue_time_us":495585,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":46880,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":6345,"thread_start_us":2232474,"threads_started":3,"wal-append.queue_time_us":1149462}
I20260709 13:02:11.849826 10471 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:02:11.956882  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:11.919147 10602 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260709 13:02:11.883559 10334 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:11.958004  8293 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:11.958160  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:12.056389  8292 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.054160  8289 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
W20260709 13:02:11.930133 10606 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:02:11.912467 10555 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:12.006543  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.932632  8358 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:12.068193  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1012) took 2036 ms. Trace:
I20260709 13:02:12.068670  8897 rpcz_store.cc:276] 0709 13:02:10.032003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.540246 (+1508243us) service_pool.cc:224] Handling call
0709 13:02:11.546042 (+  5796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.825960 (+279918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.825991 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.826030 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:11.826096 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.067909 (+241813us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54004c7cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:12.067959 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.068114 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643121536}
I20260709 13:02:11.967340  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:12.071089  8214 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:11.948635  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:11.947527 10556 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:12.018566  8216 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:12.004796 10622 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:12.078773  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 172677us
W20260709 13:02:12.047185  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 92744.5us
I20260709 13:02:11.936033 10495 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.017040  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 574) took 1909 ms. Trace:
I20260709 13:02:12.047785 10515 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:12.048308 10455 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:11.957858 10628 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:12.141505 10455 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:12.109933 10639 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.142944  8217 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:12.143009 10639 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.145444 10639 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.050755  8862 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:12.148414  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 97747.1us
I20260709 13:02:11.957535 10571 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:12.048542  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2123) took 4064 ms. Trace:
I20260709 13:02:12.081439 10397 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.051563 10446 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.003890 10478 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:12.021793  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:12.053519  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 265101us
I20260709 13:02:12.054914  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 587) took 2452 ms. Trace:
I20260709 13:02:12.158519  8288 rpcz_store.cc:276] 0709 13:02:09.578764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.578988 (+   224us) service_pool.cc:224] Handling call
0709 13:02:09.600031 (+ 21043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.622810 (+ 22779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.622850 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.654113 (+ 31263us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.299812 (+1645699us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:11.299852 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.299920 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.031057 (+731137us) raft_consensus.cc:1685] finished
0709 13:02:12.031081 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.031242 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":560,"raft.queue_time_us":14455,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4000,"thread_start_us":1645308,"threads_started":1,"wal-append.queue_time_us":1858362}
I20260709 13:02:11.872251  8359 rpcz_store.cc:276] 0709 13:02:10.155835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.184476 (+ 28641us) service_pool.cc:224] Handling call
0709 13:02:10.184873 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.185105 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:11.409126 (+1224021us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.714901 (+305775us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.762050 (+ 47149us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.766730 (+  4680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.792091 (+ 25361us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.792241 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":341991,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5822,"raft.queue_time_us":14416,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5676,"thread_start_us":1474913,"threads_started":2,"wal-append.queue_time_us":385210}
I20260709 13:02:12.161731  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.116540 10495 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.062558  8259 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:12.163103  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:12.163393  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 100900us
W20260709 13:02:12.163921 10565 consensus_meta.cc:287] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.743s	user 0.004s	sys 0.004s
I20260709 13:02:12.064117  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:11.918787 10627 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.111714  8864 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:12.070811 10555 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.149451  8286 rpcz_store.cc:276] 0709 13:02:07.984421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.984538 (+   117us) service_pool.cc:224] Handling call
0709 13:02:07.984933 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:07.985384 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.985414 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:07.997840 (+ 12426us) log.cc:844] Serialized 52 byte log entry
0709 13:02:08.381387 (+383547us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:08.632844 (+251457us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.956828 (+323984us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18003d3420. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:09.542589 (+585761us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b2400276248. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef8fe69c4 00007f2ef8fe4acb 00007f2ef919fdc9 00007f2ef919fa55 00007f2ef919f09d 00007f2efbdd110e 00007f2efbde888c 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221
0709 13:02:11.597071 (+2054482us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.048152 (+451081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.048249 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.048305 (+    56us) raft_consensus.cc:1685] finished
0709 13:02:12.048315 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.048455 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91717,"prepare.queue_time_us":1288893,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":93677,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":12167,"spinlock_wait_cycles":73319680,"thread_start_us":3929070,"threads_started":6,"wal-append.queue_time_us":721670,"wal-append.run_cpu_time_us":6916,"wal-append.run_wall_time_us":2155464}
I20260709 13:02:12.113798  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 582) took 3590 ms. Trace:
I20260709 13:02:12.054595 10528 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.881623 10624 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.056239 10456 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.049852  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.152770 10515 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:12.274137 10599 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.750s	user 0.000s	sys 0.006s
I20260709 13:02:12.275028 10515 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:12.276291  8211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1437) took 2478 ms (client timeout 2011 ms). Trace:
W20260709 13:02:12.276736  8211 rpcz_store.cc:269] 0709 13:02:09.797601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.797750 (+   149us) service_pool.cc:224] Handling call
0709 13:02:12.276069 (+2478319us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400377dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:12.276209 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3847299328}
I20260709 13:02:11.962713 10629 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:02:12.079937 10561 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.084447 10556 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:12.196673  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 85046.2us
I20260709 13:02:12.288303  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.165514  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:12.290479  8292 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
W20260709 13:02:12.290773  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 125303us
I20260709 13:02:12.158980  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1438) took 2339 ms. Trace:
I20260709 13:02:12.293213  8209 rpcz_store.cc:276] 0709 13:02:09.819146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.819276 (+   130us) service_pool.cc:224] Handling call
0709 13:02:09.830464 (+ 11188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.830980 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.831019 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.854323 (+ 23304us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.306606 (+1452283us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:11.306655 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.306719 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.158734 (+852015us) raft_consensus.cc:1685] finished
0709 13:02:12.158754 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.158917 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1254,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":20297,"thread_start_us":1370665,"threads_started":1,"wal-append.queue_time_us":1577415}
I20260709 13:02:12.199115  8290 rpcz_store.cc:276] 0709 13:02:08.523252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.524452 (+  1200us) service_pool.cc:224] Handling call
0709 13:02:08.524860 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.525229 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.525257 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.596215 (+1070958us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b2c00084bd8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efab46a11 00007f2efab56372 00007f2efc288a01 00007f2efc24d43a 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2
0709 13:02:09.613718 (+ 17503us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.305010 (+1691292us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.832339 (+527329us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.885932 (+ 53593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.886012 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.113433 (+227421us) raft_consensus.cc:1685] finished
0709 13:02:12.113545 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.113715 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53371,"prepare.queue_time_us":206488,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":60091,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":18716,"spinlock_wait_cycles":167742720,"thread_start_us":2148062,"threads_started":2,"wal-append.queue_time_us":1893676}
I20260709 13:02:12.137224 10551 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.164337 10565 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.158039  8257 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:12.150326  8217 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:12.150169 10571 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.161937 10622 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.246160  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 569) took 2385 ms. Trace:
I20260709 13:02:12.157006 10478 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.247504  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 573) took 2152 ms. Trace:
I20260709 13:02:12.248296 10627 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.254838 10610 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:12.255213 10637 log.cc:927] Time spent T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:12.258527  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 576) took 2148 ms. Trace:
I20260709 13:02:12.274302 10372 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.198704 10626 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:02:12.264057 10349 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:12.266301 10459 consensus_meta.cc:287] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.644s	user 0.006s	sys 0.006s
I20260709 13:02:12.195968 10334 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:12.267040 10630 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260709 13:02:12.268558 10446 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.278012 10507 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:12.301350  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.292115  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:12.115808  8892 rpcz_store.cc:276] 0709 13:02:10.100967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.767059 (+1666092us) service_pool.cc:224] Handling call
0709 13:02:11.832192 (+ 65133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.937554 (+105362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.010517 (+ 72963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:12.153878 10500 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:12.307801  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 149817us
I20260709 13:02:12.349758  8212 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:12.303908 10456 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:02:12.302765 10609 consensus_meta.cc:287] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.002s
I20260709 13:02:12.308753 10495 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:12.314574  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 365965us
I20260709 13:02:12.314142  8209 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:12.201236 10310 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.302814  8893 rpcz_store.cc:276] 0709 13:02:09.860544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.889855 (+ 29311us) service_pool.cc:224] Handling call
0709 13:02:09.939326 (+ 49471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.940027 (+   701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.940065 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.940630 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.510758 (+1570128us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:11.510812 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.510883 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.240323 (+729440us) raft_consensus.cc:1685] finished
0709 13:02:12.241866 (+  1543us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.246056 (+  4190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1510,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"thread_start_us":1561712,"threads_started":1,"wal-append.queue_time_us":1501613}
I20260709 13:02:12.316192  8894 rpcz_store.cc:276] 0709 13:02:10.109805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.851442 (+1741637us) service_pool.cc:224] Handling call
0709 13:02:11.894639 (+ 43197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.895107 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.895138 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.895627 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.057467 (+161840us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:12.057500 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.057585 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.258152 (+200567us) raft_consensus.cc:1685] finished
0709 13:02:12.258175 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.258452 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"thread_start_us":161112,"threads_started":1,"wal-append.queue_time_us":359520}
I20260709 13:02:12.202342 10300 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:02:12.247442 10624 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.324409  8211 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:12.303998 10571 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:12.332073  8291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60538 (request call id 2148) took 1976 ms (client timeout 2244 ms). Trace:
I20260709 13:02:12.352167 10446 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:12.307825 10478 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.314664 10622 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:12.342350 10459 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:12.343858  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.343811  8364 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:12.309191  8363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:02:12.306763 10561 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.314208  8898 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:12.359797  8863 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:12.331992 10650 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:12.405781  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.406090 10650 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.406548 10650 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.346285 10507 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.410354 10507 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:12.370436  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:12.415203  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:12.336663  8362 consensus_meta.cc:287] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
I20260709 13:02:12.417718  8362 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
W20260709 13:02:12.371399  8291 rpcz_store.cc:269] 0709 13:02:10.355829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.190410 (+834581us) service_pool.cc:224] Handling call
0709 13:02:12.331876 (+1141466us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b5400146254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:12.332014 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204296576}
I20260709 13:02:12.349243 10500 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:12.419008 10500 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:12.352465 10471 consensus_queue.cc:1243] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:12.377365  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:12.347038  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 54990.2us
W20260709 13:02:12.399719  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.375897  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:12.423283  8209 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:12.362303 10609 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:12.362161 10652 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.443950  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:12.444139  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.444770  8894 raft_consensus.cc:2393] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:12.444629  8211 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:12.361972 10626 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:02:12.474931  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 97628.6us
I20260709 13:02:12.475864  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:12.398155 10622 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.503597  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.515161  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.517603  8366 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
W20260709 13:02:12.526559  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 50796.6us
I20260709 13:02:12.527248  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.363430 10643 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:02:12.442531  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:12.499833  8358 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
W20260709 13:02:12.555142  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.622102  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:12.610869  8184 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:12.586061  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 117005us
I20260709 13:02:12.630488  8290 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 2: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:12.623716  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 245203us
I20260709 13:02:12.529925  8894 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:12.623132  8363 raft_consensus.cc:606] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:12.637215  8363 raft_consensus.cc:614] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:12.574198  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.636687  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:12.547330 10651 log.cc:927] Time spent T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:02:12.653894  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 231078us
I20260709 13:02:12.511425 10622 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:12.661103  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 302124us
I20260709 13:02:12.581259 10471 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:12.659238  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.622946 10654 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:12.642789  8332 leader_election.cc:336] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.592s (SENT)
I20260709 13:02:12.662672  8863 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:12.537633 10662 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:12.613570 10495 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:12.668740  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:12.644141 10476 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:12.547446 10565 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:12.673095  8332 leader_election.cc:336] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.612s (SENT)
I20260709 13:02:12.675665  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:12.509668 10657 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
I20260709 13:02:12.657689 10639 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:12.308328  8890 rpcz_store.cc:276] 0709 13:02:10.095262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.609450 (+1514188us) service_pool.cc:224] Handling call
0709 13:02:11.627836 (+ 18386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.628073 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:11.844236 (+216163us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.244097 (+399861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.247160 (+  3063us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:12.247241 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.247317 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.247440 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188375,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":113272,"spinlock_wait_cycles":22768512,"thread_start_us":475745,"threads_started":3,"wal-append.queue_time_us":329628}
I20260709 13:02:12.687065  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.689854  8894 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:12.510905 10652 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.677276  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.706117  8366 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:12.668347 10471 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:12.702795  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.746552  8892 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:12.747092  8211 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:12.747622  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.748870  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.734426 10471 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.675068 10654 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:12.703349 10655 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.735970  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:12.782155  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.681113 10349 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:12.830951  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.707131 10662 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.703392 10639 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.687573  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.833493  8366 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
W20260709 13:02:12.832981 10473 consensus_meta.cc:287] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.929s	user 0.003s	sys 0.008s
I20260709 13:02:12.705513 10661 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.734791 10565 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:12.735993 10619 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:12.839664 10653 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.441s	user 0.000s	sys 0.002s
I20260709 13:02:12.828991 10561 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.866441  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:12.848578 10667 log.cc:927] Time spent T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
W20260709 13:02:12.855595 10660 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:02:12.730017 10495 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:02:12.736922 10460 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:02:12.703538 10642 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:02:12.832245 10656 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:12.851554  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:12.915778  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:12.836859 10650 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.863408 10459 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:12.862924 10619 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.854249 10639 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.897687 10655 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.858896  8358 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:12.848361 10500 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.957839  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:12.958170  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:12.943946  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.905195 10565 raft_consensus.cc:697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:12.910893 10372 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:12.962946  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 274740us
I20260709 13:02:12.864993 10662 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:12.958983 10649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.017s	sys 0.022s
W20260709 13:02:12.972342  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.969938  8332 leader_election.cc:336] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.777s (SENT)
I20260709 13:02:12.956590 10619 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.973711  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:12.973977  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2066) took 1178 ms. Trace:
I20260709 13:02:12.974460  8213 rpcz_store.cc:276] 0709 13:02:11.795366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.878431 (+ 83065us) service_pool.cc:224] Handling call
0709 13:02:11.913018 (+ 34587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.920013 (+  6995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.920042 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.933813 (+ 13771us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.220836 (+287023us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:12.220883 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.220961 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.973736 (+752775us) raft_consensus.cc:1685] finished
0709 13:02:12.973760 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.973914 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54434,"raft.queue_time_us":18428,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":16371,"thread_start_us":211192,"threads_started":1,"wal-append.queue_time_us":392280}
W20260709 13:02:12.975980 10649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.017s	sys 0.022s
W20260709 13:02:12.982837  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 302519us
I20260709 13:02:12.918010 10656 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:12.961669  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:12.985891  8332 connection.cc:256] RPC call timeout handler was delayed by -2.3953653209999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 13:02:12.984870  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:12.981035 10661 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:12.987226  8332 connection.cc:256] RPC call timeout handler was delayed by -2.2458432489999609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:02:12.997056  8332 connection.cc:256] RPC call timeout handler was delayed by -2.1117809600000328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:02:12.997599  8332 connection.cc:256] RPC call timeout handler was delayed by -2.0685432490000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:02:12.996533  8892 raft_consensus.cc:2376] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4. Re-sending same reply.
I20260709 13:02:13.005335 10598 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.006711 10598 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:13.010620  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.011648  8892 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:13.013032  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 1965) took 1054 ms. Trace:
W20260709 13:02:13.014128 10571 consensus_meta.cc:287] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.001s
I20260709 13:02:13.015015 10571 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.016855  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 572) took 2927 ms. Trace:
W20260709 13:02:13.019251 10665 log.cc:927] Time spent T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:13.020399 10672 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.993290  8259 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:12.964303 10655 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:12.969949 10372 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:12.985846 10507 consensus_meta.cc:287] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.001s
W20260709 13:02:13.021896  8332 connection.cc:256] RPC call timeout handler was delayed by -2.0415432489999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 13:02:13.020603 10622 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.013484  8367 rpcz_store.cc:276] 0709 13:02:11.958888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.959009 (+   121us) service_pool.cc:224] Handling call
0709 13:02:13.012326 (+1053317us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:13.012525 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.012730 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.012755 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.012793 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:13.012828 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.012880 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.012975 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11415296}
I20260709 13:02:13.017246  8895 rpcz_store.cc:276] 0709 13:02:10.089006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.573385 (+1484379us) service_pool.cc:224] Handling call
0709 13:02:11.573709 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.573944 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:11.833425 (+259481us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.016424 (+1182999us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b1800476260. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2efbdf54bc 00007f2ef914348b 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915d455 00007f2efc245060 00007f2efc257716 00007f2efc268287
0709 13:02:13.016516 (+    92us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.016563 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:13.016609 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.016683 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.016798 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13028,"prepare.queue_time_us":242207,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":95856,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":27257,"spinlock_wait_cycles":2689920,"thread_start_us":554133,"threads_started":3,"wal-append.queue_time_us":316768}
W20260709 13:02:12.994820  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 331842us
W20260709 13:02:13.040184  8332 connection.cc:256] RPC call timeout handler was delayed by -1.2418149160000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 13:02:13.060524  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:13.090652  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.013033  8892 raft_consensus.cc:1240] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:13.042160 10673 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:02:12.990783 10642 raft_consensus.cc:2764] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:02:13.040943  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 47746.6us
W20260709 13:02:13.091441  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1707149160000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:02:13.075836 10473 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:13.094724  8895 raft_consensus.cc:1240] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:13.134855  8863 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.133514  8259 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.042747 10459 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.138612  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.075353 10661 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:13.040886 10397 consensus_meta.cc:287] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.883s	user 0.011s	sys 0.000s
W20260709 13:02:13.139408  8332 leader_election.cc:336] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.560s (SENT)
I20260709 13:02:13.083891 10652 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:13.142745 10677 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.147540  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:13.141319  8259 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:13.146009  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 509327us
I20260709 13:02:12.997723 10565 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.138253 10649 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.140298 10680 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:13.060690 10507 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:13.175184  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.139952 10556 consensus_meta.cc:287] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.832s	user 0.015s	sys 0.010s
I20260709 13:02:13.093940 10654 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:13.516672  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.517165  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.307760  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:13.517648  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.518332  8215 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
W20260709 13:02:13.182633  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0496123789999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:02:13.267042 10478 consensus_meta.cc:287] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.003s
W20260709 13:02:13.519771  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.140161 10473 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.247382 10679 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.520828 10619 consensus_meta.cc:287] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.000s
I20260709 13:02:13.534633 10619 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:13.535903  8365 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:13.520596 10679 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.539921 10679 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.542348  8897 raft_consensus.cc:1240] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:13.543501 10619 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:13.544111  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 686) took 1377 ms. Trace:
W20260709 13:02:13.306494 10555 consensus_meta.cc:287] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.063s	user 0.010s	sys 0.001s
I20260709 13:02:13.153281 10397 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5.
I20260709 13:02:13.319455 10500 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.172300 10655 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.163159  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:13.172401  8890 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:13.521984  8183 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.519640 10478 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:13.518997  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:13.526559 10389 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.164908 10372 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:13.526329 10622 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.532217 10507 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:13.533593  8898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 577) took 2926 ms (client timeout 2693 ms). Trace:
W20260709 13:02:13.537494  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.544437  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:13.583315  8898 rpcz_store.cc:269] 0709 13:02:10.607210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.360346 (+753136us) service_pool.cc:224] Handling call
0709 13:02:13.533379 (+2173033us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54000f64d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:13.533512 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044125952}
I20260709 13:02:13.544512  8897 rpcz_store.cc:276] 0709 13:02:12.166809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.166974 (+   165us) service_pool.cc:224] Handling call
0709 13:02:13.542172 (+1375198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.542780 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.543909 (+  1129us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000f64d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:13.544054 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2981008768}
I20260709 13:02:13.163689  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:13.378391 10684 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:02:13.578493  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.535902  8360 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:13.585728  8216 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:13.178356 10682 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.579492  8894 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:13.530717 10647 raft_consensus.cc:3055] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:13.516211 10662 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:13.581799  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 271461us
W20260709 13:02:13.582683  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 443246us
I20260709 13:02:13.585784  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:13.249816 10459 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:13.577205 10598 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.269986 10650 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:13.590051  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.601418  8216 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:13.580019  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 687) took 1338 ms. Trace:
I20260709 13:02:13.151949 10661 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.270018 10471 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:13.587545 10553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.703s	user 0.005s	sys 0.006s
W20260709 13:02:13.606369 10553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.722s	user 0.006s	sys 0.006s
I20260709 13:02:13.607095  8359 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:13.589342 10389 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.604158  8890 rpcz_store.cc:276] 0709 13:02:12.241050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.730118 (+489068us) service_pool.cc:224] Handling call
0709 13:02:13.578936 (+848818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.592984 10656 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:13.608953 10639 consensus_meta.cc:287] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
I20260709 13:02:13.589151 10647 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:13.609382 10639 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.609858 10647 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.611129 10647 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.611797 10639 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.605078 10473 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.616093  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:13.616787  8358 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:13.620047 10628 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:13.605480 10459 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:13.621531 10661 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.623320  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.623961  8216 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:13.625782 10478 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:13.628310  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:13.628808 10471 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:13.629623  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:13.591466  8332 leader_election.cc:336] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.794s (SENT)
W20260709 13:02:13.634888  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 43530.6us
I20260709 13:02:13.635066  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:13.575937 10555 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.587483 10571 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.586135  8360 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:13.621606 10459 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:13.593281  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.630952  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:13.592934  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:13.633206  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:13.546222 10556 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.643522  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:13.654873  8360 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:13.658191  8362 raft_consensus.cc:2410] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:13.658485  8360 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:13.645296  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 123384us
I20260709 13:02:13.646728  8218 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:13.648728 10555 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:13.649299  8891 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:02:13.651216  8366 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:02:13.652506 10234 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.630872 10283 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:13.655968  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 62748.2us
I20260709 13:02:13.664204  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.665313  8259 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.663307  8366 pending_rounds.cc:85] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 4
I20260709 13:02:13.602799 10598 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:13.666138  8366 pending_rounds.cc:107] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:02:13.666963  8366 raft_consensus.cc:2889] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:13.665694  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:13.660630 10571 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.668175  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:13.669216  8361 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:13.670625  8183 leader_election.cc:336] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.533s (SENT)
I20260709 13:02:13.670981  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:13.671705  8183 leader_election.cc:336] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.534s (SENT)
I20260709 13:02:13.671957  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:13.667914 10363 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.667625 10639 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:13.674737 10639 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:13.675114 10639 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.675568 10384 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.666703 10656 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.664785 10283 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:13.677322 10656 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.678159 10283 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:13.679508 10283 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.682284 10555 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.670384 10372 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.682852 10555 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.683423 10372 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.683866 10372 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:13.687772  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2061) took 1973 ms (client timeout 2108 ms). Trace:
W20260709 13:02:13.688298  8212 rpcz_store.cc:269] 0709 13:02:11.714779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.715020 (+   241us) service_pool.cc:224] Handling call
0709 13:02:13.687550 (+1972530us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54000582d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:13.687696 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457097088}
I20260709 13:02:13.695292  8893 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:13.679638 10656 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.700098 10691 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:13.700591 10691 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.700925 10691 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.701292  8358 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:13.684827 10555 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:13.706558  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.707499  8897 raft_consensus.cc:2410] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:13.709205 10556 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:13.710306  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.706434 10690 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:13.723116  8895 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:13.710716 10622 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.726336  8898 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:02:13.726629  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 54931.9us
W20260709 13:02:13.727381  8183 leader_election.cc:336] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.547s (SENT)
I20260709 13:02:13.711462 10598 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:13.729194  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.729664 10598 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:13.728142  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.729843  8898 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:13.741168 10622 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.743813  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:13.744551  8895 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:13.760179  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:13.763449  8258 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:13.769309  8258 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:13.769927  8895 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 2.
I20260709 13:02:13.772637  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:13.776007  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.776991  8897 raft_consensus.cc:2410] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:13.786752  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:13.779099  8258 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:13.787354  8895 raft_consensus.cc:2368] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:02:13.787992  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.753744  8889 raft_consensus.cc:1240] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:13.771494 10556 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:13.786227 10460 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:13.773294 10459 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:13.790846  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:13.794184 10459 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:13.795516 10459 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.790493  8360 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:02:13.798688  8360 pending_rounds.cc:85] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 3
I20260709 13:02:13.798974  8360 pending_rounds.cc:107] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:13.799218  8360 raft_consensus.cc:2889] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:13.799973  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 1961) took 1887 ms. Trace:
I20260709 13:02:13.800294  8360 rpcz_store.cc:276] 0709 13:02:11.912830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.918941 (+  6111us) service_pool.cc:224] Handling call
0709 13:02:12.003933 (+ 84992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.535801 (+1531868us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54000751a0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc1c4dc0 00007f2efc24f1c0 00007f2efc250231 00007f2efc24cd8f 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c
0709 13:02:13.799667 (+263866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.799885 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932970368}
I20260709 13:02:13.785156 10647 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:13.803391  8895 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:13.811134 10639 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:13.807279 10234 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:13.808000 10460 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:13.809695 10571 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.790611 10679 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.812270  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.818984  8897 raft_consensus.cc:2393] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 2: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:13.811966 10544 consensus_queue.cc:1059] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:02:13.820771 10363 raft_consensus.cc:3055] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:13.821202 10363 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:13.821537 10614 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 2.158s	user 0.008s	sys 0.001s
I20260709 13:02:13.837595  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:13.812880 10647 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.812496 10556 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:13.839411 10447 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.841305 10618 raft_consensus.cc:3055] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:13.818426 10679 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:13.842473 10460 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.843901  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2156) took 2059 ms. Trace:
I20260709 13:02:13.843451 10363 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.811007 10372 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:13.852034 10633 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 1.956s	user 0.001s	sys 0.008s
I20260709 13:02:13.852977 10372 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.847782  8287 rpcz_store.cc:276] 0709 13:02:11.784665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.052284 (+267619us) service_pool.cc:224] Handling call
0709 13:02:12.052601 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.284969 (+232368us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:12.361136 (+ 76167us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.679663 (+318527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.679712 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:12.679763 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.843656 (+1163893us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540028e954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:13.843703 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.843835 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168199,"prepare.queue_time_us":22995,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":169128,"spinlock_wait_cycles":350178560,"thread_start_us":199616,"threads_started":2,"wal-append.queue_time_us":373304,"wal-append.run_cpu_time_us":1054,"wal-append.run_wall_time_us":1007519}
I20260709 13:02:13.847505 10618 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:13.854574 10618 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:13.855096 10691 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.855540 10618 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:13.857147 10691 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:13.858165 10556 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:13.847218 10647 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.872606 10459 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:13.911736  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 118293us
I20260709 13:02:13.913939  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.876924 10679 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:13.914131  8285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60538 (request call id 2147) took 3558 ms (client timeout 2145 ms). Trace:
I20260709 13:02:13.916371  8258 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.914098 10459 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:13.915629  8285 rpcz_store.cc:269] 0709 13:02:10.355588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.537920 (+182332us) service_pool.cc:224] Handling call
0709 13:02:13.913887 (+3375967us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54004466d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:13.914022 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868070784}
W20260709 13:02:13.921591  8183 leader_election.cc:336] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.684s (SENT)
I20260709 13:02:13.923043  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:13.922518  8895 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:13.925199  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.879968  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.920336  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.929266  8212 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:13.930251  8895 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:13.930792  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:13.893069  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:13.931097  8183 leader_election.cc:336] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.886s (SENT)
I20260709 13:02:13.933147  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:13.933677  8183 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.933s (SENT)
I20260709 13:02:13.934173  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:13.934628  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.935263  8212 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:13.936611  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.937229  8212 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:13.932374  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:13.935273  8183 leader_election.cc:336] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.999s (SENT)
I20260709 13:02:13.939493  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.940158  8897 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:13.940840  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.942994  8212 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:13.941916  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.944762  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.945425  8215 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:13.938624  8895 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:13.938669  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.947481  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.948293  8895 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:13.949409  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:13.949560  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:13.950774  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.951784  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:13.952289  8895 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.954645  8216 raft_consensus.cc:2368] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
W20260709 13:02:13.955310  8183 leader_election.cc:336] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.004s (SENT)
I20260709 13:02:13.958477  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:13.959676  8183 leader_election.cc:336] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.015s (SENT)
I20260709 13:02:13.961275  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:13.962632  8183 leader_election.cc:336] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.080s (SENT)
W20260709 13:02:13.964426  8183 leader_election.cc:336] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.133s (SENT)
I20260709 13:02:13.965284  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:13.967983  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:13.968716  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.969530  8897 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:13.970444  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.955106 10348 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:14.012547  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.960453 10459 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.014943 10459 raft_consensus.cc:697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:13.966565 10693 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.015264  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.004908 10455 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:13.959015 10691 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.966094 10372 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:14.014367  8895 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:14.015966  8898 raft_consensus.cc:2368] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:14.017196  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.017119  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.017961  8895 raft_consensus.cc:2376] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5. Re-sending same reply.
I20260709 13:02:14.018953  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.005340  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.020503  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.020138  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.021775  8895 raft_consensus.cc:2376] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2. Re-sending same reply.
W20260709 13:02:14.022390 10695 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:02:14.021413  8889 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:13.928721 10623 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:14.022213  8258 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:13.971189  8897 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:14.037955  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.039319  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.040585  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.041272  8897 raft_consensus.cc:2368] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:14.025396  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:14.030846  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.915699 10639 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:14.042964  8898 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:13.971645 10471 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:02:14.019101 10647 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:14.046437  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.041991  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:13.963428 10447 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:14.045485  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.049744  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.054293  8898 raft_consensus.cc:2376] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3. Re-sending same reply.
I20260709 13:02:14.049115  8897 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:13.967247 10598 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:13.958108 10363 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.054453  8216 raft_consensus.cc:2410] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:14.055411  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:13.965837 10283 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.967031 10572 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:02:14.057441  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.056252  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.060696  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.036154 10623 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.062261  8897 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:14.065171  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.055200 10642 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:14.066140  8216 raft_consensus.cc:2410] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:14.066277  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.064190  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.074580  8897 raft_consensus.cc:2376] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5. Re-sending same reply.
I20260709 13:02:14.075655  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.046443  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.076213  8897 raft_consensus.cc:2376] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4. Re-sending same reply.
I20260709 13:02:14.073007  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:14.077479  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.077663  8366 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.068974  8184 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:14.079255  8184 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:14.078135  8897 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:14.067567  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 1970) took 2049 ms. Trace:
I20260709 13:02:14.081492  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.058108 10447 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:14.083889  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.083798  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.084699  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.048475 10372 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:14.086376  8898 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:14.015872 10459 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.064630 10623 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.082614 10693 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:14.058589 10639 consensus_queue.cc:1059] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:14.067931 10413 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:14.095937  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.099057  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.099674  8216 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:14.092131  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.096985  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.100644  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:14.102444  8366 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:14.102690  8332 leader_election.cc:400] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:14.103036  8332 leader_election.cc:403] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.082844  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.105261  8897 raft_consensus.cc:2410] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:14.083145 10647 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.110291  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.110862  8215 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.113464  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55928 (request call id 13) took 1809 ms. Trace:
I20260709 13:02:14.113834  8212 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:14.105850 10655 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.114660  8889 raft_consensus.cc:2376] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5. Re-sending same reply.
I20260709 13:02:14.115399  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.115712  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.116308  8889 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.116779  8211 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:14.116001  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.118489  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.119093  8216 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.115017  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.120699  8213 raft_consensus.cc:2368] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
W20260709 13:02:14.123584  8217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2068) took 2313 ms (client timeout 1811 ms). Trace:
I20260709 13:02:14.123905  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.124542  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 1979) took 1447 ms. Trace:
I20260709 13:02:14.124936  8365 rpcz_store.cc:276] 0709 13:02:12.677407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.916912 (+239505us) service_pool.cc:224] Handling call
0709 13:02:14.124360 (+1207448us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540043bf54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:14.124484 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313772928}
I20260709 13:02:14.113865  8363 rpcz_store.cc:276] 0709 13:02:12.308913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.309038 (+   125us) service_pool.cc:224] Handling call
0709 13:02:14.113276 (+1804238us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400152cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc247853 00007f2f0121560a 00007f2efa79b7d4 00007f2efa79b762 00007f2efa79b691 00007f2efa79b60c 00007f2efa79a8c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:14.113385 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502092672}
I20260709 13:02:14.124501  8211 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.123577  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.118523  8898 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:14.129463 10647 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.130039  8258 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:14.130282 10647 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:14.131016 10702 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:14.131296  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.132056  8898 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:14.133137 10679 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.133315  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.134742  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.135339  8898 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.132169  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.136958  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.137202  8862 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.137579  8212 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.106348  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.104213  8332 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:14.136602  8214 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:14.139032  8332 leader_election.cc:400] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:14.139776  8332 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:14.098205 10693 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.104532 10572 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4.
I20260709 13:02:14.107913 10447 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.135865  8210 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:14.136209  8217 rpcz_store.cc:269] 0709 13:02:11.809773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.833481 (+ 23708us) service_pool.cc:224] Handling call
0709 13:02:14.123401 (+2289920us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400079754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:14.123507 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543365888}
I20260709 13:02:14.130992  8893 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:14.141639  8365 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:14.142580  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.143330  8862 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:14.143982  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.157699  8367 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:14.144536  8332 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:14.131739 10702 raft_consensus.cc:697] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:14.145641  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48722.7us
W20260709 13:02:14.145977  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.093066 10348 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:14.091233 10642 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:14.146137  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:14.147106  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:14.146322  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.137115  8895 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:14.171700  8862 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.172160  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.172474  8366 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.173147  8895 raft_consensus.cc:2368] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3.
I20260709 13:02:14.174216  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.093309  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.149766 10656 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:14.177074  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.177783  8895 raft_consensus.cc:2376] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5. Re-sending same reply.
I20260709 13:02:14.178944  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.179736  8895 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:14.180616  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.104955 10413 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.190305  8862 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.152979  8864 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:14.159546  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.165184 10348 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.083796  8359 rpcz_store.cc:276] 0709 13:02:12.018050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.162818 (+144768us) service_pool.cc:224] Handling call
0709 13:02:14.067345 (+1904527us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000c6054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:14.067492 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3199421696}
I20260709 13:02:14.146039 10655 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.169574  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:14.177623 10658 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:02:14.201443  8183 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.147984 10556 raft_consensus.cc:2764] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:02:14.144928 10693 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.148300 10618 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:14.210286  8211 raft_consensus.cc:2410] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:14.147631  8215 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:14.175724  8363 raft_consensus.cc:2393] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:14.169191 10572 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:14.211830  8366 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:14.192909  8358 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:14.165210 10528 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.146307 10647 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:14.163830  8898 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:14.195729  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:14.182091 10507 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:14.196898 10555 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:14.168474 10650 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:14.202996  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.204632 10642 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:14.205840 10705 log.cc:927] Time spent T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:02:14.206341  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.202353  8183 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:14.271806  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 69513.3us
I20260709 13:02:14.209103  8862 leader_election.cc:400] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
I20260709 13:02:14.203042 10413 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:14.258920 10460 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:14.147493  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.200416 10348 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.194975 10656 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:14.207713 10679 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.262187 10639 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:14.262660 10528 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:14.263615  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 172042us
I20260709 13:02:14.262673  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.300225  8898 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:14.273402  8862 leader_election.cc:403] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.248968 10572 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:14.253749  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.320976  8893 raft_consensus.cc:2368] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3.
I20260709 13:02:14.263430 10507 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:14.282677  8897 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 2.
I20260709 13:02:14.322340 10507 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.322893  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.323768  8897 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:14.324548  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.266974 10556 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:14.325059  8897 raft_consensus.cc:2376] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3. Re-sending same reply.
I20260709 13:02:14.326423  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.322016  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.327167  8897 raft_consensus.cc:2376] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8. Re-sending same reply.
I20260709 13:02:14.327500  8893 raft_consensus.cc:2393] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:14.328008  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.289337  8216 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
W20260709 13:02:14.216015  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.266422 10650 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:14.328369  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.328806 10650 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.330128  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.331575  8893 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:14.330185  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.243788 10618 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.334033  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.335896  8897 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:14.301540  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.337819  8898 raft_consensus.cc:2376] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3. Re-sending same reply.
I20260709 13:02:14.338023  8893 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:14.338730  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.339560  8898 raft_consensus.cc:2410] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:02:14.319635  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 110656us
I20260709 13:02:14.340759  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.335794 10618 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.343405  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.345662  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.253559 10702 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.350459 10691 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.347509  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.353368  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 578) took 3642 ms. Trace:
I20260709 13:02:14.356047  8897 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:02:14.356621  8862 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.353825  8896 rpcz_store.cc:276] 0709 13:02:10.710605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.939061 (+1228456us) service_pool.cc:224] Handling call
0709 13:02:11.953623 (+ 14562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.953983 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.954010 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.010906 (+ 56896us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.350919 (+340013us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:12.401788 (+ 50869us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.531766 (+1129978us) spinlock_profiling.cc:243] Waited 64.4 ms on lock 0x7b1800381a60. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915d455 00007f2efc245060 00007f2efc257716 00007f2efc268287 00007f2efc268208
0709 13:02:13.587395 (+ 55629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.587468 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.063747 (+476279us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b1800381a60. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:14.353125 (+289378us) raft_consensus.cc:1685] finished
0709 13:02:14.353149 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.353300 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105164,"prepare.queue_time_us":46613,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":5797,"raft.queue_time_us":180499,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":20221,"spinlock_wait_cycles":359136512,"thread_start_us":327060,"threads_started":2,"wal-append.queue_time_us":323133}
I20260709 13:02:14.359494  8862 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.292107 10455 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:14.370602  8359 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:14.370733 10455 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:14.347982 10650 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.370221 10507 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.373852 10455 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:14.374366  8895 raft_consensus.cc:2393] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:14.374976 10528 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:14.376467 10572 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.378732 10507 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:14.298786 10639 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:14.377629 10650 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:14.380072 10639 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.390151 10639 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.392445 10639 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.393059 10639 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.393517 10639 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.394003 10656 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.395709 10639 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.396268 10639 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:14.292989 10460 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.401212 10460 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.406946  8896 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:14.412465  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.413298  8284 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:14.414654  8290 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:14.416493  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.418154  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.419538  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.421667  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.427548  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.428614  8285 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:14.429606  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.431382  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.432914  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.433465  8292 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:14.438304 10460 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:14.439007 10460 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:14.442457 10460 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:14.444273  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.445075  8285 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:14.448395  8896 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:14.361881 10556 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:14.451104  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 256516us
I20260709 13:02:14.452359  8292 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
W20260709 13:02:14.445911 10604 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:02:14.454253  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.410933 10655 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:14.446149 10647 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.458185  8896 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:14.461414  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.459131  8864 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:14.453054 10697 log.cc:927] Time spent T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:14.465900  8212 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:14.464087  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.382620 10709 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:14.464736  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.487706  8285 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:14.487599  8896 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:02:14.459712  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 264449us
I20260709 13:02:14.493714  8364 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:14.496341  8331 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:14.463058  8893 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:14.500026  8331 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:14.464998 10556 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.504819  8285 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:14.469743 10555 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:14.465390 10647 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.512486  8288 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:14.513780  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.514441  8286 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
W20260709 13:02:14.516599  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 216313us
I20260709 13:02:14.537192  8184 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:02:14.536383  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 176962us
I20260709 13:02:14.501101 10709 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:14.538878  8862 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.541234  8290 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:14.544548  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.499418 10604 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:14.506714  8889 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:14.560292  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.564446  8288 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
W20260709 13:02:14.567013  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.516139 10714 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:14.578369  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.539753 10716 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.583722  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46120.9us
I20260709 13:02:14.580922  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.580346  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.558269 10528 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:14.587028 10528 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:14.587405  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 100664us
I20260709 13:02:14.583149  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.588977  8288 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
W20260709 13:02:14.589758  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 52738.4us
I20260709 13:02:14.590849  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:14.573483 10413 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
I20260709 13:02:14.587345  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:14.586472  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 58848.8us
I20260709 13:02:14.592203  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.597245  8289 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:14.579030 10714 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.590049 10716 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:14.601245  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.602027  8212 raft_consensus.cc:2368] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5.
I20260709 13:02:14.604169  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.604915  8215 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:14.606822 10629 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:14.607877  8211 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:14.608028  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.608737  8214 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:14.609850  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.610008  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.610474  8213 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:14.601302 10716 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:14.613934 10716 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:14.615224  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.615901 10507 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:14.616763 10507 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.618009  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:14.620170  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.621057  8289 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:14.621760  8211 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:02:14.624698  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 124732us
I20260709 13:02:14.626104  8214 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:14.607268  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.587518 10528 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:14.607301 10629 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:14.584721 10718 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:14.647465  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.648996  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.560040 10709 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:14.582217 10623 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.595870 10713 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.618988 10714 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:14.647812 10700 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:02:14.677330  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 97839.8us
I20260709 13:02:14.679750  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.680567  8898 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.621603 10716 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:14.647481 10650 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.689543  8213 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:14.682377  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.690383  8289 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
W20260709 13:02:14.683099  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 77247.4us
I20260709 13:02:14.693127  8288 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:14.685837  8862 leader_election.cc:400] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:02:14.619079 10724 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:02:14.695755  8862 leader_election.cc:403] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:02:14.695183  8257 connection.cc:256] RPC call timeout handler was delayed by -1.1756533949999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 13:02:14.705621  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 118362us
I20260709 13:02:14.708956  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.697278  8365 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:14.700723  8289 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:14.702569  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.712042  8285 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:14.703401  8293 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:14.685372  8889 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:02:14.707383  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.714906  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.715822  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.716502  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.676857 10730 raft_consensus.cc:2764] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:14.691496 10731 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:14.627311 10555 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.735719  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.734040  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.676586 10604 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:02:14.689283 10348 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.737525  8293 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
W20260709 13:02:14.742950 10283 consensus_meta.cc:287] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.000s
I20260709 13:02:14.743619 10655 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:14.743853 10622 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:14.744467  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.748544 10740 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:14.730470 10460 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:14.750320 10460 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.750547 10735 raft_consensus.cc:3055] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:14.750933 10735 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:14.751842 10735 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.753082 10735 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:14.754719 10722 log.cc:927] Time spent T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:14.760509 10709 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:14.762588 10715 log.cc:927] Time spent T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:02:14.749723 10740 consensus_queue.cc:1059] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:14.764312  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.731707  8898 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:14.656607 10718 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:14.735162 10710 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:02:14.769572  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:14.769728  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 44861.9us
I20260709 13:02:14.773379  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.775686  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.777527  8257 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.704704 10629 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:14.750011 10693 consensus_meta.cc:287] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.507s	user 0.002s	sys 0.004s
I20260709 13:02:14.743384 10283 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.778939  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.783423  8257 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:14.784747  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.790189  8289 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:14.767558 10460 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.791780  8257 leader_election.cc:400] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5.
I20260709 13:02:14.792351  8287 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:14.792744  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 83435.2us
I20260709 13:02:14.809310  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:14.811287  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 125595us
I20260709 13:02:14.769753 10655 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:14.812129  8862 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.779012 10622 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:14.823747  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.829356  8285 raft_consensus.cc:2410] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:14.821096  8292 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:02:14.825943  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:14.828023  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.827908  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.831849  8183 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.798961 10702 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:14.833236  8289 raft_consensus.cc:2368] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:02:14.802132 10740 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.832190  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:14.840161  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.840850  8285 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:14.835604  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.825415 10731 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:14.819751 10738 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:02:14.809044 10679 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:14.843577  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.829880 10629 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:14.846251  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 216256us
I20260709 13:02:14.767539 10716 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.841722  8862 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:14.890622  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 48990.9us
I20260709 13:02:14.853886 10528 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.859061 10749 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.860351 10372 raft_consensus.cc:3055] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:14.893338  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:14.893600 10738 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.895473 10478 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:14.900226 10478 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:14.900609 10478 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.905515 10741 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:14.897464 10372 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:14.906514 10528 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.906924 10372 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.907739  8212 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:14.908176 10372 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.895640 10623 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.910313 10741 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:14.910908  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 575) took 4804 ms. Trace:
I20260709 13:02:14.911283  8891 rpcz_store.cc:276] 0709 13:02:10.106278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.823525 (+1717247us) service_pool.cc:224] Handling call
0709 13:02:12.064991 (+241466us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:12.065206 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.663230 (+1598024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.910686 (+1247456us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400675554. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:14.910851 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3655665792}
I20260709 13:02:14.918830  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.919551  8212 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:14.842592 10740 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:14.922704  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 90929.4us
I20260709 13:02:14.923619  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.924173  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.925194  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.926431  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.926347  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.927248  8898 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:14.927446  8896 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:14.858186 10604 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:14.823463 10459 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:02:14.929111 10459 consensus_queue.cc:1243] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:14.929344 10740 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:14.827072 10476 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:02:14.883356  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 51434.7us
I20260709 13:02:14.911206 10741 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.931447  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.929597 10459 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:14.932598 10459 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:14.933318 10459 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.934283 10655 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:14.934381 10459 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.935487  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:14.936088  8210 raft_consensus.cc:2376] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3. Re-sending same reply.
I20260709 13:02:14.937609  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:14.925834  8891 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:02:14.938774  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.926328  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.939806  8213 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:14.937943 10478 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:14.800760 10693 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.851980  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.859540  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.826776 10348 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:14.864225  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:14.949175  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.950035  8210 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:14.826898 10544 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:14.846005 10679 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:14.951303  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.894742  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.952035  8210 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:14.952224  8363 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:14.953143  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.953470  8210 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:14.896270  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.838961 10726 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:14.906527 10731 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:14.885684  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.947680  8290 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.957021  8361 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:14.940687  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.959529  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.960191  8891 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:14.961279  8891 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:02:14.939828  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:14.941051  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.941695  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.941906  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:14.942960  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.962371  8366 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:14.963131  8259 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.963734  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.945202  8212 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:14.951485 10679 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.966272 10639 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:14.966931 10639 raft_consensus.cc:697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:14.967700  8259 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:14.968050 10751 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:14.968860 10476 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.969341 10476 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:14.967787 10639 consensus_queue.cc:237] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:14.969772 10476 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.958340  8363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:55928
I20260709 13:02:14.945004  8862 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:14.963780  8891 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:14.854933 10691 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.860824 10718 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:14.972754  8363 raft_consensus.cc:606] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.963912 10300 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.980190  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.987401  8896 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:14.975026  8183 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:14.974391 10738 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:14.973989  8290 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:14.981846  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.982956 10735 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:14.983510  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:14.983604 10740 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.983798  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:14.995954  8898 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.985152  8213 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:02:14.989324  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 47485.2us
I20260709 13:02:14.895557 10753 consensus_queue.cc:1059] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:02:14.994516  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:14.946506 10372 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:14.997932 10679 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:14.946967 10604 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.019035  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:14.984838 10691 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.996265 10738 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:14.998992 10655 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:15.026559  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:15.027201  8331 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:14.945662 10744 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:02:15.021653  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 46736.4us
I20260709 13:02:14.995244 10544 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.037288  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:14.945887 10714 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.037160  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:15.043286  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.024382  8898 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:15.037417  8183 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.033489  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:15.021214 10716 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:15.047258  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:15.022351 10609 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:15.050244  8183 leader_election.cc:400] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3.
I20260709 13:02:15.051244  8183 leader_election.cc:403] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:15.052989  8183 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.056135  8363 raft_consensus.cc:1240] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:15.034610 10691 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.036998 10738 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.035282 10734 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:15.029994 10756 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:15.099891 10756 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:15.100354 10756 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.101794  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 732) took 1260 ms. Trace:
I20260709 13:02:15.102246  8895 rpcz_store.cc:276] 0709 13:02:13.840903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.180389 (+339486us) service_pool.cc:224] Handling call
0709 13:02:15.101604 (+921215us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54002a12d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:15.101731 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443751808}
W20260709 13:02:15.104099 10723 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:15.094589  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:15.045738 10656 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:15.036942 10655 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:15.097649  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:15.108103  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.110463  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:15.113243  8898 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:15.120929  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:15.121539  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:15.122200  8898 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:15.113621  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.021791 10719 consensus_queue.cc:1059] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:02:15.025225 10740 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.141264  8898 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:15.107401  8363 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:15.050375 10753 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:15.049273 10372 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:15.161401  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 128063us
I20260709 13:02:15.084095 10348 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:15.144776  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:15.148221  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:15.167776  8258 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.149117  8898 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:15.038581 10460 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:15.101816 10746 log.cc:927] Time spent T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:02:15.159116  8183 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.048040 10750 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:15.163607  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 51361.2us
I20260709 13:02:15.162389  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:15.084350 10749 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 2. Current term is 3.
I20260709 13:02:15.048096 10528 consensus_queue.cc:1059] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:02:15.051584 10718 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:02:15.174469  8896 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:15.175740  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:15.176630  8898 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:15.143752 10655 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.179989  8183 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:15.190177  8863 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.2:39859 timed out after 2.033s (SENT) [suppressed 51 similar messages]
I20260709 13:02:15.157986 10742 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:15.205663  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:15.212818  8332 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:15.213476  8289 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:15.162025 10692 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:15.162910 10656 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:15.087838 10609 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.178279 10363 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.169147 10702 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:15.178294 10750 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.279807  8361 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:02:15.280453  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 67753.8us
I20260709 13:02:15.182996 10753 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:15.283897  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:15.277611 10692 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.183317 10348 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:15.168992 10724 consensus_queue.cc:1059] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
W20260709 13:02:15.291143  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.292658  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:15.215098 10604 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:15.275759 10372 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:15.275067 10709 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.280308 10742 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:15.183209 10734 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
W20260709 13:02:15.311391  8894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 691) took 2966 ms (client timeout 2133 ms). Trace:
I20260709 13:02:15.293588 10478 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:15.294437 10753 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:15.312077  8897 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:15.293390 10447 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.314332  8894 rpcz_store.cc:269] 0709 13:02:12.345031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.912659 (+567628us) service_pool.cc:224] Handling call
0709 13:02:15.311182 (+2398523us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400678c54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:15.311319 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415204736}
I20260709 13:02:15.301041  8889 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:15.294086 10750 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.286548 10768 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.294992 10692 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.301249 10604 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:15.297199 10528 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:15.302188 10693 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.289219 10657 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:02:15.286463 10300 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:02:15.308739 10372 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:15.361020 10609 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:15.362288 10679 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.362183 10348 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.365123 10756 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.366858 10476 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.370378 10604 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.342696 10753 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.413913 10655 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.429044 10655 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:15.429643 10742 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:15.429123 10767 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:15.379853 10528 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:15.436388 10760 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:02:15.436913 10471 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:15.437456 10764 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:02:15.438242 10733 raft_consensus.cc:3055] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:15.438437 10755 log.cc:927] Time spent T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:02:15.459403 10476 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:15.437374 10471 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:15.460918 10471 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.434732 10528 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.438733 10733 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:15.467326 10733 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.468434 10733 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:15.474509 10629 consensus_meta.cc:287] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
W20260709 13:02:15.476226 10769 log.cc:927] Time spent T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:02:15.354996 10656 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.477278 10713 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:15.503620 10713 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:15.505125 10728 log.cc:927] Time spent T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.815s	user 0.002s	sys 0.000s
W20260709 13:02:15.507297 10721 log.cc:927] Time spent T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.649s	user 0.000s	sys 0.001s
I20260709 13:02:15.480284 10647 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.421998 10714 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:15.510703 10770 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:02:15.513288 10738 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.513841 10709 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:15.516535 10750 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.516568 10691 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.520066 10753 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.531910 10753 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:15.587015  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 407060us
I20260709 13:02:15.588963  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:15.593636  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 416045us
I20260709 13:02:15.598712  8284 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.603046  8286 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 7. Ops: [5.4-5.4]
I20260709 13:02:15.612391  8332 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:15.614959  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:15.619846  8332 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:15.625206  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:15.625896  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:15.626617  8365 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.628242  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:15.630421  8363 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:15.622120  8293 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
W20260709 13:02:15.640287  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.633988  8284 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:15.651479 10372 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.382041 10455 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:15.656379 10639 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:15.656425 10455 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:15.658814 10455 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.522396 10691 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.525218 10692 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.529246 10713 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.512115 10734 consensus_queue.cc:1243] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:15.519388 10750 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:15.678676  8365 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
W20260709 13:02:15.678201  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 83432.4us
W20260709 13:02:15.694016  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.694427  8258 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.354260 10447 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.694442 10777 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:15.698807  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 110001us
I20260709 13:02:15.701812  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:15.704613 10459 consensus_meta.cc:287] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.003s
I20260709 13:02:15.706861 10753 raft_consensus.cc:2764] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:02:15.707545 10756 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.708942 10460 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:15.709648 10738 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:15.710404 10783 raft_consensus.cc:2764] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:15.711057 10714 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:15.711270 10783 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.711884 10714 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.715368  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:15.716997  8890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 696) took 2040 ms (client timeout 1933 ms). Trace:
I20260709 13:02:15.720424 10713 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:15.687505 10655 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.687484 10455 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.724223  8363 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.721982 10655 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.733088 10571 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.689877 10556 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.709888 10447 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:15.739219  8892 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:15.733837 10571 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.740213  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 701) took 2043 ms. Trace:
I20260709 13:02:15.743666 10556 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.734149 10692 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.748220  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 735) took 1906 ms. Trace:
W20260709 13:02:15.748667  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.717746  8890 rpcz_store.cc:269] 0709 13:02:13.689833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.716190 (+ 26357us) service_pool.cc:224] Handling call
0709 13:02:15.714801 (+1998611us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:15.716715 (+  1914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6314880}
I20260709 13:02:15.750377 10714 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.750808  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:15.734150 10655 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:15.750020 10348 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.759187 10348 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.762550  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:15.759545  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 65659.9us
I20260709 13:02:15.740774  8892 rpcz_store.cc:276] 0709 13:02:13.696975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.715008 (+ 18033us) service_pool.cc:224] Handling call
0709 13:02:15.738340 (+2023332us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128eee 0000000000375939 00007f2f0119c1e0 00007f2f012650c4 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:15.738732 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.739801 (+  1069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.740111 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2872192}
I20260709 13:02:15.748701  8897 rpcz_store.cc:276] 0709 13:02:13.841795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.361550 (+519755us) service_pool.cc:224] Handling call
0709 13:02:15.311770 (+950220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.340839 (+ 29069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.747772 (+406933us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400678c50. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:15.748030 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184527104}
I20260709 13:02:15.764333 10571 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.750006 10447 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:15.770141  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 148280us
I20260709 13:02:15.772480 10618 raft_consensus.cc:3055] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:15.773028 10618 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:15.774406 10713 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:15.774948 10713 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.775373 10713 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.767169 10348 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:15.780577  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.780342 10556 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:15.803089  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.806891 10604 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.808429 10528 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.809264 10604 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.810580 10655 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.812265  8362 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:15.815364  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:15.813380  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:15.814311 10691 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:15.816969  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:15.798869  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:15.821841  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 53311.4us
I20260709 13:02:15.825103  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:15.825336  8258 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:15.825946 10776 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:02:15.829234 10655 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.817694 10556 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:15.825109 10528 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.834055  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:15.837750 10707 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 1.559s	user 0.001s	sys 0.011s
I20260709 13:02:15.829262 10460 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:15.841365  8366 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:15.848574 10460 raft_consensus.cc:697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:15.856174  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:15.856741 10460 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.858961 10740 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:15.860522  8363 raft_consensus.cc:2410] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:15.867102 10776 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:15.867309  8288 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.867686 10776 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.868115 10776 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.870543 10717 raft_consensus.cc:3055] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:15.870890  8285 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:15.871090 10717 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:15.872385 10717 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.873323  8292 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:15.877161  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:15.877610  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2158) took 1465 ms. Trace:
I20260709 13:02:15.877969  8287 rpcz_store.cc:276] 0709 13:02:14.411753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.413720 (+  1967us) service_pool.cc:224] Handling call
0709 13:02:14.414004 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.800290 (+386286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.877146 (+1076856us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b540009fe54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:15.877441 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869636992}
I20260709 13:02:15.879582  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 1990) took 1113 ms. Trace:
W20260709 13:02:15.881596  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 76458.9us
I20260709 13:02:15.880198  8367 rpcz_store.cc:276] 0709 13:02:14.765754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.766130 (+   376us) service_pool.cc:224] Handling call
0709 13:02:14.774734 (+  8604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.839879 (+ 65145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.839912 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.839950 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:14.839978 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.879140 (+1039162us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b54000c6f54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:15.879203 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.879396 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149308672}
I20260709 13:02:15.886111 10628 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:15.886649 10751 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.887374 10751 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:15.889814  8360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 469) took 1818 ms (client timeout 1623 ms). Trace:
W20260709 13:02:15.890412  8360 rpcz_store.cc:269] 0709 13:02:14.070827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.076150 (+  5323us) service_pool.cc:224] Handling call
0709 13:02:15.876836 (+1800686us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:15.889616 (+ 12780us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3455744}
I20260709 13:02:15.890478 10751 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.899092  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:15.901563  8215 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:15.897167  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:02:15.903157  8213 raft_consensus.cc:606] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:15.880394 10618 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:15.907289 10783 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:15.895574 10544 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:02:15.908304  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 120104us
I20260709 13:02:15.909204  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:15.899109  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.910531 10528 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:15.913216 10528 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:15.914666 10528 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.915339  8183 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.896883  8212 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:15.917039 10372 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.896086  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:15.912607 10749 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:15.876416 10717 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.912508  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:15.901893  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:15.912798  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:15.940477  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 86162.9us
W20260709 13:02:15.943885  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 116833us
I20260709 13:02:15.900008 10655 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:15.942260  8288 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:15.945492  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:15.946314  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 50462.4us
I20260709 13:02:15.946841  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:15.947718  8291 raft_consensus.cc:2410] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:15.947611  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:15.862936 10556 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:02:15.946381  8360 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:15.895246 10571 consensus_queue.cc:1059] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:02:15.951545  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:15.952112 10571 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:15.942684 10604 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.953518 10363 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:15.954852 10622 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:15.957156  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 1970) took 1193 ms. Trace:
I20260709 13:02:15.957613  8293 rpcz_store.cc:276] 0709 13:02:14.763858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.764048 (+   190us) service_pool.cc:224] Handling call
0709 13:02:15.956900 (+1192852us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54004457d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:15.957079 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911083776}
I20260709 13:02:15.959446  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:15.952507  8289 raft_consensus.cc:2410] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:15.957859  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:15.960443  8285 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:15.949980  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:15.961203 10642 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:15.961427  8212 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.962380 10609 consensus_queue.cc:1059] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:15.961898 10642 raft_consensus.cc:697] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:15.963922 10650 raft_consensus.cc:3055] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:15.964296 10650 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:15.962569  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:15.965664 10650 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.966943 10650 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:15.967587  8864 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:15.968565 10738 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:15.969058 10738 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.969385 10738 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.952507 10571 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:15.964258 10642 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.970955 10571 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:15.972630 10571 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.956403  8114 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.976035  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:15.978466  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:15.978789  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:15.979269  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:15.979283  8293 raft_consensus.cc:2368] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:02:15.982188  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 1955) took 1453 ms. Trace:
I20260709 13:02:15.982606  8286 rpcz_store.cc:276] 0709 13:02:14.528911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.561017 (+ 32106us) service_pool.cc:224] Handling call
0709 13:02:15.105476 (+544459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.603730 (+498254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.709824 (+106094us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54001d65d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:15.981947 (+272123us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54001d65d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:15.982136 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347635456}
I20260709 13:02:15.983886  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:15.983799  8289 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:15.989190  8212 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:15.980469  8285 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:15.982686 10777 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:16.071013  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 68615.2us
I20260709 13:02:16.085887  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 468) took 2015 ms. Trace:
I20260709 13:02:16.086289  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:16.446906  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 536160us
W20260709 13:02:16.100039  8284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60538 (request call id 2162) took 1683 ms (client timeout 1932 ms). Trace:
I20260709 13:02:16.190590  8896 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:16.096027  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:16.258493  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.191175  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.192865  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.274174  8897 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:16.449560  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 534589us
W20260709 13:02:16.448483  8284 rpcz_store.cc:269] 0709 13:02:14.416133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.416276 (+   143us) service_pool.cc:224] Handling call
0709 13:02:16.099794 (+1683518us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400045454. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:16.099967 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2717339904}
I20260709 13:02:16.073568  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:16.086387  8364 rpcz_store.cc:276] 0709 13:02:14.070554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.070687 (+   133us) service_pool.cc:224] Handling call
0709 13:02:14.250217 (+179530us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:14.250444 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.494290 (+243846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.085447 (+1591157us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540043c454. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:16.085717 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562715776}
I20260709 13:02:16.091663  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:16.486501  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.463673  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 377570us
W20260709 13:02:16.100734 10787 log.cc:927] Time spent T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:16.091807 10622 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:16.411664 10372 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:16.488114 10713 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.003s
I20260709 13:02:16.315303 10768 raft_consensus.cc:3055] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:16.065095 10776 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:16.100021 10748 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:16.504097  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 46215.7us
I20260709 13:02:16.089763 10555 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.190601  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:16.508872  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.504076  8359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 1984) took 2355 ms (client timeout 2805 ms). Trace:
I20260709 13:02:16.502584  8287 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:16.102236 10609 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:16.510605  8366 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:16.272419 10650 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.228s
I20260709 13:02:16.511401  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:16.099711 10738 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.503988 10389 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:16.521409 10363 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:16.501127 10642 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.512631 10748 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:16.553824 10544 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:16.554687 10544 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.558367 10618 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:16.559542  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:16.560101 10569 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.511761 10713 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.562323  8895 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:16.563077 10713 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.564283  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:16.564978  8284 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:16.565260 10572 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.565934  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:16.566370  8289 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:16.567044  8285 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:16.567804 10544 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:16.568207  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:16.520712  8359 rpcz_store.cc:269] 0709 13:02:14.148302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.202693 (+ 54391us) service_pool.cc:224] Handling call
0709 13:02:16.498684 (+2295991us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b54001cedd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:16.503876 (+  5192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219596544}
I20260709 13:02:16.568758  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:16.560736 10569 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.571233  8291 raft_consensus.cc:2376] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6. Re-sending same reply.
I20260709 13:02:16.572368 10642 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.573887 10569 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.574486  8893 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:16.574810 10363 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.574985 10642 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:16.566612  8286 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:16.580233  8288 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
W20260709 13:02:16.591290  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 526558us
I20260709 13:02:16.523963 10768 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:16.523103 10639 consensus_queue.cc:1059] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:16.529897 10455 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:16.583278 10363 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.565979 10572 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.510061 10622 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:16.529755 10609 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.595371  8897 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:02:16.602921  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 102003us
I20260709 13:02:16.539331  8892 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.588744 10738 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.565296 10650 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.569487  8890 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:16.583060 10389 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:16.597905 10639 consensus_queue.cc:1243] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:16.588865 10709 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:16.583745 10555 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.608979 10455 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.652154  8895 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:02:16.635229 10389 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.660477  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 596) took 2569 ms. Trace:
I20260709 13:02:16.661798 10389 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:16.660902  8218 rpcz_store.cc:276] 0709 13:02:14.074107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.074326 (+   219us) service_pool.cc:224] Handling call
0709 13:02:14.074927 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.075254 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.075281 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.075653 (+   372us) log.cc:844] Serialized 26 byte log entry
0709 13:02:15.663262 (+1587609us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b1800409ea0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1 00007f2efc208a0f
0709 13:02:15.787069 (+123807us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:15.841446 (+ 54377us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.876156 (+ 34710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.882435 (+  6279us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.622337 (+739902us) raft_consensus.cc:1685] finished
0709 13:02:16.628714 (+  6377us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.643001 (+ 14287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11602,"prepare.queue_time_us":156106,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":4516,"raft.queue_time_us":27821,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":25868,"spinlock_wait_cycles":10476928,"thread_start_us":172696,"threads_started":2,"wal-append.queue_time_us":1854942}
I20260709 13:02:16.663633  8212 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:16.664036 10572 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:16.665581  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:16.666301 10460 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:16.666915 10460 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:16.668555  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:16.669054 10460 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.669301  8211 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:16.670272  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:16.670940  8217 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:16.671728 10555 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:16.666297  8213 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:16.623894 10768 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.675959 10768 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.676400  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:16.677826 10799 log.cc:927] Time spent T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:16.677641 10572 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:16.679482 10794 log.cc:927] Time spent T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:16.680042 10471 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.674295  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:16.686786  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:16.685453  8184 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:16.687528  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:16.644902 10650 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.683254 10776 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.712421  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:16.684167 10727 consensus_queue.cc:1059] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:16.725696 10727 raft_consensus.cc:3055] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:16.726199 10727 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:16.726468  8215 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:16.723605  8288 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:16.674729 10655 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:16.711330 10604 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:16.735852  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:16.742421  8217 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:16.738185  8215 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:16.743803  8214 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:16.745476  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:16.753866  8183 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:16.739038 10604 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:16.788480  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 489) took 1087 ms. Trace:
W20260709 13:02:16.783612  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 230786us
I20260709 13:02:16.788928  8363 rpcz_store.cc:276] 0709 13:02:15.701109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.701363 (+   254us) service_pool.cc:224] Handling call
0709 13:02:16.788289 (+1086926us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54001f6154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:16.788424 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49622784}
W20260709 13:02:16.800779  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 295854us
I20260709 13:02:16.790040  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:16.784073 10655 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:16.801056  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:16.804152  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 58779.9us
I20260709 13:02:16.789379 10604 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:16.781641 10609 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.809530  8862 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:16.742900 10727 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.816361  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:16.803678 10622 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.817942  8360 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:16.823333  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:16.817775 10807 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:16.817850 10806 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:02:16.823868  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:16.831156  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:16.833019  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:16.835682  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:16.833850  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:16.822098 10555 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:16.859956  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:16.861487  8895 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.857038  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:16.863598  8362 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:16.828068 10740 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:16.815176 10556 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:02:16.873515  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 118767us
I20260709 13:02:16.858991 10455 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:16.876706  8897 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:16.861266 10555 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.873163  8218 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:16.862217 10807 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:16.881367  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:16.882513  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 178437us
I20260709 13:02:16.889091  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:16.890296  8215 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:16.881364  8364 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
W20260709 13:02:16.897727  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 66041.1us
I20260709 13:02:16.875532 10650 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.897128  8213 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:16.885025 10555 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.907932  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:16.915259 10812 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:16.915532 10807 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.888736 10740 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:16.898880 10817 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.910822  8863 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:16.907109  8890 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:02:16.924046  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:16.923722  8184 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:16.930853  8211 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:16.912878 10650 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:16.889897 10816 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:02:16.920979 10727 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:16.920586 10808 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:16.937352  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 56107.3us
I20260709 13:02:16.941431  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:16.941713  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:16.944082  8213 raft_consensus.cc:1240] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:16.944823 10815 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.945524 10815 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.946581  8898 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:16.947734  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:16.947929  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:16.948419 10821 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:16.948817  8211 raft_consensus.cc:2410] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:16.945015 10823 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.950505 10823 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.950883 10802 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.950641 10740 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.951510 10802 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.921952 10571 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:16.927198 10736 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 13:02:16.955020  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:16.943104  8862 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:16.962787  8862 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:16.963989 10803 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:16.964457 10803 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.964802 10803 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:16.935878 10639 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:16.943156 10808 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.947844 10815 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:16.948856 10821 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:16.958346 10733 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:16.985533  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 92433.9us
W20260709 13:02:16.956960 10809 log.cc:927] Time spent T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:02:16.986836  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 79895.8us
I20260709 13:02:16.989532  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:16.978868 10816 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:17.002640  8213 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:16.981434 10556 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:16.978055 10639 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:16.979378 10820 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.006232  8360 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:17.007349 10815 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.956485  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.011785  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:17.012408 10803 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.954196 10806 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:17.019920  8362 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:17.020378  8258 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:16.956413 10650 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.023322  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:16.984536 10808 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.001535 10622 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:17.062990  8257 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:17.070667  8895 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
W20260709 13:02:17.029898  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 67269.4us
I20260709 13:02:16.943364 10817 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.044647  8367 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:17.015179 10556 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.056425  8365 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:17.004276 10816 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.051795  8331 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:17.056907  8897 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:16.984491 10363 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:16.991488 10571 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.025354 10639 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.059052 10460 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:17.091403  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:17.043872 10822 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:02:17.059893  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:17.062193 10804 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.029390 10814 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.060873  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:17.071324 10738 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.050550 10733 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:17.107735  8362 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:17.062937  8889 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:17.094570  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:17.063316  8898 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:17.086701 10609 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.097637  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.031147 10820 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.067332  8893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:17.085160 10556 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:17.098958  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 84304.5us
W20260709 13:02:17.108465  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 56803us
I20260709 13:02:17.087378 10816 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.067179 10815 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:17.098269  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 121713us
I20260709 13:02:17.002995 10776 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:02:17.111500  8897 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:17.067706 10544 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:02:17.117710  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:17.093914 10460 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.106732 10803 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:17.134958  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:17.123606  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 192102us
I20260709 13:02:17.112093 10455 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.086877 10713 consensus_queue.cc:1059] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:02:17.112033 10811 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:02:17.123483 10618 consensus_meta.cc:287] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 13:02:17.084757 10806 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.117717 10471 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.108765 10727 consensus_queue.cc:1059] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:02:17.148526  8358 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:17.113469  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:17.066094 10821 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.135860 10460 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.098902 10768 consensus_queue.cc:1059] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:02:17.136502 10736 consensus_queue.cc:1243] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:17.136723  8893 raft_consensus.cc:606] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:17.113621 10802 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:17.403764 10655 consensus_meta.cc:287] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.592s	user 0.002s	sys 0.008s
I20260709 13:02:17.141649 10650 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:17.175258 10623 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.176257 10829 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:17.388114  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:17.289247 10598 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:17.215790 10389 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.215343  8890 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:17.233826  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 78119us
I20260709 13:02:17.312930 10748 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.238824 10744 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:17.145615 10814 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.513150  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:17.277848 10363 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.319226  8287 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:17.237615 10840 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:17.516474  8361 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:17.310969  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:17.309194 10847 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:17.158248 10803 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.288491  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.400017 10639 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.306768 10556 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.302803 10806 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:17.232774  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:17.158206 10828 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:17.306905 10820 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:17.312682 10571 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:17.532375  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.533008  8891 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:17.533936 10817 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.534622 10363 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:17.534971 10556 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:17.296520  8286 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:17.292346 10604 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.405433  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:17.290431 10717 consensus_meta.cc:287] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.346s	user 0.013s	sys 0.000s
I20260709 13:02:17.384040  8290 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:17.214530 10618 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.241259 10785 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.229624 10823 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.286859 10839 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 13:02:17.214711 10830 log.cc:927] Time spent T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:17.176828  8360 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:17.291352  8892 consensus_meta.cc:287] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.004s
I20260709 13:02:17.518548 10622 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.301090  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:17.318317  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:17.298254  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:17.307178  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.287146 10812 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.312000  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:17.286913 10826 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:17.309139  8897 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:17.620450 10814 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.647790 10839 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.647737 10812 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.238629 10835 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.648767 10839 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.649441 10835 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.650444 10812 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.650926 10839 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:17.214854 10832 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.191s
I20260709 13:02:17.651180 10622 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.651609  8360 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:17.651640 10835 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.653012  8213 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:02:17.211961 10831 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:17.289629 10816 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.438676  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.654713  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:17.216500 10815 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:17.655222 10816 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:17.467564  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 348676us
I20260709 13:02:17.647795  8285 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.469113 10849 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.656477 10849 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.658281 10785 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.658685 10849 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.655242  8218 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.660316 10785 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:17.471745 10851 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:17.661473 10851 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.662737  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:17.663470 10839 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:17.663753 10851 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.663848 10839 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.473737  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.664348 10839 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.647964 10826 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:17.475260  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:17.666244  8209 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.666155 10826 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.667342 10727 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.667675 10826 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.668694 10727 consensus_queue.cc:1059] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:17.669466 10727 raft_consensus.cc:3055] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:17.669402 10823 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:17.670311 10823 consensus_queue.cc:1243] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:17.670761 10823 raft_consensus.cc:3055] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:17.671054 10823 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:17.483361  8217 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:02:17.673023  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.673317  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.675161 10740 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.675689 10740 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.677716 10740 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:17.111693 10738 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.679469  8285 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
W20260709 13:02:17.484578  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.669983 10727 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:17.684836  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:17.492378 10856 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.686285 10571 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:17.685942 10856 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.686712 10571 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.687155 10571 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.688280 10856 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.688807  8218 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:17.675698  8863 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:17.493846  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 513179us
I20260709 13:02:17.690702  8209 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
W20260709 13:02:17.488596  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 344389us
I20260709 13:02:17.498310  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:17.489460  8183 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:17.498999 10623 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.465723  8893 raft_consensus.cc:614] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:17.681859 10738 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:17.708772 10738 consensus_queue.cc:1059] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:17.709229  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.709724 10811 raft_consensus.cc:3055] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:17.671782 10823 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.710673  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.214354 10842 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.269s
I20260709 13:02:17.711983  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.712716 10842 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:17.393564  8898 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:17.244108 10555 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.653597 10622 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.333590 10808 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.506580 10655 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:17.216676 10733 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.531368  8293 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:02:17.531240 10847 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.513397 10389 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:17.529103 10840 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:17.514662 10829 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.602792  8361 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:17.635305  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.636864  8212 raft_consensus.cc:2410] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:17.566617  8366 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:17.118129 10609 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.529556 10744 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.638119 10556 consensus_queue.cc:1059] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:02:17.645284  8288 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:17.646095  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:17.646833  8892 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:17.482224  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:17.492769  8896 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:02:17.494556 10807 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:17.691275  8862 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:17.691085  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:17.677718  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.703095  8863 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:17.705227 10832 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:17.705826 10814 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:17.706494 10785 consensus_queue.cc:1059] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.536327  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.707119 10777 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.710104 10811 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:17.566020 10460 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.702831 10650 consensus_queue.cc:1059] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:02:17.522507 10803 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.508090 10598 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:17.685225 10727 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.714244  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:17.943365 10850 raft_consensus.cc:3055] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:17.943720 10623 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.944296 10623 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:17.945037 10823 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:17.944840 10623 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:17.851418  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.716143  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.947301 10850 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:17.947744 10727 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.948098  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.941886  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.948854  8218 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:17.949013  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.950397  8209 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:17.952297 10857 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:17.953189 10857 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:17.954742 10857 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.955209 10744 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:17.955595  8891 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:17.920261  8890 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
W20260709 13:02:17.958472  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 267475us
I20260709 13:02:17.714181  8359 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:17.943157  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 453958us
W20260709 13:02:17.944790  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.964342 10861 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.964802 10803 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:17.965348  8889 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:17.964931 10861 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:17.969993  8216 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:17.715219 10555 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:17.712646  8893 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:17.970827 10738 raft_consensus.cc:3055] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:17.976397 10623 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.971607 10556 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:17.970943  8862 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:17.972679  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 281884us
I20260709 13:02:17.957602  8891 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:17.974380  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:17.974727  8895 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:17.974296  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.961233  8293 pending_rounds.cc:85] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting all ops after (but not including) 4
I20260709 13:02:17.984562 10604 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:17.985515  8217 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:17.986191  8898 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:02:17.742831  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:17.971539 10814 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.972539  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:17.715284  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:17.998672  8897 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:02:18.000093  8211 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.001802  8291 raft_consensus.cc:2368] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
W20260709 13:02:18.002367  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 297092us
I20260709 13:02:17.937611 10639 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:17.698482 10363 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:18.045944  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 75116.3us
I20260709 13:02:17.850126 10622 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.989952  8892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 756) took 1797 ms (client timeout 1919 ms). Trace:
W20260709 13:02:18.044782  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48450.8us
W20260709 13:02:18.035741  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 330803us
I20260709 13:02:18.000471  8293 pending_rounds.cc:107] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:02:18.046705  8367 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:17.968400 10777 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:18.046566 10776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.009s	sys 0.042s
I20260709 13:02:17.601264 10828 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.056182  8293 raft_consensus.cc:2889] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.007609 10655 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:18.031013 10816 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.075949  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:17.841420 10839 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.029358 10820 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.074820  8289 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.076999 10820 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.079325 10820 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.080571  8183 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:17.989029 10738 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:18.054836  8862 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:18.070003 10776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.009s	sys 0.042s
I20260709 13:02:18.083004 10851 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:18.083578 10851 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:18.084626 10851 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.086189 10839 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:18.066978  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 62463.2us
I20260709 13:02:18.089349  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:18.090835  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:18.091399  8212 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.082031 10738 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.086259 10639 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:18.095101 10639 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:18.095404 10738 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.096165 10639 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.092720  8289 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:18.056723 10814 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.110939 10814 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:18.115314  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.044112 10835 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:02:18.064677 10744 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:18.052978 10822 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:02:18.058813 10622 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:18.135721  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 81001.9us
I20260709 13:02:18.136289  8211 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:18.114459  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:17.951951 10598 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.126737  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:18.125751  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:18.137826  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 395338us
I20260709 13:02:18.141716  8366 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:18.141770  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 71958.4us
I20260709 13:02:18.145642  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:18.127250  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:18.151417  8212 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:18.151643  8257 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:18.154366  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:18.188627  8863 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:18.135576  8210 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:18.161257  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:18.121668 10389 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.126577 10744 raft_consensus.cc:697] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:18.115422 10859 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:18.055691  8892 rpcz_store.cc:269] 0709 13:02:16.189043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.190268 (+  1225us) service_pool.cc:224] Handling call
0709 13:02:17.986739 (+1796471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.196911 10839 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:18.147001 10814 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:02:18.049741 10854 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
W20260709 13:02:18.203445  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 89395us
I20260709 13:02:18.157373 10738 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.204814 10822 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:18.065245 10811 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.206463 10807 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:18.206931 10642 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:18.207301 10363 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.208629  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:18.193121 10598 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.209619 10609 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
W20260709 13:02:18.212152  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 57763.4us
I20260709 13:02:18.150669 10556 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:18.272675 10556 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.140339 10832 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.129455 10622 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.273259  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:18.122351 10571 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.161401 10847 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.121748 10869 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:02:18.223417 10857 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:18.274533  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.275159  8292 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:18.275230 10571 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.218001 10389 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:18.275959 10389 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:18.276377 10389 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.271891  8284 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.277561  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.273223 10556 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.278685  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.279000  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:18.218852  8359 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:18.129595 10816 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.279551  8288 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.280206  8284 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:18.281221 10816 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.120764 10655 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.276470  8286 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.231241 10460 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.276119  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:18.282611  8292 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.283286 10655 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.211174 10821 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:18.230876  8365 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:18.238663  8366 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:18.284874  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:18.285574  8366 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:18.211483 10829 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.245038  8285 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:18.286414  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:18.287473  8285 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:18.287539  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:18.205816 10835 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:18.268452  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 107331us
I20260709 13:02:18.265828 10642 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:18.290643 10642 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.291179  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:18.291927 10861 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.292061 10642 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:18.200934  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.271400  8863 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:18.263386 10839 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:18.228935 10623 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.269790 10823 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.159742 10604 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:18.269143  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.297809  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:18.270998 10822 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:18.325323  8292 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
W20260709 13:02:18.293733 10867 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:18.353734  8290 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
W20260709 13:02:18.325040  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 53738.4us
I20260709 13:02:18.332402  8288 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
W20260709 13:02:18.337508  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 69708.1us
W20260709 13:02:18.368881  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 316662us
I20260709 13:02:18.302664 10623 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.371285  8366 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:18.324890  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:18.352802 10835 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.328832 10609 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.410465  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:18.481333  8891 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.265306 10738 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.412518  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.361531 10604 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.224502 10840 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.294790 10814 consensus_queue.cc:1059] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:02:18.361331 10363 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:18.326335 10872 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.368896 10826 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.325850 10727 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:02:18.364140 10822 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:18.387339 10623 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:18.374192 10455 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.159s	user 0.007s	sys 0.006s
I20260709 13:02:18.263804 10859 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.376931 10847 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:18.409969 10861 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:18.491669 10604 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.378436  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:18.444964 10832 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.460096 10839 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.453851 10736 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:18.467567 10866 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260709 13:02:18.468608 10873 log.cc:927] Time spent T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:02:18.450438 10785 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:18.355080 10655 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:18.458570 10777 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.447154 10835 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.574761  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:18.454378  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 302943us
I20260709 13:02:18.492835 10363 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:18.683254  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 305025us
I20260709 13:02:18.292564 10556 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:18.674582  8209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.025s	sys 0.052s
I20260709 13:02:18.494692 10828 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:18.494241 10808 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.445968 10744 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:18.715850  8209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.025s	sys 0.052s
W20260709 13:02:18.593758 10455 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.008s	sys 0.007s
I20260709 13:02:18.687610  8114 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.688426  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 1981) took 1388 ms. Trace:
W20260709 13:02:18.711655  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.673730 10740 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:18.717784  8291 rpcz_store.cc:276] 0709 13:02:17.299826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.300821 (+   995us) service_pool.cc:224] Handling call
0709 13:02:18.688062 (+1387241us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400044054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:18.688311 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824899968}
W20260709 13:02:18.722362  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 424848us
W20260709 13:02:18.685782 10856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.004s	sys 0.014s
I20260709 13:02:18.689414 10854 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:18.686681 10650 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.574697 10826 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.728211  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:18.730644  8257 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:18.729957  8183 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:18.733551  8218 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:18.734529  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:18.736439  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.743059  8331 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:18.705053  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:18.682600 10847 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.753716  8257 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:18.758749  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 637) took 1050 ms. Trace:
W20260709 13:02:18.735872  8890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.026s	sys 0.027s
I20260709 13:02:18.756093  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.712837 10785 raft_consensus.cc:697] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:18.682356 10861 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:18.730427 10856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.004s	sys 0.014s
I20260709 13:02:18.759670  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.759723  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.693428 10736 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.739149 10828 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.759866  8895 rpcz_store.cc:276] 0709 13:02:17.707805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.043574 (+335769us) service_pool.cc:224] Handling call
0709 13:02:18.063508 (+ 19934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.063704 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:18.478132 (+414428us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.758266 (+280134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.758322 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:18.758372 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.758439 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.758565 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12371,"prepare.queue_time_us":426138,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":6062,"thread_start_us":681474,"threads_started":2}
I20260709 13:02:18.691270 10832 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.733071 10854 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.775279  8285 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:18.718927 10655 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:18.775349  8291 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:18.763541 10642 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.755713 10740 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.780134 10556 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:18.780411 10748 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:18.763711  8890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.026s	sys 0.027s
I20260709 13:02:18.757318 10555 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.743083 10372 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:18.755215 10807 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:18.783206  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 494) took 1782 ms. Trace:
W20260709 13:02:18.827069  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 384548us
W20260709 13:02:18.783772 10639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.004s	sys 0.023s
I20260709 13:02:18.797482  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 625) took 1316 ms. Trace:
I20260709 13:02:18.805298 10803 raft_consensus.cc:3055] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:18.797456  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.738400 10869 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:02:18.797767  8292 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:18.784225 10854 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.764726  8892 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.761807 10727 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:18.752884 10650 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:18.804821 10875 log.cc:927] Time spent T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:02:18.743362 10855 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:02:18.737473 10777 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:02:18.799475  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:18.738554 10820 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:02:18.825301  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 71713.8us
I20260709 13:02:18.808540 10569 raft_consensus.cc:3055] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:18.938009 10569 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:18.842125  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:18.842909 10847 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:18.845340 10389 consensus_meta.cc:287] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.000s
I20260709 13:02:18.829499 10807 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:18.913058 10821 consensus_meta.cc:287] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.000s
W20260709 13:02:18.851977 10598 consensus_meta.cc:287] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
I20260709 13:02:18.852432 10785 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.826984  8364 rpcz_store.cc:276] 0709 13:02:17.001199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.001316 (+   117us) service_pool.cc:224] Handling call
0709 13:02:17.006892 (+  5576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.528455 (+521563us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:17.528483 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.801133 (+272650us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.998716 (+197583us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:17.998756 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.998833 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.783014 (+784181us) raft_consensus.cc:1685] finished
0709 13:02:18.783030 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.783154 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90493,"raft.queue_time_us":171127,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":9731,"thread_start_us":504735,"threads_started":2,"wal-append.queue_time_us":374694}
I20260709 13:02:18.854512 10832 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.855168 10655 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.858566  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:18.827636 10555 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.809671 10828 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:18.864218 10861 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.756618 10822 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.866508  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 632) took 1216 ms. Trace:
I20260709 13:02:18.870231 10372 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:18.866525  8891 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:18.872387 10854 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:18.877700 10891 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:18.879479 10868 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.614s	user 0.004s	sys 0.000s
I20260709 13:02:18.881280  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1476) took 1477 ms. Trace:
I20260709 13:02:19.042359  8213 rpcz_store.cc:276] 0709 13:02:17.404143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.404242 (+    99us) service_pool.cc:224] Handling call
0709 13:02:17.426498 (+ 22256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.653409 (+226911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.881004 (+1227595us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400472cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:18.881216 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520372480}
I20260709 13:02:19.043783  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:18.882437  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 762) took 2012 ms. Trace:
I20260709 13:02:18.883586  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1573) took 2085 ms. Trace:
I20260709 13:02:18.886775  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 630) took 1252 ms. Trace:
I20260709 13:02:19.044946  8894 rpcz_store.cc:276] 0709 13:02:16.870611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.870752 (+   141us) service_pool.cc:224] Handling call
0709 13:02:17.689264 (+818512us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:17.689444 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.954434 (+264990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.954466 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:17.954504 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:17.954538 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.882106 (+927568us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54005d39d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:18.882162 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.882277 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613300352}
I20260709 13:02:19.045167  8890 rpcz_store.cc:276] 0709 13:02:17.634378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.958961 (+324583us) service_pool.cc:224] Handling call
0709 13:02:17.959554 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.959870 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:18.159995 (+200125us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.827761 (+667766us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.830695 (+  2934us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:18.886493 (+ 55798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.886587 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.886713 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":409066,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":35853,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":8539,"thread_start_us":764087,"threads_started":2,"wal-append.queue_time_us":667254}
I20260709 13:02:19.046602 10372 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.047166  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.047619  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:18.888124 10859 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.887981  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2001) took 1874 ms. Trace:
I20260709 13:02:18.890707  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:18.891929  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 1983) took 1576 ms. Trace:
I20260709 13:02:18.889074 10835 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.918638  8291 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.920905  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:19.049338  8363 rpcz_store.cc:276] 0709 13:02:16.798536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.798872 (+   336us) service_pool.cc:224] Handling call
0709 13:02:17.391467 (+592595us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128eee 0000000000375939 00007f2f0119c1e0 00007f2f012650c4 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:17.391632 (+   165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.140346 (+748714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.140378 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.140421 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:18.140459 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.883368 (+742909us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54001f7554. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:18.883410 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.883528 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726468864}
W20260709 13:02:18.904721 10639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.007s	sys 0.026s
I20260709 13:02:19.050835  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:18.937417 10826 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:18.939644  8285 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:19.051945  8363 raft_consensus.cc:2410] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:19.052323  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.052969  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.053366  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.053544  8363 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:18.840950  8214 rpcz_store.cc:276] 0709 13:02:17.470792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.470918 (+   126us) service_pool.cc:224] Handling call
0709 13:02:17.471278 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.471741 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:17.471769 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.472247 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.693949 (+221702us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:17.693992 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.694062 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.786788 (+1092726us) raft_consensus.cc:1685] finished
0709 13:02:18.786808 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.786938 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26,"raft.queue_time_us":858,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":201670,"threads_started":1,"wal-append.queue_time_us":705300}
I20260709 13:02:18.939131 10569 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.003618 10828 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.054662 10859 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:19.048884  8286 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:18.852077 10740 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.838471 10877 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:18.831561  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:18.904441 10803 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:18.990376  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 1985) took 1666 ms. Trace:
I20260709 13:02:18.988576  8895 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:18.992395 10833 raft_consensus.cc:3055] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:18.994720  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:18.996157 10838 raft_consensus.cc:3055] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:19.004678  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.007808  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 264961us
I20260709 13:02:18.957247 10738 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:19.011809  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:18.999563 10850 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.015144  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:18.918591 10727 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.018106 10891 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:19.018668  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:19.021710  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:19.023736  8210 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:19.024966  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:19.027016 10598 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.028805 10650 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:19.083225  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2113) took 1411 ms. Trace:
I20260709 13:02:19.085145  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.082650  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 623) took 1565 ms. Trace:
I20260709 13:02:19.080209  8892 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:19.077562  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2006) took 1601 ms. Trace:
I20260709 13:02:19.055933  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.053939  8285 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:19.031539  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:19.032682 10854 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.959908 10604 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.098845 10850 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:19.100672 10897 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.115835 10897 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.116571 10604 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:19.034530 10555 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:18.958894 10389 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.035429  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:19.116729 10363 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.100785 10826 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.036021  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:19.098505 10727 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.117859 10826 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.115253 10841 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:19.101257  8367 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 3: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:19.118949 10363 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.100538 10828 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:19.119696  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 626) took 1591 ms. Trace:
I20260709 13:02:19.117977  8364 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:19.100870  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 273279us
I20260709 13:02:18.849362 10623 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.013172  8896 rpcz_store.cc:276] 0709 13:02:17.650450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.985937 (+335487us) service_pool.cc:224] Handling call
0709 13:02:18.008147 (+ 22210us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:18.053813 (+ 45666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.053847 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:18.130790 (+ 76943us) log.cc:844] Serialized 52 byte log entry
0709 13:02:18.479763 (+348973us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:18.479814 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.479888 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.866279 (+386391us) raft_consensus.cc:1685] finished
0709 13:02:18.866297 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.866449 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38467,"raft.queue_time_us":51095,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5225,"thread_start_us":348278,"threads_started":1,"wal-append.queue_time_us":697624}
I20260709 13:02:19.101917  8293 rpcz_store.cc:276] 0709 13:02:17.324337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.324446 (+   109us) service_pool.cc:224] Handling call
0709 13:02:17.384765 (+ 60319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.116197 (+731432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.990033 (+873836us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400044f54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:18.990301 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332931328}
I20260709 13:02:18.958993 10807 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:19.028985 10847 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.100289  8217 rpcz_store.cc:276] 0709 13:02:17.672189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.951246 (+279057us) service_pool.cc:224] Handling call
0709 13:02:17.985344 (+ 34098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.049300 (+ 63956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.083042 (+1033742us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54000ed8d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:19.083156 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77768064}
I20260709 13:02:19.099260  8891 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:19.105965  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:19.123499  8292 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.112948  8211 raft_consensus.cc:2393] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:02:19.099635  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 87978.4us
I20260709 13:02:19.117622  8212 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
W20260709 13:02:19.103199  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.108577  8286 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:19.119688  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.101873  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.126675  8367 raft_consensus.cc:2410] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:19.126816  8361 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:02:19.106463  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.100404  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:19.123766  8891 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:19.047906  8894 raft_consensus.cc:2410] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:19.101850  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:18.958859 10544 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:19.120178  8362 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:19.102963  8898 rpcz_store.cc:276] 0709 13:02:17.516788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.944219 (+427431us) service_pool.cc:224] Handling call
0709 13:02:17.985861 (+ 41642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.049621 (+ 63760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.082418 (+1032797us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5400524ed0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:19.082580 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95056128}
I20260709 13:02:19.101768  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.121814  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:19.131992  8291 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:19.105382  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:19.129401  8891 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:19.049073  8289 rpcz_store.cc:276] 0709 13:02:17.315230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.317974 (+  2744us) service_pool.cc:224] Handling call
0709 13:02:18.891775 (+1573801us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54001d56d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:18.891874 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002999168}
I20260709 13:02:19.048511  8358 rpcz_store.cc:276] 0709 13:02:17.013653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.250756 (+237103us) service_pool.cc:224] Handling call
0709 13:02:17.289302 (+ 38546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.956512 (+667210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.956544 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:17.956589 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:17.956627 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.887717 (+931090us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54001ce8d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:18.887766 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.887920 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534502144}
W20260709 13:02:19.050673  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 129915us
I20260709 13:02:19.103564  8258 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:19.133201  8259 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:19.137825  8891 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:19.107227  8365 rpcz_store.cc:276] 0709 13:02:17.476093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.688577 (+212484us) service_pool.cc:224] Handling call
0709 13:02:17.688890 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.283989 (+595099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.077280 (+793291us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400067cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:19.077493 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246280960}
I20260709 13:02:19.140501  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 508) took 1021 ms. Trace:
I20260709 13:02:19.139946  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:19.131075 10544 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:19.098436 10598 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.100353 10833 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:19.142956 10544 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.143296 10833 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.144090 10598 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.099066 10891 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.144781  8896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:19.145337  8896 raft_consensus.cc:606] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:19.140512 10604 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.146870 10650 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.146760 10604 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.147390 10650 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.148769 10604 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.102638 10877 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:19.149519 10877 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:19.149887 10877 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.150761  8285 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:19.151793  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:19.120131 10828 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.154004 10892 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:19.154711 10892 raft_consensus.cc:697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:19.114090  8890 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:19.138515 10847 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.157006  8215 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:02:19.120837 10841 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:19.157485 10733 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.158059  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1481) took 1718 ms. Trace:
I20260709 13:02:19.157927 10733 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.158316  8364 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:19.098057 10736 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.158859  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 505) took 1040 ms. Trace:
I20260709 13:02:19.143923 10544 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.158931  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1066) took 2042 ms. Trace:
I20260709 13:02:19.160387 10733 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.139539 10455 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:19.161051  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:19.177323  8293 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:19.102058 10738 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:19.101316 10838 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:19.162365 10847 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:19.193763  8365 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:19.119656 10389 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.196599  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:19.164100 10623 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.164930  8209 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:19.167667  8364 rpcz_store.cc:276] 0709 13:02:18.118388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.014898 (+896510us) service_pool.cc:224] Handling call
0709 13:02:19.158802 (+143904us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:19.137059  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 224390us
I20260709 13:02:19.159166  8215 rpcz_store.cc:276] 0709 13:02:17.439631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.439794 (+   163us) service_pool.cc:224] Handling call
0709 13:02:17.721681 (+281887us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800002798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:17.721889 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.157360 (+1435471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.157867 (+   507us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003778d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:19.158010 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3329606272}
I20260709 13:02:19.173202  8292 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:19.173270  8897 rpcz_store.cc:276] 0709 13:02:17.116566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.648683 (+532117us) service_pool.cc:224] Handling call
0709 13:02:17.649017 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:18.043080 (+394063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.158676 (+1115596us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54003a34d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:19.158877 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803889024}
I20260709 13:02:19.141727  8361 rpcz_store.cc:276] 0709 13:02:18.119131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.101663 (+982532us) service_pool.cc:224] Handling call
0709 13:02:19.140433 (+ 38770us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.161202 10555 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:19.187666  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2008) took 1711 ms. Trace:
W20260709 13:02:19.189162  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 49309.6us
I20260709 13:02:19.204202  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.204772  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:19.189199  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 50129.3us
I20260709 13:02:19.120138  8889 rpcz_store.cc:276] 0709 13:02:17.528178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.953468 (+425290us) service_pool.cc:224] Handling call
0709 13:02:17.953917 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.965712 (+ 11795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.119469 (+1153757us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b540029d1d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:19.119636 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25339776}
I20260709 13:02:19.163185  8290 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:19.195465  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1580) took 1227 ms. Trace:
I20260709 13:02:19.154963 10833 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:19.212478  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.213248  8284 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:19.215147  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.215834  8292 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:19.207670  8366 rpcz_store.cc:276] 0709 13:02:17.476729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.139588 (+1662859us) service_pool.cc:224] Handling call
0709 13:02:19.187151 (+ 47563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.187338 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.187361 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.187407 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:19.187443 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.187494 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.187602 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:19.199460  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 99176.3us
I20260709 13:02:19.196938 10604 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:19.107133  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:19.197688  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.200371  8285 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:19.149634 10650 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:19.154207 10828 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.102541 10803 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.228318  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.206983  8365 rpcz_store.cc:276] 0709 13:02:17.968437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.168234 (+1199797us) service_pool.cc:224] Handling call
0709 13:02:19.193467 (+ 25233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.195216 (+  1749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.195404 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.229606  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.230348  8895 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:19.231633  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.232487  8364 raft_consensus.cc:2410] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:19.217939  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:19.223212  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:19.203439  8863 leader_election.cc:336] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Timed out: RequestConsensusVote RPC to 127.6.236.2:39859 timed out after 1.828s (SENT)
I20260709 13:02:19.196530 10455 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:19.233155  8293 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.194109 10859 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:19.238850  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.239025  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:19.262801  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2009) took 1143 ms. Trace:
I20260709 13:02:19.263278  8360 rpcz_store.cc:276] 0709 13:02:18.119383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.190614 (+1071231us) service_pool.cc:224] Handling call
0709 13:02:19.190935 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.238301 (+ 47366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.262316 (+ 24015us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.262403 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.262475 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.262556 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.262721 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31913,"raft.queue_time_us":48538}
I20260709 13:02:19.264564 10776 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:19.266382 10892 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.268327 10838 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.269311 10838 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.235262 10869 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:19.271689  8285 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
W20260709 13:02:19.276244  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 45600.3us
I20260709 13:02:19.276377  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.206766 10738 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:19.284138  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.236667  8892 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:19.435145  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 217358us
I20260709 13:02:19.436082  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.436672  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:19.420650  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.435395  8863 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Timed out: RequestConsensusVote RPC to 127.6.236.2:39859 timed out after 2.233s (SENT)
I20260709 13:02:19.364420  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2194) took 1093 ms. Trace:
I20260709 13:02:19.440937  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:19.441859  8284 raft_consensus.cc:2376] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6. Re-sending same reply.
I20260709 13:02:19.442813  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.443357  8293 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:19.440687  8287 rpcz_store.cc:276] 0709 13:02:18.270898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.271019 (+   121us) service_pool.cc:224] Handling call
0709 13:02:18.271313 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.694763 (+423450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.694795 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.694839 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:18.694875 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.364127 (+669252us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54004461d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:19.364182 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.364346 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973834496}
I20260709 13:02:19.450738  8293 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:19.299466 10886 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.174s
W20260709 13:02:19.407276 10909 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:02:19.280004 10828 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:19.434896 10872 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:19.460537  8115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35680 (request call id 397) took 13105 ms (client timeout 15000 ms). Trace:
I20260709 13:02:19.286652  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.441026 10897 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:19.486305  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.487385  8360 raft_consensus.cc:2393] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:19.487915  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48840.8us
I20260709 13:02:19.488543  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.489440  8360 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:19.490974  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:19.495647 10906 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:02:19.497542 10907 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:19.504539 10372 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:19.505195 10372 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.507407 10372 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:19.509232  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.509907  8287 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 2.
I20260709 13:02:19.447225 10604 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:02:19.515045 10604 raft_consensus.cc:3055] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:19.515408 10604 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:19.516212 10604 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.517675 10604 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:19.445855 10891 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:19.519286  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.520104 10891 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:19.522657 10569 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.382195 10807 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.524262  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 772) took 1264 ms. Trace:
I20260709 13:02:19.524641  8894 rpcz_store.cc:276] 0709 13:02:18.259470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.132070 (+872600us) service_pool.cc:224] Handling call
0709 13:02:19.171269 (+ 39199us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:19.189776 (+ 18507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.189804 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:19.214122 (+ 24318us) log.cc:844] Serialized 78 byte log entry
0709 13:02:19.414438 (+200316us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.414482 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.414559 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.524016 (+109457us) raft_consensus.cc:1685] finished
0709 13:02:19.524035 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.524189 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2792,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":151668,"threads_started":1,"wal-append.queue_time_us":253599}
I20260709 13:02:19.526273  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:19.526435  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:19.527033  8290 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:19.528349 10872 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:19.528781 10872 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.475790 10738 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.531004  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2013) took 1349 ms. Trace:
I20260709 13:02:19.531402  8362 rpcz_store.cc:276] 0709 13:02:18.181902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.489675 (+307773us) service_pool.cc:224] Handling call
0709 13:02:19.530797 (+1041122us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54003188d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:19.530944 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960783744}
I20260709 13:02:19.531965 10822 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.532469  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.533223  8362 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:19.474392 10744 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:19.534511 10744 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.271660 10841 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:19.536616  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.463886 10455 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.538889 10803 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.288094 10869 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:19.480070  8114 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 2 to 3, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.540710  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:19.526841  8894 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.533967  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.551515 10571 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:19.551864 10841 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.552380 10744 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:19.546094  8114 catalog_manager.cc:5697] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.554663 10869 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:19.560099  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.554625  8114 catalog_manager.cc:5697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 2, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.563426  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:19.566593  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:19.570786  8288 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:02:19.564787  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58924 (request call id 7) took 1386 ms. Trace:
I20260709 13:02:19.574859  8114 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.580694  8896 rpcz_store.cc:276] 0709 13:02:18.160887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.122093 (+961206us) service_pool.cc:224] Handling call
0709 13:02:19.463104 (+341011us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b5400520e20. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc1ca520 00007f2efc247652 00007f2f0121560a 00007f2efa79b7d4 00007f2efa79b762 00007f2efa79b691 00007f2efa79b60c 00007f2efa79a8c2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:19.547477 (+ 84373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179238784}
I20260709 13:02:19.583640  8332 leader_election.cc:400] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
I20260709 13:02:19.584333  8332 leader_election.cc:403] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:19.586020  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:19.584326  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.584573  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.587524  8364 raft_consensus.cc:2410] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:19.588379  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:19.546193 10897 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.589439  8362 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.551586 10826 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.591234  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:19.607872  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:19.612290  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:19.613423 10785 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.615275  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.615505  8183 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:19.616008  8897 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:19.570447 10828 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:19.589968  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.558558 10571 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:19.565217 10891 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.619644  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.620069  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.614869  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 767) took 1367 ms. Trace:
I20260709 13:02:19.628480  8290 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:19.629271  8293 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:19.583084 10372 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:19.616963  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:19.589090  8360 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.630239  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:19.630899  8897 raft_consensus.cc:2368] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7.
I20260709 13:02:19.631692  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.632719  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.627555  8894 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:19.634261  8894 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:02:19.578478  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 143192us
I20260709 13:02:19.608486 10847 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:19.607066 10389 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.638377  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.639978  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.618120 10736 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:19.622262 10850 consensus_meta.cc:287] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.001s
I20260709 13:02:19.622159 10598 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:19.588140 10820 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:19.644687  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.648914  8894 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:19.627287 10807 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:19.646406  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:19.626029 10826 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.628676  8898 rpcz_store.cc:276] 0709 13:02:18.247124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.131538 (+884414us) service_pool.cc:224] Handling call
0709 13:02:19.144303 (+ 12765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.151170 (+  6867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.151198 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.151651 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.201325 (+ 49674us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.234324 (+ 32999us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.234586 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.234708 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.455691 (+220983us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b1800288940. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:19.585311 (+129620us) raft_consensus.cc:1685] finished
0709 13:02:19.614660 (+ 29349us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.614810 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6454,"prepare.queue_time_us":32764,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":70,"raft.queue_time_us":7668,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":34116,"spinlock_wait_cycles":78387072,"thread_start_us":49237,"threads_started":1,"wal-append.queue_time_us":118414}
I20260709 13:02:19.619114 10835 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:19.649511  8897 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:19.572455 10877 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.650488  8367 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:02:19.652570  8290 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:19.661551  8367 pending_rounds.cc:85] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 4
I20260709 13:02:19.661836  8367 pending_rounds.cc:107] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:02:19.662101  8367 raft_consensus.cc:2889] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:19.663137  8894 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:19.639117 10857 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:19.664134  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:19.641193 10847 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.617843 10897 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.667960  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.647653 10389 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.644699 10555 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:02:19.671950  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.684742  8898 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:19.685215  8288 raft_consensus.cc:2393] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:19.675873  8362 raft_consensus.cc:2410] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:02:19.484229  8115 rpcz_store.cc:269] 0709 13:02:06.388543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.390899 (+  2356us) service_pool.cc:224] Handling call
0709 13:02:19.460296 (+13069397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:11.956765 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:12.201961 (+245196us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:12.201996 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:02:12.242539 (+ 40543us) tablet.cc:662] Decoding operations
0709 13:02:13.654982 (+1412443us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b5c0007690c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f0243f331 00007f2f0243f221 00007f2f02439f6c 00007f2effb95370 00007f2effc97e74 00007f2effc830a6 00007f2effc82d58 00007f2effc879f1 00007f2effc879a9 00007f2effc87939 00007f2effc87901
0709 13:02:13.658297 (+  3315us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:13.658361 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:13.658388 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:13.658873 (+   485us) tablet.cc:701] Row locks acquired
0709 13:02:13.658890 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:02:13.659031 (+   141us) write_op.cc:270] Start()
0709 13:02:13.659216 (+   185us) write_op.cc:276] Timestamp: P: 1783602133658987 usec, L: 0
0709 13:02:13.659235 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:13.687307 (+ 28072us) log.cc:844] Serialized 2431 byte log entry
0709 13:02:14.005958 (+318651us) op_driver.cc:464] REPLICATION: finished
0709 13:02:14.173990 (+168032us) write_op.cc:301] APPLY: starting
0709 13:02:14.181565 (+  7575us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:14.192657 (+ 11092us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:14.192680 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:14.262802 (+ 70122us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:14.263055 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:02:14.263099 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:14.318629 (+ 55530us) log.cc:844] Serialized 53 byte log entry
0709 13:02:14.349644 (+ 31015us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:14.349769 (+   125us) write_op.cc:454] Released schema lock
0709 13:02:14.349828 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:14.350290 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:14.350318 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57128,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":148856,"apply.run_cpu_time_us":3746,"apply.run_wall_time_us":186200,"num_ops":6,"prepare.queue_time_us":303012,"prepare.run_cpu_time_us":32412,"prepare.run_wall_time_us":1842524,"raft.queue_time_us":154671,"raft.run_cpu_time_us":14800,"raft.run_wall_time_us":51930,"replication_time_us":346565,"spinlock_wait_cycles":12881152,"thread_start_us":329427,"threads_started":4,"wal-append.queue_time_us":81755,"wal-append.run_cpu_time_us":13418,"wal-append.run_wall_time_us":1677466}]]}
I20260709 13:02:19.638888 10891 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.659966 10826 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.689251  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 510) took 1334 ms. Trace:
I20260709 13:02:19.659546 10835 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.628160 10828 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.643505 10744 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:02:19.666760  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.681463 10807 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:19.672541 10847 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.684540 10861 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.727020  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.649323 10736 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.730721  8898 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:19.694448 10829 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:19.695712 10826 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.697333 10835 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.699818 10811 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.672868 10857 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.748356 10650 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.755523 10650 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.757216  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2017) took 1260 ms. Trace:
I20260709 13:02:19.757336  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:19.758891 10913 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:02:19.757758  8361 rpcz_store.cc:276] 0709 13:02:18.496592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.218601 (+722009us) service_pool.cc:224] Handling call
0709 13:02:19.239613 (+ 21012us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:19.281765 (+ 42152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.281798 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:19.286693 (+  4895us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.621629 (+334936us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.621680 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.621746 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.756954 (+135208us) raft_consensus.cc:1685] finished
0709 13:02:19.756973 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.757146 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9278,"raft.queue_time_us":11672,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":12262,"thread_start_us":214855,"threads_started":1,"wal-append.queue_time_us":375627}
W20260709 13:02:19.760658 10908 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:02:19.762254 10911 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:02:19.764788 10905 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:19.757898 10650 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:19.779654  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1579) took 1811 ms. Trace:
I20260709 13:02:19.780133  8367 rpcz_store.cc:276] 0709 13:02:17.968197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.165057 (+1196860us) service_pool.cc:224] Handling call
0709 13:02:19.191961 (+ 26904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.662744 (+470783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.779348 (+116604us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54001531d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:19.779574 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054210432}
I20260709 13:02:19.784493  8896 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:19.785914 10460 raft_consensus.cc:3055] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:19.786388 10460 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:19.787281 10460 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.788502 10460 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:19.795173 10389 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.702751 10807 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:19.799532  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.800845  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.803618  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.805552 10850 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.806099 10850 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:19.682282 10571 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:19.807473 10571 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.808097 10850 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.809422  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.810990  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.811190 10891 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.813071  8365 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:19.814639  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:19.815150 10897 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.819308  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:19.824188  8184 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:19.825037 10838 consensus_meta.cc:287] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.000s
I20260709 13:02:19.825635  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:19.837146  8184 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:19.827311 10828 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.828847 10736 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:19.734540  8359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 495) took 2722 ms (client timeout 2031 ms). Trace:
W20260709 13:02:19.842970  8359 rpcz_store.cc:269] 0709 13:02:17.010315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.027541 (+ 17226us) service_pool.cc:224] Handling call
0709 13:02:17.310793 (+283252us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:19.723457 (+2412664us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400434254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:19.732137 (+  8680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436505216}
I20260709 13:02:19.844344  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:19.845221  8359 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:19.846692  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:19.846863 10736 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:19.758277 10904 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:02:20.261090 10833 consensus_meta.cc:287] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 1.033s	user 0.001s	sys 0.009s
W20260709 13:02:20.353302 10604 consensus_meta.cc:287] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.835s	user 0.006s	sys 0.006s
W20260709 13:02:19.987764  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 371021us
I20260709 13:02:20.526460  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:20.512015  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 675241us
I20260709 13:02:19.802547 10807 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:19.863801 10822 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:20.230098  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 489093us
I20260709 13:02:19.851651 10877 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:19.974272 10372 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:02:20.032526  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.511662  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:20.541029  8288 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:20.521241  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:20.542152  8889 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:20.517871  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:20.543963 10785 consensus_meta.cc:287] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.930s	user 0.008s	sys 0.000s
I20260709 13:02:20.527359  8898 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:20.549768  8292 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:20.512277  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:19.689754  8363 rpcz_store.cc:276] 0709 13:02:18.354897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.202772 (+847875us) service_pool.cc:224] Handling call
0709 13:02:19.227105 (+ 24333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.227327 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:19.557745 (+330418us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.688591 (+130846us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.688840 (+   249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.688887 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.688931 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.689070 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.689182 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16933,"prepare.queue_time_us":458803,"raft.queue_time_us":5646,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":11089,"spinlock_wait_cycles":15034240,"thread_start_us":395301,"threads_started":2}
W20260709 13:02:20.374794 10571 consensus_meta.cc:287] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.005s
W20260709 13:02:20.392767  8897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.009s	sys 0.008s
W20260709 13:02:20.551015  8897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.012s	sys 0.009s
I20260709 13:02:20.518894  8890 raft_consensus.cc:2410] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:20.032373 10841 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.032608  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 507) took 1913 ms. Trace:
I20260709 13:02:20.533454 10736 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.853914  8367 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:20.561360  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:20.566447  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:20.567206  8367 raft_consensus.cc:2410] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:20.568038  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:20.568555  8367 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:20.569275  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:20.570451  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.569756  8367 raft_consensus.cc:2376] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7. Re-sending same reply.
I20260709 13:02:20.571569  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:20.546371 10822 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.200788 10872 consensus_meta.cc:287] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.002s
I20260709 13:02:19.850035  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:20.237402 10898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.012s
I20260709 13:02:19.847080 10828 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.850144 10861 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:20.399643  8361 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.013s
W20260709 13:02:20.048202  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.582803 10898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.004s	sys 0.023s
W20260709 13:02:20.377090  8863 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.020s
W20260709 13:02:20.584851  8863 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.006s	sys 0.022s
W20260709 13:02:20.583809  8361 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.004s	sys 0.016s
I20260709 13:02:20.527033  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:20.510685  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 898853us
W20260709 13:02:20.585343  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 714598us
I20260709 13:02:20.586550  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:02:20.587244  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 60315.9us
W20260709 13:02:20.512776  8114 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.000s	sys 0.026s
I20260709 13:02:20.537550  8284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 641) took 1299 ms. Trace:
W20260709 13:02:20.587977  8114 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.001s	sys 0.026s
I20260709 13:02:20.588034  8284 rpcz_store.cc:276] 0709 13:02:19.238235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.442544 (+204309us) service_pool.cc:224] Handling call
0709 13:02:20.533698 (+1091154us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54002756d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:20.537485 (+  3787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445289856}
I20260709 13:02:20.538304  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:20.514053 10363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.013s	sys 0.003s
W20260709 13:02:20.274847  8892 consensus_meta.cc:287] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.000s
I20260709 13:02:20.538864  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:20.592702  8895 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
W20260709 13:02:20.370550 10820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.012s	sys 0.008s
I20260709 13:02:19.983157 10851 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.015611 10829 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.363631  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.615650 10926 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:20.616253 10926 consensus_queue.cc:1243] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:20.076570 10598 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:20.619004 10829 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.619788 10598 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:20.274151 10857 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:19.957707 10609 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.553476  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:20.592023 10847 consensus_meta.cc:287] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.854s	user 0.006s	sys 0.004s
W20260709 13:02:20.515793  8209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2124) took 1412 ms (client timeout 1708 ms). Trace:
I20260709 13:02:20.560581  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:20.560740  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:20.560866  8293 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:20.561467 10841 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.561805  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.642601  8285 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:20.595517 10820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.014s	sys 0.010s
I20260709 13:02:20.562201  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:20.643751  8363 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:20.562389  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.552394 10869 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:20.563980  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.564363  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.651307  8213 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:20.651422  8218 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:20.564550  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:19.987376  8360 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:20.572635  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:20.625628  8257 connection.cc:256] RPC call timeout handler was delayed by -1.2517938680000498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:02:20.654835  8367 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:20.654855  8864 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:20.572605  8862 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:20.573706  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:20.574625  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.576756  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:20.582652 10822 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.579388 10622 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.574231 10555 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.581794  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2208) took 1554 ms. Trace:
W20260709 13:02:20.571125 10835 consensus_meta.cc:287] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.775s	user 0.008s	sys 0.000s
I20260709 13:02:20.570246 10736 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:20.576785 10803 consensus_meta.cc:287] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.037s	user 0.010s	sys 0.000s
I20260709 13:02:20.583995  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:20.583750 10861 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.595898 10642 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:20.596112 10604 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:20.591403  8892 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:20.583563 10828 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:20.581507 10872 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:20.590340 10363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.013s	sys 0.003s
I20260709 13:02:20.602206 10898 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:20.609846 10460 consensus_meta.cc:287] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.001s
W20260709 13:02:20.610805 10826 consensus_meta.cc:287] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.000s
I20260709 13:02:20.613041 10925 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:20.613607 10833 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.615130 10811 consensus_meta.cc:287] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.861s	user 0.010s	sys 0.000s
I20260709 13:02:20.618520 10571 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:20.620144  8366 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:20.551136  8365 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
W20260709 13:02:20.515225  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.627485 10389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.031s	sys 0.017s
W20260709 13:02:20.629613 10738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.019s	sys 0.023s
W20260709 13:02:20.631136  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 102296us
I20260709 13:02:20.635792  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:20.635958  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:20.595350 10372 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.644686  8217 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
W20260709 13:02:20.640091  8209 rpcz_store.cc:269] 0709 13:02:19.103846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.105125 (+  1279us) service_pool.cc:224] Handling call
0709 13:02:20.515593 (+1410468us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b5400057dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:20.515714 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73108736}
I20260709 13:02:20.642838  8215 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:20.653893  8863 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:20.660036  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:20.661134  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:20.661953  8292 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:20.559229 10785 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.821780  8288 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:20.821723  8363 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:20.663434  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1589) took 1173 ms. Trace:
I20260709 13:02:20.653486 10869 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:20.668462 10841 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:20.655854 10839 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
I20260709 13:02:20.654316 10820 consensus_queue.cc:1243] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:20.672513  8286 rpcz_store.cc:276] 0709 13:02:19.027347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.136205 (+108858us) service_pool.cc:224] Handling call
0709 13:02:19.172600 (+ 36395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.288326 (+115726us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:19.520109 (+231783us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18003d3540. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915d455 00007f2effc453c7 00007f2efc2579a7 00007f2efc2670bf 00007f2efc267038
0709 13:02:19.623192 (+103083us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.546960 (+923768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.547012 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:20.547066 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.581545 (+ 34479us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400401354. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:20.581612 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.581737 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623367,"prepare.queue_time_us":464429,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":597842,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":42322,"spinlock_wait_cycles":257065984,"thread_start_us":429239,"threads_started":2,"wal-append.queue_time_us":1028297}
I20260709 13:02:20.675482 10555 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.643308 10609 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.652868 10847 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.721534 10803 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.798275  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 210687us
I20260709 13:02:20.677451 10835 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:20.768802  8331 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.554s (SENT) [suppressed 11 similar messages]
I20260709 13:02:20.676905 10622 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.723366 10945 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:20.755892  8892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 769) took 2497 ms (client timeout 2978 ms). Trace:
I20260709 13:02:20.758520 10826 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:20.792268 10460 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.764603 10857 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:20.830315  8293 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:20.816907  8359 raft_consensus.cc:2410] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:02:20.816933 10738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.020s	sys 0.024s
W20260709 13:02:20.817263 10389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.032s	sys 0.023s
I20260709 13:02:20.837632  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:20.839579  8363 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:20.912357  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.912914  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 514) took 1044 ms. Trace:
I20260709 13:02:20.800530 10943 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:20.816696 10569 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.849715  8290 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:20.819554 10829 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:20.860056  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:20.889947  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.923102  8286 raft_consensus.cc:2393] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:20.923537  8332 leader_election.cc:400] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7.
I20260709 13:02:20.923831  8332 leader_election.cc:403] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.924675  8332 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:20.827368  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 173631us
I20260709 13:02:20.925662  8863 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:20.890383  8214 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:20.802968 10833 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:20.928076  8364 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:20.928539  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 268710us
W20260709 13:02:20.929677  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 348549us
I20260709 13:02:20.897701  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.931146  8213 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:20.898325  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:20.932133  8218 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:02:20.900008  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.899076  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 44304.6us
I20260709 13:02:20.908576  8287 raft_consensus.cc:2393] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:20.826232  8360 rpcz_store.cc:276] 0709 13:02:19.485243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.561030 (+ 75787us) service_pool.cc:224] Handling call
0709 13:02:20.658120 (+1097090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.911738  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.913058  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.913612  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:20.936937  8217 raft_consensus.cc:2410] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:20.914321  8363 rpcz_store.cc:276] 0709 13:02:19.868297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.822549 (+954252us) service_pool.cc:224] Handling call
0709 13:02:20.839236 (+ 16687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.912685 (+ 73449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.912863 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.828925 10925 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.921617  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 518) took 1045 ms. Trace:
I20260709 13:02:20.940815  8366 rpcz_store.cc:276] 0709 13:02:19.869240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.517611 (+648371us) service_pool.cc:224] Handling call
0709 13:02:20.914755 (+397144us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b54003179d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:20.914860 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175796608}
I20260709 13:02:20.922315  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:20.943749  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.906002 10857 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.948592  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.907538 10851 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.853639 10803 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.950829  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.901397 10960 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:20.978045 10960 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:20.978698  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 210028us
I20260709 13:02:20.981052 10960 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:20.955124  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:20.956096  8218 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:20.954424  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:20.889397  8892 rpcz_store.cc:269] 0709 13:02:18.258506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.106907 (+848401us) service_pool.cc:224] Handling call
0709 13:02:20.730459 (+1623552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.983799  8862 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:20.982527  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1590) took 1465 ms. Trace:
I20260709 13:02:20.983603 10960 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.984741 10960 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:20.986131  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.986882 10960 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:20.986817  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.986949  8361 rpcz_store.cc:276] 0709 13:02:19.516867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.759568 (+242701us) service_pool.cc:224] Handling call
0709 13:02:19.759837 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.760013 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:20.585532 (+825519us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.982180 (+396648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.982238 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:20.982285 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.982348 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.982466 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85661,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":162857,"thread_start_us":1221425,"threads_started":3,"wal-append.queue_time_us":312092}
I20260709 13:02:20.988698  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:20.990742  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:20.991401  8892 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:20.993527  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:20.994379  8890 raft_consensus.cc:2410] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:20.994859  8891 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:20.995491  8898 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:02:20.975396  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.996483  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:20.999519  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:21.000211  8891 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:21.000682  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.001802  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:20.944841 10898 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:21.003631  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:20.558491  8358 rpcz_store.cc:276] 0709 13:02:18.118902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.174941 (+1056039us) service_pool.cc:224] Handling call
0709 13:02:19.175554 (+   613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.234175 (+ 58621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.239527 (+  5352us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.271169 (+ 31642us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.640467 (+369298us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.645918 (+  5451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.678286 (+ 32368us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.793030 (+114744us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b480012c258. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f01176aa1 00007f2f0116db37 00007f2f0116d9ca 00007f2f0126526f 00007f2f01264f37 00007f2f0127955c 00007f2f01279508 00007f2f01279488 00007f2f01279443 00007f2f012786ec 00007f2f001a2a96
0709 13:02:19.913361 (+120331us) raft_consensus.cc:1685] finished
0709 13:02:19.913389 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.030914 (+117525us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43498,"raft.queue_time_us":58752,"raft.run_cpu_time_us":3445,"raft.run_wall_time_us":552675,"spinlock_wait_cycles":12275328,"thread_start_us":323402,"threads_started":1,"wal-append.queue_time_us":464753}
I20260709 13:02:20.909772 10460 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:20.959750 10857 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:20.927795  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 516) took 1053 ms. Trace:
I20260709 13:02:21.008978  8891 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:20.945650 10604 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:21.009402  8217 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:21.015620  8217 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:21.004632  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:20.946518 10811 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:21.013665  8216 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:21.001134 10933 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 13:02:21.016297  8217 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:20.997874 10945 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:21.023253  8217 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:21.024020  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 98447.3us
I20260709 13:02:20.940913 10569 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.026855  8863 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:21.045099  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.091753  8209 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:21.008775 10898 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:21.037763  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:21.104408  8217 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:02:21.118507  8217 pending_rounds.cc:85] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 7
I20260709 13:02:21.118772  8217 pending_rounds.cc:107] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:02:21.118992  8217 raft_consensus.cc:2889] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.104171  8259 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.007526 10946 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:21.124221  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 88101.1us
I20260709 13:02:21.125304  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.126729  8259 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:21.037035 10952 log.cc:927] Time spent T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:02:21.037027 10953 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:02:21.018970 10951 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.021682 10811 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:21.038002 10941 log.cc:927] Time spent T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 13:02:21.137701  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 213187us
I20260709 13:02:21.045923 10959 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.042714 10872 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.043563 10785 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.142784  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.018268  8359 rpcz_store.cc:276] 0709 13:02:19.868755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.583712 (+714957us) service_pool.cc:224] Handling call
0709 13:02:20.921884 (+338172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.972669 10851 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:21.145016  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 490535us
I20260709 13:02:21.044200 10944 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.043542 10571 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:21.024583 10962 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7.
I20260709 13:02:21.181372  8864 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:21.149537 10933 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:02:21.135699 10934 log.cc:927] Time spent T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:02:21.140136 10938 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.454s	user 0.000s	sys 0.001s
I20260709 13:02:21.102178  8893 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:21.095794  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:21.163362  8332 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:21.149101  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.202904  8213 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:21.185005  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:21.146818 10950 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.147131  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:21.148535 10955 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:21.145931 10811 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:21.206400 10943 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:21.195290  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 51124.2us
W20260709 13:02:21.153373 10927 log.cc:927] Time spent T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:02:21.198887  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:21.213907  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.219210  8366 raft_consensus.cc:2410] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:02:21.197999  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 171308us
I20260709 13:02:21.203805  8367 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:21.220635  8863 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.220897  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:21.221489  8367 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 2.
I20260709 13:02:21.202831  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.206996  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.223459  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:21.149396 10844 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:21.204367 10555 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.195904 10847 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.221916  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.252987  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.254184  8216 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:21.158591 10960 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:02:21.217052 10937 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.217203 10835 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.192138 10571 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.248052  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.201792 10872 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:21.161420 10598 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.212605 10943 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.294611 10943 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.250669 10962 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.295159 10962 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:21.295555 10962 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.198491 10964 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.252832  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:21.299814  8359 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:21.180958 10604 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.249887 10972 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.218035 10811 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.217811 10931 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.313596 10931 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.218047 10959 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:21.269104  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.162159 10785 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.247747  8863 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:21.324276  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 78262.4us
I20260709 13:02:21.294328 10925 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.145823 10951 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.300863 10833 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:21.222502 10609 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.291107 10928 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:21.291683 10954 log.cc:927] Time spent T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 13:02:21.292006 10829 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:21.292548 10983 log.cc:927] Time spent T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:21.293174 10978 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.226028 10955 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.305989  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:21.268301  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 54493.5us
I20260709 13:02:21.308341  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.351833  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.312163 10994 raft_consensus.cc:993] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: : Instructing follower ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:02:21.291005 10803 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.217828  8358 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.325006  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.284876  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.328497  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1067) took 2164 ms. Trace:
I20260709 13:02:21.202484 10945 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.353134 10851 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.262624 10844 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.330224 10951 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.315094 10972 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.332423 10962 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:21.330755 10861 consensus_meta.cc:287] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:02:21.332962 10857 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.221392 10950 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.310604 10826 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:21.347440  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 166234us
I20260709 13:02:21.319656 10872 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.347988 10829 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:21.374717 10857 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.305943 10598 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.375187  8862 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:21.375636 10957 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.376044  8862 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:21.376227 10950 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.352766  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.303134 10937 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.356763  8183 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.319360 10959 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:21.376350 10957 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.385818 10957 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:21.386287 10807 consensus_meta.cc:287] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.847s	user 0.005s	sys 0.005s
I20260709 13:02:21.386554 10957 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.386965 10957 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.387297 10957 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.368693 10861 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.389179 10861 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:21.394054 10748 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:02:21.394752 10962 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.306252 10963 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.364192  8897 rpcz_store.cc:276] 0709 13:02:19.164566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.661276 (+496710us) service_pool.cc:224] Handling call
0709 13:02:19.673143 (+ 11867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.690458 (+ 17315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.690490 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.697903 (+  7413us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.558797 (+860894us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:20.558872 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.559008 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.328288 (+769280us) raft_consensus.cc:1685] finished
0709 13:02:21.328307 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.328432 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":800087,"threads_started":1,"wal-append.queue_time_us":890191}
I20260709 13:02:21.341679 10928 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:21.324405 10976 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.396221 10928 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:21.370975  8863 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:21.373072 10978 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:21.374253 10571 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.374410 10872 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.374666 10829 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.370098  8864 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.396843 10959 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.396781 10978 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:21.398728 10857 raft_consensus.cc:1081] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Signalling peer ca43983edda443fa9d74c1f80252f1fc to start an election
I20260709 13:02:21.399708 10857 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:21.400099 10857 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.400457 10857 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.401713  8864 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.376639 10972 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.312098 10981 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:02:21.402920 10972 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.403472 10872 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.374989 10958 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.403955  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.404778 10958 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.405031  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.405614  8211 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:21.358536 10955 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:21.360102 10785 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:21.406340 10958 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.396426 10937 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.403594 10598 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.382586 10931 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:21.394883 10736 consensus_meta.cc:287] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.000s
I20260709 13:02:21.410799 10736 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.411577 10555 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:21.395244  8893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 641) took 3233 ms (client timeout 1766 ms). Trace:
I20260709 13:02:21.411836 10928 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:21.412055  8893 rpcz_store.cc:269] 0709 13:02:18.161410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.208291 (+ 46881us) service_pool.cc:224] Handling call
0709 13:02:21.395034 (+3186743us) spinlock_profiling.cc:243] Waited 2.78 s on lock 0x7b5400718c54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:21.395147 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6388547456}
I20260709 13:02:21.348378 10609 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:21.398762 10978 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.412858 10736 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.413275 10555 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:21.402658  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 46020.3us
I20260709 13:02:21.414439 10555 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.414732  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.416847  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:21.363757  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 78999.1us
I20260709 13:02:21.415095  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.415318 10609 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:21.417851  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.412477 11003 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:21.379257  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.418298  8365 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:21.425827  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.418221 10598 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:02:21.424669 10736 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.426494  8183 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:21.418926  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:21.427767  8257 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.428865 10990 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:21.429461 10748 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.429857 10748 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.430205 10748 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.425030 10937 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.431455 10990 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:21.431802 10990 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:21.430859 10937 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.432255 10898 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.432224 10937 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.432593 10990 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.429324 10609 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.433270 10898 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.438486  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.440004 10571 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.440495 10571 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:21.441517 10939 log.cc:927] Time spent T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.749s	user 0.000s	sys 0.003s
I20260709 13:02:21.451957 10598 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:21.452716  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 318573us
I20260709 13:02:21.454245 10946 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:21.455219 10946 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.461771  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.462658  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.463434  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.463706  8217 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:21.465904  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:21.466284  8332 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:21.467106  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.469318  8332 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:21.473071 10928 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.475914  8358 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:21.477041  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.477674 10851 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:21.442819 10978 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.478255  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2018) took 2973 ms. Trace:
I20260709 13:02:21.477773  8211 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:21.464880  8214 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:21.478705  8362 rpcz_store.cc:276] 0709 13:02:18.505006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.691308 (+1186302us) service_pool.cc:224] Handling call
0709 13:02:19.727896 (+ 36588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.728319 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.728350 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.737625 (+  9275us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.288539 (+550914us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:20.288584 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.288660 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.440943 (+1152283us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:21.464426 (+ 23483us) raft_consensus.cc:1685] finished
0709 13:02:21.464446 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.478192 (+ 13746us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":13314,"spinlock_wait_cycles":64485632,"thread_start_us":485259,"threads_started":1,"wal-append.queue_time_us":888093}
I20260709 13:02:21.484627  8332 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:21.486505 10811 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.386703 10807 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.487110 10861 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.487565 10861 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.487936 10861 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.488689 10807 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.489270 10947 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:21.450845 10839 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:21.468178 10955 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:21.490674  8212 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 3: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:21.500118  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:21.486613  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.497059  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.501782  8898 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.501725  8211 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:21.497370  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.503353  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.497402  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.502801  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.504222  8292 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.498226  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.504822  8289 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.505903  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:21.506196 10833 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:21.506448 10980 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:02:21.473853 10748 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.507555  8285 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:21.508559  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.509601  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.509932 10811 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:21.510718 10965 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.511135 10965 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.511641  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.511531 10861 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.513157 10958 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.504527  8214 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:21.514621  8288 raft_consensus.cc:1240] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:21.513952  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.515872  8286 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:21.516794  8293 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:21.511135  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.518234  8291 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:21.519091  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.519506  8290 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:21.515575  8284 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:21.520673  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:21.521394  8897 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:21.467607 10972 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.524911  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.525102  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:21.525694  8288 raft_consensus.cc:2410] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:21.525925  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.525861  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.526993  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.481743 10838 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.481480 10604 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.491973 10962 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:21.464955 10736 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:02:21.547832  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.548542  8285 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:21.528714  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.511469 10965 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.530257  8898 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:21.399240 10943 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.527529  8894 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:21.532987  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.499205 10839 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.527482  8290 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.529345 10986 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:21.539240  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:21.539592  8214 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:21.505920 10571 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.540099  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:21.541831 10748 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.468592 10951 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:02:21.541836  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.533797 10962 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:21.544015  8215 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:21.544574 10990 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.558184  8288 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:21.589138  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.591125  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.478873  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 67132.7us
I20260709 13:02:21.563587  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.566395  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.599140  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.566793 10937 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.567560 10943 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:21.567677 10839 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.606490  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.606885 10829 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.492152 10976 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:02:21.489909 10785 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:02:21.569152  8292 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:21.531916 10861 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.477758 10959 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.572137  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.503849 10826 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:02:21.573856  8889 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:21.531371 10838 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:21.579422  8289 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:21.539788 11004 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:02:21.581600 10978 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.575223  8286 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:21.583256  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.566955  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:21.630102  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46928.2us
I20260709 13:02:21.630115  8291 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:21.617321 10946 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.601555  8183 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:21.622759 10943 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.644896 10957 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.646086  8893 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:21.626941 10838 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:21.650058 11011 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:21.652168  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 513) took 1784 ms. Trace:
I20260709 13:02:21.652557  8365 rpcz_store.cc:276] 0709 13:02:19.868042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.800349 (+932307us) service_pool.cc:224] Handling call
0709 13:02:20.828103 (+ 27754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.425822 (+597719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.651901 (+226079us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54000ad2d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:21.652101 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357527936}
I20260709 13:02:21.625808 10931 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:21.656996  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1586) took 2222 ms. Trace:
I20260709 13:02:21.657333  8364 rpcz_store.cc:276] 0709 13:02:19.439629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.619387 (+179758us) service_pool.cc:224] Handling call
0709 13:02:21.656800 (+2037413us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540043bf54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:21.656943 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2990258432}
I20260709 13:02:21.659200  8363 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:21.664585  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 63107.4us
W20260709 13:02:21.602088  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.592959  8862 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:21.604276  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.605916  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:21.666676  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 73847.5us
I20260709 13:02:21.607522  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.574604 10950 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:02:21.613802 11001 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:02:21.605852  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.681703  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:21.616405 10937 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.581970 10857 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.592504 10962 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.686594  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.687649  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.687776  8184 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.685668  8890 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.692580 10857 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.693414  8897 raft_consensus.cc:2368] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:02:21.678722 10931 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:21.694031 10931 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.694386 10931 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.695016 10829 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.679082 10609 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:21.600577  8290 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:21.631570  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:21.638852  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.666838  8211 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:21.606228  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.629227 11004 consensus_queue.cc:1243] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:21.637408 10861 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.682313  8257 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:21.700600  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 69128.5us
W20260709 13:02:21.683740  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 58660.3us
I20260709 13:02:21.633289  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.686178  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.701463  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:21.696005  8895 raft_consensus.cc:2410] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:21.698814  8184 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:21.699466  8284 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:21.700562  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.684820  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.701822  8863 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.684118 10951 consensus_queue.cc:1059] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:02:21.657498 10838 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.697690 10372 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.714145 10986 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.715914 10986 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.716341 10986 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.707087 10976 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.718544  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.718866 10807 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.719305 11002 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:21.699858 10609 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.699563 10937 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.695223 10959 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.718410  8183 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:21.719480  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:21.719575 10807 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.722139 10807 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:21.722528 10807 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.722925 11002 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:21.723291 11002 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:21.723397 10622 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.723685 11002 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.715240 10844 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:21.640565 10946 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.736632 10946 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.736372  8890 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:21.739804 10748 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:21.740233 10748 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:21.740927 10748 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.725345 10965 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.721150 10609 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.710652 10957 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.726585  8214 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:21.727116 10861 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:21.743554 10861 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:21.744024 10861 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.743239  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.728144  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:21.746955 10959 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:21.703948  8863 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.747406 10959 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:21.748746  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.749119 10944 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.748881 10959 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.728754 10951 raft_consensus.cc:3055] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:21.750211 10951 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:21.750939 10951 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.702030  8257 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:21.728782 10828 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:21.729458 10822 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.752504 10946 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.730842  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.723534 10838 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.752465 10828 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:21.753268  8209 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:21.753305 10828 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:21.709725 10839 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:21.730835  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.754712  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.754571 10828 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.755877  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.756610  8209 raft_consensus.cc:2410] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:21.757277  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.757767  8209 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.758059 10811 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.758549 10811 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.760370 10811 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.760967  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:21.755874  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 650) took 1193 ms. Trace:
I20260709 13:02:21.741971 10748 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.722667  8184 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.762148  8210 rpcz_store.cc:276] 0709 13:02:20.562430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.563641 (+  1211us) service_pool.cc:224] Handling call
0709 13:02:20.563967 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.795078 (+231111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.798412 (+  3334us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.300225 (+501813us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b2c000014c8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efab46a11 00007f2efab56372 00007f2efc288a01 00007f2efc24d43a 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2
0709 13:02:21.300622 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.377781 (+ 77159us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:21.383400 (+  5619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.755584 (+372184us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001af4d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:21.755632 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.755675 (+    43us) raft_consensus.cc:1685] finished
0709 13:02:21.755692 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.755821 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99635,"raft.queue_time_us":132870,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":20749,"spinlock_wait_cycles":245640320,"thread_start_us":66068,"threads_started":1,"wal-append.queue_time_us":109954}
W20260709 13:02:21.751447  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 47490.2us
I20260709 13:02:21.765125  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.766273  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:21.767495  8210 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.770330 10839 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:21.752620  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 50688us
I20260709 13:02:21.767853  8863 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.752010 10951 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.772467  8257 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:21.773626  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 51055.8us
W20260709 13:02:21.775583  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 57281.3us
I20260709 13:02:21.778258  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.779551  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:21.784163 10994 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.768438 10569 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.784827  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.776186  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:21.786296 10988 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:21.786638 10736 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:21.787213 10736 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:21.788024 10736 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.788272 10986 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.789582 10460 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.790390 10928 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.791847 10807 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.793037 10869 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:21.795192  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:21.797137  8209 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:21.799803  8367 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:21.800587  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:21.801120  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.801029  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.801697  8293 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.802626  8213 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:21.801139  8364 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.800112  8367 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:21.801728  8862 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:21.806895  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:21.809340  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.815955  8290 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:21.816293  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.812628  8213 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:21.816809  8285 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.817920  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.818367  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:21.818626  8896 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.822285  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.822975  8894 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:21.822957  8365 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:21.822911  8363 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:02:21.812932 10835 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.847880  8216 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:21.777583 10990 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.852679  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.845326  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:21.844779  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 47022us
I20260709 13:02:21.808019 10569 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.808679 10828 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:02:21.846618  8289 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:21.786818 10988 raft_consensus.cc:697] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:21.866647  8209 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:21.846328  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:21.829365 11003 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:21.850684  8293 raft_consensus.cc:2410] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:21.804105 10839 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.843770  8285 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:21.848067 10835 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.857657  8183 leader_election.cc:400] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:02:21.846278 10829 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:21.855587  8257 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:21.858464  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.808049 10869 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.813367 10733 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:21.847028 10981 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:21.794379 10807 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.867466 10945 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:21.868871  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:21.880487  8365 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:21.857059  8364 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:21.871145  8360 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:21.873443  8292 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:21.808070 10811 consensus_queue.cc:1059] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:02:21.859160 10957 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:21.876792  8291 raft_consensus.cc:2393] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:21.877081  8257 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:21.874784  8183 leader_election.cc:403] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:02:21.885996 10945 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.893441 10945 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.895107 10976 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.895509 10976 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.895833 10976 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.898715 10569 raft_consensus.cc:3055] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:21.899220 10569 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:21.900292 10988 consensus_queue.cc:237] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.899998 10569 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.875734 10835 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.902294 10937 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:21.902777 10937 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.901799 10569 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.877641  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.888741 10986 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.908133  8896 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:21.904477  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:21.865131 10931 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:21.875777 10829 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:21.912467  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 54971.8us
I20260709 13:02:21.918252  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:21.898648 10460 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.878576 10733 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.881310 11003 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:21.922966  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:21.886803 10960 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:21.918675  8183 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:21.827356 10951 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:02:21.918812  8365 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.911278  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:21.920938  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.892025  8213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:39866
I20260709 13:02:21.923605  8291 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.968457  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.967212  8213 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.968832  8211 raft_consensus.cc:2368] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7.
I20260709 13:02:21.969375  8213 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.917670 10372 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.968736  8285 raft_consensus.cc:2410] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:21.970409  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:21.970885  8894 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:21.890202 10962 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.925393 10733 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.977281  8361 raft_consensus.cc:2368] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:02:21.921900 10829 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.905349 10957 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.923382 10363 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.981459  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:21.926211 10960 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:21.973255 10609 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.999809 10838 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:21.990971  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:22.000459 10838 raft_consensus.cc:697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:22.001135  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:22.001330 10838 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.002179  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:21.999756  8213 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.003675  8863 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:22.004683  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:22.004757  8213 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:21.991535 11003 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.005522 10609 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.006343  8890 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:02:21.994612  8291 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:22.007169 10951 consensus_queue.cc:1059] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:22.007293  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:22.007449 10851 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:22.007884  8291 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:22.008143 10851 consensus_queue.cc:1243] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:22.008320 10951 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:22.008719 10951 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:21.988317 10945 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:21.994582  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:22.016453  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:22.017069  8292 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
W20260709 13:02:21.999994 11019 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:21.999807 10960 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.979907 10965 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.022382  8359 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:02:22.006202  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:21.997030  8365 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:22.004753  8863 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:22.011220  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:22.024320  8216 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:21.991333 10928 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:22.007197  8184 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:22.013243  8361 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:22.013176  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:22.002768  8289 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:22.028262  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1485) took 1131 ms. Trace:
I20260709 13:02:22.028367  8218 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:22.010345 10609 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:22.032053  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:22.009481 10951 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.032567 10931 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.032876 10965 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:21.996971  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 78395.3us
I20260709 13:02:21.925945 10460 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.032752  8366 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:22.030229  8863 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:22.031044  8212 rpcz_store.cc:276] 0709 13:02:20.897149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.897250 (+   101us) service_pool.cc:224] Handling call
0709 13:02:22.028066 (+1130816us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54003796d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:22.028205 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329030400}
I20260709 13:02:22.046981  8291 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:22.058106  8184 leader_election.cc:400] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:02:22.058902  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:22.061476  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:22.062515  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:22.067857  8215 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:22.072820 10944 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.073321 10944 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.073644 10944 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.027930 10986 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:22.077023  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:22.033840 10844 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:22.081907  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:22.083262  8289 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.008332 10937 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.082691  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:22.076256 10736 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:02:22.065312 10822 consensus_queue.cc:1059] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:02:22.088737 10460 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.066711 10965 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:22.052438 10861 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.056818 10931 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.027014 10363 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:22.023058 10976 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:22.099818  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:22.280097  8214 raft_consensus.cc:2410] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:02:22.276618  8365 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:22.249174  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:22.394656  8289 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:22.070786 10642 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:22.228317  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.074482 10950 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.074754 10998 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.097533 10851 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:22.426656  8258 leader_election.cc:336] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.766s (SENT)
I20260709 13:02:22.092381 10945 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.091300 10962 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.289636 10951 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.291144 10372 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4.
I20260709 13:02:22.437674  8258 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:22.129572  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.440024  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 1.03476e+06us
I20260709 13:02:22.328315 10931 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.448158  8289 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:22.272863 10835 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:22.478341  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:22.095054 10986 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:22.461426  8210 consensus_meta.cc:287] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.693s	user 0.006s	sys 0.002s
I20260709 13:02:22.463532 10937 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:22.463963 11022 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.560s	user 0.003s	sys 0.008s
I20260709 13:02:22.464730 10960 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:22.421535 11002 consensus_meta.cc:287] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.000s
I20260709 13:02:22.459954  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:22.474205  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 47612.2us
I20260709 13:02:22.475590  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:22.459868 10965 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.482883 10569 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:22.486258  8290 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:22.486928  8293 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:22.475157 10931 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.429217 10642 raft_consensus.cc:697] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:22.503805  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.563513  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:22.567747 10976 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.556591 10851 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:22.484985 10998 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:22.578662  8292 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:22.590572  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 112363us
I20260709 13:02:22.465593  8367 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:22.484840 10957 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.438855 10950 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:22.616835  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.014s	sys 0.021s
I20260709 13:02:22.610613  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:22.618284  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:22.611841  8864 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:22.617190  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.014s	sys 0.021s
W20260709 13:02:22.619460  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 560852us
I20260709 13:02:22.614612  8361 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.615688  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:22.489291  8210 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:22.610647  8891 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:02:22.608636 10829 consensus_meta.cc:287] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.581s	user 0.004s	sys 0.004s
I20260709 13:02:22.639087  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:22.628746  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.027s
I20260709 13:02:22.612203  8367 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:22.484683 10962 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:02:22.642174  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:22.642526  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:22.599481 10569 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:22.598655 10460 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:22.646324  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1514) took 1032 ms. Trace:
I20260709 13:02:22.652175  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:22.646610  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.016s	sys 0.028s
I20260709 13:02:22.649145  8358 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:22.652281  8214 rpcz_store.cc:276] 0709 13:02:21.614286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.742970 (+128684us) service_pool.cc:224] Handling call
0709 13:02:22.638319 (+895349us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54002a7954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:22.646266 (+  7947us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227007232}
I20260709 13:02:22.649138  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2127) took 1348 ms. Trace:
I20260709 13:02:22.648176 10609 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:22.653774  8217 rpcz_store.cc:276] 0709 13:02:21.300580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.308110 (+  7530us) service_pool.cc:224] Handling call
0709 13:02:22.648985 (+1340875us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400129154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:22.649083 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257092352}
I20260709 13:02:22.615684 10861 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:22.658766  8285 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.020s	sys 0.059s
W20260709 13:02:22.659518  8285 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.020s	sys 0.059s
I20260709 13:02:22.559168 11002 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.658886  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:22.660781  8209 raft_consensus.cc:2410] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:02:22.660883  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 601418us
I20260709 13:02:22.653843  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:22.662549  8217 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:22.670329  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1506) took 1084 ms. Trace:
I20260709 13:02:22.670595  8217 rpcz_store.cc:276] 0709 13:02:21.586383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.662131 (+1075748us) service_pool.cc:224] Handling call
0709 13:02:22.662390 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.669951 (+  7561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.670280 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.647943 10957 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:22.614475 10851 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:22.654549 10372 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:22.682454  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 664) took 1076 ms. Trace:
I20260709 13:02:22.743539  8209 rpcz_store.cc:276] 0709 13:02:21.605844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.669150 (+1063306us) service_pool.cc:224] Handling call
0709 13:02:22.681931 (+ 12781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.682119 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.682146 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.682184 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:22.682215 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.682268 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.682396 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:22.653837 10733 consensus_meta.cc:287] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.000s
I20260709 13:02:22.669205  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:22.647789 10829 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:22.673504  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:22.753110 10372 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:22.762807 10835 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.764143 10986 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.764400 10851 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.675341 10957 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:22.768899  8367 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:02:22.662307 10945 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
W20260709 13:02:22.770104  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.769758  8286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.019s	sys 0.040s
W20260709 13:02:22.776114  8286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.020s	sys 0.040s
I20260709 13:02:22.781337  8363 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:22.752004 10937 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:22.749193 10733 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:22.787814 10733 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:22.788928 10944 consensus_meta.cc:287] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.000s
I20260709 13:02:22.789361 10944 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.754824 11032 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:22.790356 11032 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.791091 11002 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.792246 11032 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.793027 10960 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.794956 10950 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.796759 10829 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:22.749514 10642 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.781810 10986 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:02:22.798422 10372 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.658488 10460 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.773435  8892 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:22.813237  8331 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.071s	sys 0.081s
I20260709 13:02:22.812566  8216 raft_consensus.cc:2410] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:02:22.814881  8331 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.072s	sys 0.081s
W20260709 13:02:22.815197  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 744503us
I20260709 13:02:22.816099  8361 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:22.816756  8284 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:22.817502  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:22.774438  8367 pending_rounds.cc:85] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 2
I20260709 13:02:22.819691  8367 pending_rounds.cc:107] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:02:22.819976  8367 raft_consensus.cc:2889] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:22.820586  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2032) took 1021 ms. Trace:
I20260709 13:02:22.820902  8367 rpcz_store.cc:276] 0709 13:02:21.799299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.799421 (+   122us) service_pool.cc:224] Handling call
0709 13:02:21.799699 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.465298 (+665599us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b5400256820. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc1cb06f 00007f2efc243f60 00007f2efc2457de 00007f2efc24fb49 00007f2efc250416 00007f2efc24cd8f 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62
0709 13:02:22.820364 (+355066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.820538 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164132736}
I20260709 13:02:22.824452  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:22.825048  8360 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:22.825191  8366 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:22.780150 11028 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:02:22.826534  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:22.826978  8365 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:22.778147 10957 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.828537  8367 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
W20260709 13:02:22.828560 10959 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:02:22.831949  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:22.832206 10944 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.833716  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:22.834316  8365 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:22.797983 10822 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:22.835675  8358 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:22.782495 10363 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:22.806107 11001 raft_consensus.cc:3055] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:22.804636 10998 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:22.838577  8360 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:22.827386 10946 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.844280  8358 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:02:22.842613  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:22.845628  8366 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:22.812778 10937 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.848337  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:22.844632  8358 pending_rounds.cc:85] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 8
I20260709 13:02:22.850422  8358 pending_rounds.cc:107] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:02:22.850708  8358 raft_consensus.cc:2889] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:22.851159 10953 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 1.589s	user 0.006s	sys 0.012s
I20260709 13:02:22.838348 11001 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:22.841177 10946 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.840747 10822 raft_consensus.cc:697] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:02:22.853755 10988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.029s	sys 0.040s
W20260709 13:02:22.906502  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 297040us
I20260709 13:02:22.908054  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:22.859786 10946 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.931130  8284 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
W20260709 13:02:22.868119 10988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.029s	sys 0.040s
I20260709 13:02:22.946823  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:22.948303  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:22.948870  8289 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:22.951264  8366 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:22.951427  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.959563  8214 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:22.949196  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:22.979486  8331 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:22.982864  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:22.983109  8892 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:22.983291  8284 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:22.984545  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 803) took 1159 ms. Trace:
I20260709 13:02:22.984066  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:22.986732  8892 rpcz_store.cc:276] 0709 13:02:21.842550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.846211 (+  3661us) service_pool.cc:224] Handling call
0709 13:02:22.658019 (+811808us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:22.984442 (+326423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15895808}
I20260709 13:02:22.984602  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:22.985924  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 316932us
I20260709 13:02:22.986100  8331 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:22.951274  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 171732us
I20260709 13:02:22.986263  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 667) took 1061 ms. Trace:
I20260709 13:02:22.987783  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:22.954077 10965 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:22.996055  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 350655us
I20260709 13:02:22.948962 11035 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.993757  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:22.999464  8214 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:22.945505 10460 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:22.986667 10962 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:22.998533  8183 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:22.968681 10822 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:23.008392  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.009322  8214 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:23.010342  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:23.011154  8214 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:23.014241  8284 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:23.015360  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:22.945791 11001 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.016503  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:23.024672  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 790) took 1529 ms. Trace:
I20260709 13:02:23.025069  8895 rpcz_store.cc:276] 0709 13:02:21.495482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.495606 (+   124us) service_pool.cc:224] Handling call
0709 13:02:23.018304 (+1522698us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540067edd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:23.024615 (+  6311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384927616}
I20260709 13:02:23.025269  8284 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:23.019323  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:23.026661  8898 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:23.020439  8896 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:23.022010  8892 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:23.024346  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1520) took 1343 ms. Trace:
I20260709 13:02:23.027940  8214 rpcz_store.cc:276] 0709 13:02:21.681228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.023652 (+1342424us) service_pool.cc:224] Handling call
0709 13:02:23.023891 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.024046 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.024080 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.024118 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:23.024154 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.024201 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.024296 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.000996  8359 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:23.033964  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:23.034651  8284 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:23.001498  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1088) took 1507 ms. Trace:
I20260709 13:02:22.997505 11037 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:22.999656 10965 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.045282 10965 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.045827 10965 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.024441 10945 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:23.003198 11035 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:23.148078 11039 log.cc:927] Time spent T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:02:23.180467 11034 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:02:23.042928  8893 rpcz_store.cc:276] 0709 13:02:21.493810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.498583 (+  4773us) service_pool.cc:224] Handling call
0709 13:02:22.993134 (+1494551us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400501ed4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:22.999186 (+  6052us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320614272}
I20260709 13:02:23.077178  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:23.245612 11040 log.cc:927] Time spent T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:02:23.249523 11035 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.029868 10944 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.093622  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 107674us
I20260709 13:02:23.179431 10363 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:02:23.146340 10962 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:23.263172  8331 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:23.046622 11037 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.254961  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:23.131237  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 146776us
I20260709 13:02:23.254715  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:23.254382  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:23.268162  8896 raft_consensus.cc:2393] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:23.265952  8289 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:23.266824  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 189795us
W20260709 13:02:23.273650  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.197613 11001 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:23.221658 11050 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.279292  8284 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:23.283515  8284 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:23.280239  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:23.285168  8896 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:23.252758 10945 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:23.201232 11051 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:23.207521 11055 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.259021 11035 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.287762  8258 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:23.287550  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:23.293282  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:23.274410 11031 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:23.266492 11054 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:23.294935  8896 raft_consensus.cc:2410] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:23.282231 11043 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.272912 11037 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.194581 10937 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.093040 10835 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 13:02:23.223035 10957 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.298086  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:23.295580  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1521) took 1593 ms. Trace:
I20260709 13:02:23.265537 10944 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.298482 11054 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.290920 11051 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.308171 11054 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:23.307730  8896 raft_consensus.cc:2410] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:23.312328  8863 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:23.312507  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:23.297873 10363 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.305892  8289 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:23.296378 11031 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:23.318277  8258 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:23.317302  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:23.315217  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:23.264149 10962 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.314567  8214 rpcz_store.cc:276] 0709 13:02:21.702555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.029052 (+1326497us) service_pool.cc:224] Handling call
0709 13:02:23.029348 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.064194 (+ 34846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.064225 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.064725 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.295265 (+230540us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:23.295302 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.295376 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.295417 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:23.295427 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.295531 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41913,"raft.queue_time_us":35254,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":53541,"thread_start_us":145811,"threads_started":1,"wal-append.queue_time_us":195666}
I20260709 13:02:23.319635  8284 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.322307  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:23.315313 10931 consensus_meta.cc:287] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.005s
W20260709 13:02:23.329103  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 45608us
I20260709 13:02:23.318156 11003 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.344863  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:23.332463  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:23.289153 11050 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.298805 11035 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.330322  8287 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:23.297072 11055 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:23.336918 11046 log.cc:927] Time spent T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
I20260709 13:02:23.302354 11043 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:23.339385 11056 log.cc:927] Time spent T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:23.302357 11058 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:02:23.340020  8288 raft_consensus.cc:1240] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:23.342954  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 661) took 1881 ms. Trace:
I20260709 13:02:23.313741 11051 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.321039 11031 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:23.346839  8894 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:23.348739  8896 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:23.324136 10990 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:23.330778 11045 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:02:23.306684 10822 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:23.325740 11041 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:23.357267  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:23.332552 11034 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:23.376124  8284 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
W20260709 13:02:23.465682 11062 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:02:23.464423 11037 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:23.465693 10946 consensus_meta.cc:287] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.516s	user 0.043s	sys 0.025s
I20260709 13:02:23.471436 11050 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.353893 10964 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:02:23.477798 10957 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:23.353754 11003 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.326184 10994 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:23.352269 10363 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:23.355232 10950 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.483790  8896 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:23.485047  8214 raft_consensus.cc:2376] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4. Re-sending same reply.
I20260709 13:02:23.522794  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:23.523504  8214 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:23.346973 10965 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:02:23.336094 10931 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:23.485770  8284 raft_consensus.cc:3055] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:23.489887  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 132373us
I20260709 13:02:23.482179 10990 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.518368 11069 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.520223 10991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.618s	user 0.009s	sys 0.027s
I20260709 13:02:23.334805 10945 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:23.525730  8284 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:23.486680 10851 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.534489  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 49223.5us
I20260709 13:02:23.526576  8863 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:23.530898  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:23.536028  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:23.469676 11054 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.536849  8214 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:23.516436 11067 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.570169  8215 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:02:23.527799 10991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.625s	user 0.010s	sys 0.027s
I20260709 13:02:23.573907  8214 pending_rounds.cc:85] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 6
I20260709 13:02:23.543622  8284 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.577905  8284 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:23.572577  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:23.579411  8214 pending_rounds.cc:107] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:02:23.579723  8214 raft_consensus.cc:2889] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:23.580695  8257 leader_election.cc:336] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.994s (SENT)
I20260709 13:02:23.581200  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:23.582386 10960 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.530170 11066 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.529672 10990 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.530143 10642 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:23.490774 10946 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:23.595438 10748 raft_consensus.cc:3055] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:23.595968 10748 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:23.596908 10748 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.526962 10363 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:23.486570 11041 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.566763 11074 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:23.528527 10950 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:23.605135  8284 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:23.591018 10822 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.567961 10957 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:02:23.612252  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 76698.6us
I20260709 13:02:23.612753  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:23.567555 10851 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.535108 11069 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:23.629729 11068 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:23.574545 11067 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.592586 11066 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:23.616191 11071 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:23.599785 10642 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:22.992514  8285 rpcz_store.cc:276] 0709 13:02:21.924896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.027202 (+102306us) service_pool.cc:224] Handling call
0709 13:02:22.027452 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.027628 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:22.660353 (+632725us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.985845 (+325492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.985944 (+    99us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:22.985998 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.986065 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.986204 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":822988,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":99,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5635,"thread_start_us":953364,"threads_started":2}
W20260709 13:02:23.643108  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.395171  8210 rpcz_store.cc:276] 0709 13:02:21.461135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.657834 (+1196699us) service_pool.cc:224] Handling call
0709 13:02:22.774978 (+117144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.910891 (+135913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.916314 (+  5423us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.975129 (+ 58815us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.193265 (+218136us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:23.197539 (+  4274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.309642 (+112103us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b5400194454. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:23.309690 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.342670 (+ 32980us) raft_consensus.cc:1685] finished
0709 13:02:23.342689 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.342894 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202784128,"thread_start_us":72496,"threads_started":1,"wal-append.queue_time_us":266064}
W20260709 13:02:23.647550  8331 leader_election.cc:336] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.554s (SENT)
I20260709 13:02:23.648765  8331 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:23.649837  8331 leader_election.cc:336] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.576s (SENT)
I20260709 13:02:23.650269  8331 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:23.651067  8285 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:23.654963  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:23.655628  8288 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:23.640558 10964 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.642063 11035 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.622691 10822 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:23.679118 11076 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:23.679342 11067 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.681058 10807 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:23.682524  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:23.683293 11053 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:23.612907 11074 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.697415 11084 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:23.694322 10807 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:23.706411  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:23.655256 11072 consensus_queue.cc:1059] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:02:23.687245 11055 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:23.723186 11014 log.cc:927] Time spent T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 1.823s	user 0.017s	sys 0.021s
I20260709 13:02:23.694895 11037 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.677629 10964 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.813880 10851 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.817793  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1522) took 1923 ms. Trace:
I20260709 13:02:23.776166 11041 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:23.724278 11085 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.819396 10946 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:23.724545 11043 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.819535 11066 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:23.710855 10931 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:23.850725  8285 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:23.849079  8214 rpcz_store.cc:276] 0709 13:02:21.894372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.571678 (+1677306us) service_pool.cc:224] Handling call
0709 13:02:23.572073 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:23.583977 (+ 11904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.584011 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:23.584583 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 13:02:23.691594 (+107011us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:23.691637 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.691717 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.817537 (+125820us) raft_consensus.cc:1685] finished
0709 13:02:23.817557 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.817725 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3555,"raft.queue_time_us":8312,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":16644,"spinlock_wait_cycles":53632,"thread_start_us":105418,"threads_started":1,"wal-append.queue_time_us":109327}
I20260709 13:02:23.818288 10736 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.851742  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:23.850039 11085 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.852025 10736 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:23.852715 10964 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.706772  8210 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:23.853197  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:23.848860 10807 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:23.854185 10736 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:23.724184 11074 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:23.851740  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:23.771083 11049 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:23.855808  8214 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.791069 10363 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:23.738714  8331 leader_election.cc:336] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.708s (SENT)
W20260709 13:02:23.857200  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 118594us
I20260709 13:02:23.848955 11072 raft_consensus.cc:3055] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:23.858387 11072 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:23.854502  8285 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
W20260709 13:02:23.870268  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 212341us
I20260709 13:02:23.871850  8214 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:23.873147  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1525) took 1058 ms. Trace:
I20260709 13:02:23.873538  8214 rpcz_store.cc:276] 0709 13:02:22.814517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.872468 (+1057951us) service_pool.cc:224] Handling call
0709 13:02:23.872724 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.872876 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.872900 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.872934 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:23.872966 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.873014 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.873100 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:23.877388  8331 leader_election.cc:336] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.848s (SENT)
I20260709 13:02:23.882444  8214 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:02:23.882632  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:23.854418  8210 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:23.875065 10950 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:23.899559 11085 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.900300 11069 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.900089 10990 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.876946 11031 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.887879 11093 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.888916 11071 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:23.914129  8897 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:23.918015 11071 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.920238 11051 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.921872  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2125) took 2671 ms. Trace:
I20260709 13:02:23.923113  8218 rpcz_store.cc:276] 0709 13:02:21.251148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.251304 (+   156us) service_pool.cc:224] Handling call
0709 13:02:22.028194 (+776890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.036650 (+  8456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.921698 (+1885048us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54003796d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:23.921818 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786878720}
I20260709 13:02:23.926339 11051 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.914435 10642 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.911062  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2143) took 1849 ms. Trace:
I20260709 13:02:23.925318 10990 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:23.948004 11035 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:23.903728 11072 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.953915 11072 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.954592 10822 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.955547 11081 raft_consensus.cc:3055] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:23.956003 11081 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:23.935840  8210 rpcz_store.cc:276] 0709 13:02:22.053762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.853892 (+1800130us) service_pool.cc:224] Handling call
0709 13:02:23.854248 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.890795 (+ 36547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.903432 (+ 12637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.972775  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:23.973477  8366 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:23.980592  8361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2052) took 1954 ms (client timeout 2279 ms). Trace:
I20260709 13:02:23.960467 11081 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.963315 11031 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:23.984440  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2036) took 2147 ms. Trace:
W20260709 13:02:23.970671 11100 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:02:23.981109  8361 rpcz_store.cc:269] 0709 13:02:22.026479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.065984 (+ 39505us) service_pool.cc:224] Handling call
0709 13:02:23.980395 (+1914411us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400318dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:23.980523 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407255424}
I20260709 13:02:23.969121 10990 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.985798 10990 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:23.987035  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2031) took 2066 ms. Trace:
I20260709 13:02:23.985028  8362 rpcz_store.cc:276] 0709 13:02:21.800355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.800444 (+    89us) service_pool.cc:224] Handling call
0709 13:02:21.844506 (+ 44062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.844693 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:21.846821 (+  2128us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.599317 (+1752496us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b18003b2fc0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2efbdf54bc 00007f2ef914348b 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded23a
0709 13:02:23.775937 (+176620us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.947480 (+171543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.947535 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:23.947598 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.947695 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.947813 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2531,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":32553,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":170,"spinlock_wait_cycles":11853056,"thread_start_us":369958,"threads_started":3,"wal-append.queue_time_us":155415,"wal-append.run_cpu_time_us":949,"wal-append.run_wall_time_us":1002263}
I20260709 13:02:23.987681  8286 rpcz_store.cc:276] 0709 13:02:21.920563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.920665 (+   102us) service_pool.cc:224] Handling call
0709 13:02:21.925788 (+  5123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.776530 (+850742us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:22.776559 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.804874 (+ 28315us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.992300 (+187426us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:22.992327 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.982353 (+990026us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54001d6ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:23.982414 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.982466 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:23.982480 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.986974 (+  4494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8337,"raft.queue_time_us":13245,"spinlock_wait_cycles":368269056,"thread_start_us":878899,"threads_started":2,"wal-append.queue_time_us":342773}
I20260709 13:02:23.992738  8366 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:23.995959  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1613) took 1020 ms. Trace:
W20260709 13:02:23.996527  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.997736  8366 rpcz_store.cc:276] 0709 13:02:22.975366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.975489 (+   123us) service_pool.cc:224] Handling call
0709 13:02:23.972592 (+997103us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:23.995891 (+ 23299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7369600}
I20260709 13:02:24.015755 11084 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.016474 11084 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.072324  8331 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.074055  8331 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:24.078197 10986 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:24.082058  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:24.089532  8331 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:24.095512  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.095813  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.096268  8218 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:24.091849  8331 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:24.098412 10898 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:24.100419  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:24.101064 10990 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:24.100558  8211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1512) took 2474 ms (client timeout 1994 ms). Trace:
I20260709 13:02:24.100325  8212 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:24.104075 10898 raft_consensus.cc:697] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:24.105090 10898 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:24.101732  8211 rpcz_store.cc:269] 0709 13:02:21.613612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.700284 (+ 86672us) service_pool.cc:224] Handling call
0709 13:02:24.087872 (+2387588us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002a8354. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:24.087999 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611944832}
I20260709 13:02:24.090934 10986 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:24.111819  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2032) took 2190 ms. Trace:
I20260709 13:02:24.112279  8292 rpcz_store.cc:276] 0709 13:02:21.920895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.017679 (+ 96784us) service_pool.cc:224] Handling call
0709 13:02:22.017947 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.611265 (+593318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.111589 (+1500324us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b5400044554. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:24.111762 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289691520}
I20260709 13:02:24.114253 10986 consensus_queue.cc:1059] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:24.115654 10986 raft_consensus.cc:3055] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:24.101310  8210 raft_consensus.cc:2393] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:24.120198  8892 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:24.087437 10829 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.120923  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 662) took 1090 ms. Trace:
I20260709 13:02:24.121604 10960 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:24.116005  8259 connection.cc:256] RPC call timeout handler was delayed by -1.2135922929999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:02:24.130153  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.121284  8892 rpcz_store.cc:276] 0709 13:02:23.031048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.031345 (+   297us) service_pool.cc:224] Handling call
0709 13:02:24.119735 (+1088390us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:24.119975 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.120674 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.120870 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5994880}
I20260709 13:02:24.132108  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.139365  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:24.128747 11105 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:02:24.146735  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.149820  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:24.147902  8259 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:24.155764  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.156697  8366 raft_consensus.cc:2410] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:24.161878  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:24.163884 11106 log.cc:927] Time spent T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:24.129750 10829 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.170946 11084 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:24.144964 11067 consensus_queue.cc:1059] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:02:24.174006  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 655) took 1157 ms. Trace:
I20260709 13:02:24.178151 10946 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:24.179735 10946 raft_consensus.cc:2764] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:24.138692 10642 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.180681 10642 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.174499  8890 rpcz_store.cc:276] 0709 13:02:23.016668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.024109 (+  7441us) service_pool.cc:224] Handling call
0709 13:02:24.173042 (+1148933us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128eee 0000000000375939 00007f2f0119c1e0 00007f2f012650c4 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:24.173389 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.173623 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.173655 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.173705 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:24.173746 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.173809 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.173950 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129966336}
I20260709 13:02:24.183079 10642 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.186218  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2030) took 2266 ms. Trace:
I20260709 13:02:24.186050 10964 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:24.186586  8293 rpcz_store.cc:276] 0709 13:02:21.920227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.920337 (+   110us) service_pool.cc:224] Handling call
0709 13:02:22.486663 (+566326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.559218 (+ 72555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.185984 (+1626766us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400445cd0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:24.186139 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302394752}
I20260709 13:02:24.187425 11034 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.187793 11034 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:24.188148 11034 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.190424 11054 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.154173 10363 consensus_queue.cc:1059] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:02:24.191828 10363 raft_consensus.cc:3055] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:24.192175 10363 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:24.192996 10363 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.186985 11085 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:24.116034 10986 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:24.195797  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.196475  8895 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.197072  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:24.199179  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2150) took 2134 ms (client timeout 1520 ms). Trace:
I20260709 13:02:24.154332 11093 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:24.199582  8216 rpcz_store.cc:269] 0709 13:02:22.064751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.078939 (+ 14188us) service_pool.cc:224] Handling call
0709 13:02:24.198979 (+2120040us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54003773d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:24.199111 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164537088}
I20260709 13:02:24.200229 11085 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.200650 11085 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.144709 11072 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.202942 11072 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.199952 11093 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.141577 10960 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.206666 11072 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:24.214748  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.216524  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1600) took 1396 ms. Trace:
I20260709 13:02:24.216595  8897 raft_consensus.cc:2393] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:24.217648  8366 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:24.219465  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.220515  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.144665 10959 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:02:24.154673  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.214566 11000 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.222018  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.208534 11055 consensus_queue.cc:1059] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:24.224236 10960 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:24.228555  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.205302 10363 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.229130  8895 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:24.215123 11093 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.233702  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 661) took 1208 ms. Trace:
I20260709 13:02:24.230796  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.234263  8895 rpcz_store.cc:276] 0709 13:02:23.023569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.026109 (+  2540us) service_pool.cc:224] Handling call
0709 13:02:24.195631 (+1169522us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:24.231932 (+ 36301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482671872}
I20260709 13:02:24.236615  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.228063  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.241113  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.243212  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.230551  8359 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:24.246352  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.238462 11000 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.256937 11000 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:24.262013  8923 heartbeater.cc:646] Failed to heartbeat to 127.6.236.62:39147 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.236.62:39147 timed out after 15.000s (SENT)
I20260709 13:02:24.249553  8890 raft_consensus.cc:3055] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:24.266466  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.267033  8894 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.266407  8890 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:24.269361  8890 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.272015  8890 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:24.271509  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.272177  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.272873  8893 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:24.273461  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 668) took 1144 ms. Trace:
I20260709 13:02:24.230172 10986 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.274696 10986 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:24.275799  8363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2038) took 2450 ms (client timeout 1591 ms). Trace:
W20260709 13:02:24.276182  8363 rpcz_store.cc:269] 0709 13:02:21.824939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.825231 (+   292us) service_pool.cc:224] Handling call
0709 13:02:24.275618 (+2450387us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b5400180954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:24.275736 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2101628800}
W20260709 13:02:24.273123  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.273823  8893 rpcz_store.cc:276] 0709 13:02:23.129207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.249078 (+119871us) service_pool.cc:224] Handling call
0709 13:02:24.272035 (+1022957us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:24.273402 (+  1367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11504000}
I20260709 13:02:24.278579  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.279194 10642 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:24.262223 10964 consensus_queue.cc:1059] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:02:24.280099  8893 raft_consensus.cc:2376] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8. Re-sending same reply.
I20260709 13:02:24.274936  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1518) took 2659 ms. Trace:
I20260709 13:02:24.280902  8209 rpcz_store.cc:276] 0709 13:02:21.615348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.754047 (+1138699us) service_pool.cc:224] Handling call
0709 13:02:24.274329 (+1520282us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b5800002798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:24.274495 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.274642 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.274665 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.274703 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.274731 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.274783 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.274886 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11990784}
I20260709 13:02:24.217026  8364 rpcz_store.cc:276] 0709 13:02:22.820010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.820122 (+   112us) service_pool.cc:224] Handling call
0709 13:02:22.820413 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.820720 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.820747 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.827497 (+  6750us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.031322 (+1203825us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b18003b1f40. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1 00007f2efc208a0f
0709 13:02:24.141188 (+109866us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.156479 (+ 15291us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.208751 (+ 52272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.208832 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.208887 (+    55us) raft_consensus.cc:1685] finished
0709 13:02:24.216328 (+  7441us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.216469 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51998,"prepare.queue_time_us":49221,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":52918,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":7006,"spinlock_wait_cycles":8476416,"thread_start_us":109323,"threads_started":1,"wal-append.queue_time_us":1326386}
I20260709 13:02:24.282486  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.284983  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.286159 10946 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:24.239506 11037 raft_consensus.cc:3055] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:24.289287 11093 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:24.294446  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 146688us
I20260709 13:02:24.296747  8894 raft_consensus.cc:2410] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:24.301977  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.306442  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.307446  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.308141  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:24.308143  8897 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:24.314319  8259 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:24.325016  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.344084  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.347177  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.348090  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.299099 11037 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:24.289806 11034 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.310518 10960 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:02:24.348881  8893 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:24.355645  8862 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:24.355749  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 95764.5us
I20260709 13:02:24.345741 11035 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:24.373109  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0870524000000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:02:24.310268 10622 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:02:24.370682  8894 raft_consensus.cc:2410] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:24.354312 11055 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:24.315358 11085 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.381955  8862 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:24.359983 11113 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.379225  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.383375  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.384969  8894 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.387672  8360 raft_consensus.cc:2368] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:24.388916  8890 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:24.389827  8332 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.389928  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.392414  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.393471  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.375928 11000 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:24.359797 10994 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:02:24.396360  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.378362 10642 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.397886  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.399241  8332 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.380043 10372 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.407618  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:24.408489  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 94282.5us
I20260709 13:02:24.402426  8894 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:24.403569 11050 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.403512  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.415573  8893 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:24.416659  8893 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:24.403671 10950 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:24.404320  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.404747 11097 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:02:24.405519  8359 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:24.381464 11080 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.411875  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.411959  8894 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:02:24.414692  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.420822  8332 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:24.378702 11035 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.408358 11000 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:24.426051 11035 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.401401 11066 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.422485  8894 pending_rounds.cc:85] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 6
I20260709 13:02:24.420924 11113 consensus_queue.cc:1059] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:02:24.427018  8894 pending_rounds.cc:107] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:02:24.427302  8894 raft_consensus.cc:2889] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.384779 11055 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.423363  8363 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:24.429684  8184 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:24.410343 10990 raft_consensus.cc:2764] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:24.434477  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.432025 10838 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:02:24.440548  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.440824  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.441352 11093 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.442049  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.442883  8358 raft_consensus.cc:2393] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:24.444763  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.448531  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.449676  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.450481  8358 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:24.411861 10372 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.427469 11113 raft_consensus.cc:3055] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:24.455983  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.431695 10861 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.402050 11037 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.455788  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.468724  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.435653 11001 consensus_queue.cc:1059] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:02:24.447947 11042 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:24.451509 11093 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.476035  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.430944 11080 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.432242 11065 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:02:24.451869 11035 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:24.479209  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.479308  8363 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:24.485467  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.485981  8358 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:24.425902 11000 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.450875 10959 consensus_queue.cc:1059] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:24.455646 11113 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:24.481240 11042 raft_consensus.cc:697] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:24.482002 11055 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:24.483917 11048 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.277s	user 0.005s	sys 0.000s
I20260709 13:02:24.487182  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.491720  8363 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:24.468175 10861 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.492202 11085 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:24.492962 11114 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:02:24.497551  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.498153  8358 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 3.
I20260709 13:02:24.500878 11042 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.495791 11034 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:24.489378 11035 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:24.507391 11035 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.503865  8365 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:24.510910 10861 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.511680  8359 raft_consensus.cc:2410] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:24.514263  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.514775 11080 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.531572  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.523190 10950 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:24.519295  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1605) took 1688 ms. Trace:
I20260709 13:02:24.539172  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.513315 11113 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.535945  8361 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
I20260709 13:02:24.515018  8363 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:24.539201  8367 rpcz_store.cc:276] 0709 13:02:22.831216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.831331 (+   115us) service_pool.cc:224] Handling call
0709 13:02:22.831618 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.832202 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.832232 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.832664 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.998765 (+166101us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:22.998803 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.998864 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.483370 (+1484506us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:24.518933 (+ 35563us) raft_consensus.cc:1685] finished
0709 13:02:24.518952 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.519237 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"spinlock_wait_cycles":4243712,"thread_start_us":165754,"threads_started":1,"wal-append.queue_time_us":298536}
I20260709 13:02:24.539925  8893 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.544746 10807 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.530516 11081 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:24.547334  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.561236  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.564141  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.523694 11050 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.578711 11091 raft_consensus.cc:3055] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:24.580410 11091 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:24.581368 11091 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.582521  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.583063  8358 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:24.587965  8362 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:24.585879  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:24.517117 11072 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:24.589761  8184 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:24.591765 10838 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:24.592236 10838 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:24.593016 10838 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.534675 10944 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:24.519920 10748 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:24.594691  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.525192 11065 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:24.595388  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.596069  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:24.601789  8363 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:24.567420 11080 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:24.594507 11072 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:24.605288  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.607566  8362 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:24.606379  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:24.605252 11091 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.614356  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.615532  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.616230  8363 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:24.616923  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.604126 11065 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.617554  8363 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:24.618458 10972 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:24.618893 10972 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.619234 10972 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.620733  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:24.621484  8363 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:24.622407  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.622534  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.623201  8897 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 3: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:24.595427 10828 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.601847 11001 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.627565  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.628146  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.629210  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.628153  8897 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:24.630601  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.631116  8897 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:24.631839  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.632352  8897 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
W20260709 13:02:24.629647  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2142) took 2576 ms (client timeout 2511 ms). Trace:
I20260709 13:02:24.607280 11080 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.626859  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.644158  8362 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:24.634613  8215 rpcz_store.cc:269] 0709 13:02:22.053487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.651930 (+598443us) service_pool.cc:224] Handling call
0709 13:02:24.629452 (+1977522us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b5400377dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:24.629580 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109852416}
I20260709 13:02:24.636094  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.639475 11034 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:24.640139  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.645247  8897 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:24.651731  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.652413  8257 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.653945  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.653965  8897 raft_consensus.cc:2410] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:24.620914 11113 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.606969 10945 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.655912  8257 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:24.659183  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.664547  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.665221  8897 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:24.661550  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.662161  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:24.666112  8213 raft_consensus.cc:2410] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:02:24.666808  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.667910  8893 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:24.668906  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.670174 11120 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:24.670720 11120 raft_consensus.cc:697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:24.671782 11080 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.671574 11120 consensus_queue.cc:237] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.672294 11080 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:24.674260 11072 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.678783  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.681721  8897 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:24.682675  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.683666  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.676098  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:24.698968  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.700510  8257 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.703351  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.703922  8897 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:24.705044  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:24.670030  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.709152  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:24.709432  8897 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:24.709780  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:24.713976  8287 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
W20260709 13:02:24.714373  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 54348.3us
I20260709 13:02:24.710670  8285 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:02:24.691841 10363 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:24.711275  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:24.657850 10998 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:02:24.716089  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:24.716213  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:24.717520  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:24.718488  8183 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:24.719635  8362 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:24.720319  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.657562 11034 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.662706 11119 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.723074  8288 raft_consensus.cc:2410] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:24.714736 10748 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.713152 11072 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:24.707245 11120 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.725756  8362 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:24.726143 11002 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:24.733073 10748 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.739056  8366 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:24.738683 10363 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:24.740177  8366 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:24.740463 10748 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.740676 10363 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.733476  8286 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:24.745553  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:24.725833 11065 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.747543  8889 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:24.747962 11001 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.748468 11000 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.748433  8863 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:24.750452  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:24.750365 10972 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:24.750934  8863 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:24.751675 11091 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:24.752053 11091 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.752345 11091 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.752530 10972 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:24.722582 11131 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:24.753819  8863 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:24.757293  8863 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:24.759717 11084 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.760569 11097 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.761163 11034 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:24.762622  8893 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:24.763209  8896 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:24.764026  8893 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:24.765375 10372 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:24.766100 11000 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.748219  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 657) took 1731 ms. Trace:
I20260709 13:02:24.767820  8889 rpcz_store.cc:276] 0709 13:02:23.017231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.023703 (+  6472us) service_pool.cc:224] Handling call
0709 13:02:24.721085 (+1697382us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:24.733592 (+ 12507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.747980 (+ 14388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.748164 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480567552}
I20260709 13:02:24.770364  8259 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.770960  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.771620  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:24.771963  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:24.772917  8214 raft_consensus.cc:2410] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:24.775877  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.777029  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.774502  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:24.784245 11097 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:24.785004  8213 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:02:24.785279 11113 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.779201  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:24.756767 11136 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.061s	user 0.001s	sys 0.003s
I20260709 13:02:24.793958  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:24.796430  8216 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.787007  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.797410  8211 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:02:24.797822  8211 pending_rounds.cc:85] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 4
I20260709 13:02:24.798041  8211 pending_rounds.cc:107] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:02:24.798300  8211 raft_consensus.cc:2889] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.777966 11034 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:24.779757  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:24.725191  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:24.786055  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:24.785765 11113 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:24.812968  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:24.779772 11119 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:02:24.779273 10960 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:24.850991  8213 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 3: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:24.851670  8214 raft_consensus.cc:2410] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:24.830267  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:24.855371  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 130302us
W20260709 13:02:24.850526  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 56137.1us
W20260709 13:02:24.848889  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.854220  8209 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:24.857662  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:24.860263  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.869724 11133 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:02:24.872673  8895 raft_consensus.cc:2410] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:24.858934 11131 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:24.853430 11113 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.891466  8216 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:24.900377  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:24.901106  8360 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:24.902860  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.903975  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.904520  8893 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:24.898556 10960 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:24.907794  8216 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:24.910504 11119 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:24.911664 11119 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:24.912557 11119 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:24.923024  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 65459.7us
I20260709 13:02:24.924067  8259 leader_election.cc:400] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:24.924438  8259 leader_election.cc:403] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.925372 10642 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.929785  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:24.931725  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.934340 11070 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.319s	user 0.010s	sys 0.014s
W20260709 13:02:24.935570 11070 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.010s	sys 0.014s
I20260709 13:02:24.943588  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.944406  8891 raft_consensus.cc:2368] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6.
W20260709 13:02:24.944804  8891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 656) took 1927 ms (client timeout 1766 ms). Trace:
I20260709 13:02:24.947887  8332 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:24.948571  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:24.948762  8332 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:24.945147  8891 rpcz_store.cc:269] 0709 13:02:23.016962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.018980 (+  2018us) service_pool.cc:224] Handling call
0709 13:02:24.943421 (+1924441us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:24.944738 (+  1317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483423488}
I20260709 13:02:24.936079 11070 raft_consensus.cc:3055] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:24.953708 11070 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:24.952710 10372 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:02:24.956360 11112 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.586s	user 0.002s	sys 0.000s
I20260709 13:02:24.951799  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:24.954038  8898 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:24.957751  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 663) took 1915 ms. Trace:
I20260709 13:02:24.958101  8898 rpcz_store.cc:276] 0709 13:02:23.042579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.042722 (+   143us) service_pool.cc:224] Handling call
0709 13:02:24.953713 (+1910991us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5800187b98. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:24.953873 (+   160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.957538 (+  3665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.957703 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486569728}
I20260709 13:02:24.962721  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:24.963289  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:24.952490 10972 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.965221  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:24.965775  8892 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.967308  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:24.935634 10960 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:24.972558  8209 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:24.975838  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:24.986402  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.023728  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.964546 10972 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.968777 11035 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:24.971699 10835 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:24.968305 10950 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.050046  8892 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:25.053267  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:24.957446 11088 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:02:24.973348 10965 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:24.977523 11053 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:24.980794 11051 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:25.038341 11054 raft_consensus.cc:3055] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:25.046693 11155 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:25.046501 10972 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.069720  8209 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:25.054543 11070 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.050309 11035 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.051774 10835 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:25.065514 10838 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.061225 10748 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:25.073944 11155 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:25.027602 10898 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:02:25.097525 10748 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:25.046490 10990 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:02:25.062095 11053 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:25.067590 11051 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.068544 11054 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:25.097819 11113 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:25.072732 10965 raft_consensus.cc:697] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:25.087821 11035 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.103085  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:25.106102  8209 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:25.104255  8216 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:25.095481 10835 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.109908  8216 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:25.110450 10748 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.085354 10861 consensus_queue.cc:1059] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:25.104014 11051 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.101697 11053 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:25.115780 11123 log.cc:927] Time spent T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:02:25.099046 10838 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:25.132606 11149 log.cc:927] Time spent T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:02:25.123054 11155 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:25.137497 10965 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.145985 10838 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:25.147035  8216 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:02:25.148931  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.148680 11091 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:25.149560  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.153896  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:25.154919  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:25.155730  8331 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:25.156056  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:25.156598 11058 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.157248  8360 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 8. Ops: []
I20260709 13:02:25.158022  8331 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:25.158294  8360 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:25.160583 10642 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:25.161106 10898 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:25.162690 11069 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:25.191352 11069 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:25.192286 11069 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:25.193311 11069 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.155153  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:25.194546  8367 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:25.195796  8367 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:25.196058 11120 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.163641 10986 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:22.443714  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:25.163607  8331 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:25.198236  8367 raft_consensus.cc:1217] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Deduplicated request from leader. Original: 4.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:02:25.198725  8367 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:25.199244  8331 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:25.199714  8367 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:25.200529  8331 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:25.201002  8367 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:25.202251 10898 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.203032 10898 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:25.203596 10898 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:25.166113  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.205169 10835 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.205858 11137 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.167229 11113 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:25.193418  8114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48060 (request call id 277) took 18403 ms (client timeout 15000 ms). Trace:
W20260709 13:02:25.182730 11159 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:25.183911  8217 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.189131  8184 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:25.208848  8367 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:25.177973  8889 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:25.227519  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:25.173523 11051 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.220920  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:25.233618  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 44577.6us
I20260709 13:02:25.234264  8363 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:25.234375  8184 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:25.236758  8184 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:25.248978  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:25.210803  8114 rpcz_store.cc:269] 0709 13:02:06.790154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.868591 (+ 78437us) service_pool.cc:224] Handling call
0709 13:02:25.193315 (+18324724us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:20.665773 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:20.666405 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:20.666456 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:02:20.666476 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:20.667619 (+  1143us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:20.667695 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:20.667727 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:20.668276 (+   549us) tablet.cc:701] Row locks acquired
0709 13:02:20.668324 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:02:20.668487 (+   163us) write_op.cc:270] Start()
0709 13:02:20.668637 (+   150us) write_op.cc:276] Timestamp: P: 1783602140668423 usec, L: 0
0709 13:02:20.668657 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:20.682396 (+ 13739us) log.cc:844] Serialized 2416 byte log entry
0709 13:02:21.580432 (+898036us) op_driver.cc:464] REPLICATION: finished
0709 13:02:21.819783 (+239351us) write_op.cc:301] APPLY: starting
0709 13:02:21.819879 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:21.820076 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:21.820215 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:21.821165 (+   950us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:21.821448 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:02:21.821492 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:21.821800 (+   308us) log.cc:844] Serialized 53 byte log entry
0709 13:02:21.821997 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:21.841524 (+ 19527us) write_op.cc:454] Released schema lock
0709 13:02:21.856864 (+ 15340us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:21.911834 (+ 54970us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:21.911870 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6917504,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":239066,"apply.run_cpu_time_us":3477,"apply.run_wall_time_us":66938,"num_ops":6,"prepare.queue_time_us":1032794,"prepare.run_cpu_time_us":20212,"prepare.run_wall_time_us":356772,"raft.queue_time_us":215336,"raft.run_cpu_time_us":13907,"raft.run_wall_time_us":152078,"replication_time_us":895639,"thread_start_us":1378943,"threads_started":4,"wal-append.queue_time_us":372343,"wal-append.run_cpu_time_us":14671,"wal-append.run_wall_time_us":1667136}]]}
I20260709 13:02:25.264676  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.245700 10945 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.245411 11113 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.238807 11080 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:25.218741 10972 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.223160 10986 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:02:25.220544 11050 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:02:25.247583 11003 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:25.259366 11037 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.274483  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.235730 11120 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:02:25.135747 11054 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:25.238356 11155 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:02:25.267673 11119 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.267165 11091 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:25.275612 10945 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.275499 10733 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:25.276829 11080 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:25.289256  8184 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.286340 10838 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.308187 10820 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:02:25.316032  8362 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:02:25.317454  8362 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:02:25.292310 10945 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.299893 11080 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.297617 10733 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.290269 10998 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:25.302579 10748 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:25.327953  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.333406  8894 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:25.335793 10838 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:25.341674 11137 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:25.333139  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1100) took 1120 ms. Trace:
I20260709 13:02:25.350816  8895 rpcz_store.cc:276] 0709 13:02:24.212516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.236459 (+ 23943us) service_pool.cc:224] Handling call
0709 13:02:25.332935 (+1096476us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54004a15d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:25.333080 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461887744}
I20260709 13:02:25.371088  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:25.372354  8362 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:25.373832  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:25.375447 10748 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:25.376406 10951 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.376792 10951 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:25.377102 10838 consensus_queue.cc:1059] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:25.377707  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:25.378225 10951 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.332288 10733 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.380961  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:25.352674 10835 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:25.396075  8358 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:25.362785 10998 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:25.358922 11032 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:02:25.385465 11133 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.386444 11051 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:25.402668 11119 consensus_queue.cc:1059] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:02:25.414374 11119 raft_consensus.cc:3055] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:25.414713  8359 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:25.365404 11035 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.420729  8214 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:25.425863 11113 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.426651 11053 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.407101 11133 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:25.429664 11133 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:25.433754  8360 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:25.436506  8864 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.456846  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.458559  8362 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.487948  8864 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.489692  8864 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:25.491438  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:25.506147  8864 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:25.506822  8365 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:25.507836  8864 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:25.508559  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.508972  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.506280  8360 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:25.414758 11119 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:25.511104  8360 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:25.513144  8360 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:25.430835  8210 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:25.442267 11053 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:25.446667 11081 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.436785 10957 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.505231 11071 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.486559 11113 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:25.520236  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 444582us
I20260709 13:02:25.514405  8360 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.423202 11120 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:02:25.549817  8360 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.514876 11133 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:25.549026  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 183009us
I20260709 13:02:25.429987 11080 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:25.561915  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.562318  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.562551  8358 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:25.516423 11141 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:02:25.565177  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 450193us
I20260709 13:02:25.511114 11155 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:25.566823  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:25.569728  8292 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.575631  8360 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:02:25.576285  8360 pending_rounds.cc:85] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 6
I20260709 13:02:25.576565  8360 pending_rounds.cc:107] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:25.576872  8360 raft_consensus.cc:2889] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.513365 10945 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.561419 10898 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.570441 10990 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.587070  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1116) took 1056 ms. Trace:
I20260709 13:02:25.592749  8894 rpcz_store.cc:276] 0709 13:02:24.530899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.531029 (+   130us) service_pool.cc:224] Handling call
0709 13:02:25.333067 (+802038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.343294 (+ 10227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.586867 (+243573us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54004a15d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:25.587007 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844697856}
I20260709 13:02:25.588609  8292 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:25.549316 11081 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.573010 11071 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:25.613492  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 104636us
I20260709 13:02:25.559199 11113 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.563138 10957 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.571342 11172 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:02:25.578887 11034 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
W20260709 13:02:25.639410 11164 log.cc:927] Time spent T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 13:02:25.639206 11169 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:25.661918 10957 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:25.661973 11113 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:25.640340 11084 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:25.641040 10990 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:25.640993 11180 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:25.600371 10898 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:25.674772  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 96357.2us
I20260709 13:02:25.680689  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.681113  8863 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:25.640868 11145 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:02:25.589565 11119 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.664278 11178 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.689168  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.689790  8292 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:25.674221 11177 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:25.663938 11084 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:25.664148 10945 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:25.697680  8284 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.697963  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.693262  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.695502  8364 raft_consensus.cc:2410] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:25.690690  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.670567 10998 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:25.685207  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:25.672123  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:25.702490  8291 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 3.
I20260709 13:02:25.681963 11180 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:25.700100  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.710995  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.702904  8293 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:25.703358  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.703742  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:25.679500 11142 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:25.715058  8285 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:25.715740  8288 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.687006 11035 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:25.727375  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.731879  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.694455 11120 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.703213 11084 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.719311 11037 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.697268 11176 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:25.718704 11119 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:25.741683  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 61095.4us
I20260709 13:02:25.793324  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:25.794430  8286 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:25.821909  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.719621 11180 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.696756 10733 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.855495  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.853358  8288 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.859879  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:25.871094  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.856977  8284 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
W20260709 13:02:25.793079 11171 log.cc:927] Time spent T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:02:25.879907  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.908062  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:25.909289  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.910437  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 229498us
I20260709 13:02:25.911197  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:25.737737 11181 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:02:25.915040  8209 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:25.788923 11178 consensus_queue.cc:1059] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 13:02:25.728489 11142 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.912178  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.872239 11185 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:25.854797 11177 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:25.746464 11120 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.918586  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.903244 11071 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:25.928840  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:25.822922 11037 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:25.932329  8288 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:25.936082  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:25.945410  8285 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.934243  8286 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:25.913993 11184 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.914819 11080 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:25.949352  8286 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:25.917783 10998 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.994160  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.919713 10990 raft_consensus.cc:697] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:26.001284  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 141537us
I20260709 13:02:26.003978  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:25.853207 11176 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:25.933236 11032 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.020671  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:26.021390  8895 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.022737  8896 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:02:26.010006  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.005230  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 61339.8us
I20260709 13:02:26.005618  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:26.012145  8890 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.034435  8897 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.014700  8289 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:25.920955 11081 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:02:25.930456 11189 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:26.034014  8286 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 8. Ops: []
I20260709 13:02:25.999868 10835 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.004992 11185 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:26.059804  8890 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:26.016649 11141 consensus_queue.cc:1059] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:02:25.941963 11177 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.018047 10998 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:26.006803 11184 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.027520 10898 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:26.038815 11071 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:26.040584 11032 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.445096 11032 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:26.433862 11035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.018s	sys 0.035s
W20260709 13:02:26.445983 11035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.019s	sys 0.035s
W20260709 13:02:26.254454 11187 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 13:02:26.043833 11197 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:26.048651 11081 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.355257 10733 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:26.259760 11176 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:26.232394 11198 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.265262 11196 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:26.441043 11133 consensus_meta.cc:287] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.876s	user 0.005s	sys 0.005s
I20260709 13:02:26.211400 11201 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.367627 11037 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:26.311509 11183 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.184s
I20260709 13:02:26.047463 11189 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.465237 11120 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:26.486232 11205 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.483534 11142 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:26.258462 10990 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.572113  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:26.206463  8893 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:26.645076  8893 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:26.577922  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.582175  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.586825  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1517) took 4971 ms. Trace:
W20260709 13:02:26.591396  8285 consensus_meta.cc:287] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.000s
I20260709 13:02:26.597172  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:26.646435  8217 rpcz_store.cc:276] 0709 13:02:21.615109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.671133 (+1056024us) service_pool.cc:224] Handling call
0709 13:02:24.632573 (+1961440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.226484 (+593911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.667474 (+440990us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400377dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:26.586220 (+918746us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400377dd0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:26.586569 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5780802176}
I20260709 13:02:26.647739  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:26.648763  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1627) took 1721 ms. Trace:
I20260709 13:02:26.649029  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:26.652529  8893 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:02:26.653009  8893 pending_rounds.cc:85] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 8
I20260709 13:02:26.653275  8893 pending_rounds.cc:107] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:02:26.653652  8893 raft_consensus.cc:2889] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:26.599455  8259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 1.766s (SENT) [suppressed 34 similar messages]
I20260709 13:02:26.599720  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:26.601089  8289 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:26.601369  8292 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:26.602465  8331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.044s	sys 0.103s
W20260709 13:02:26.602463  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.018s	sys 0.013s
W20260709 13:02:26.604269  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.605652  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2083) took 1041 ms. Trace:
I20260709 13:02:26.538139 11071 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:26.544656 11180 consensus_meta.cc:287] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.002s
I20260709 13:02:26.530303 11184 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:26.710685 11180 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.712548 10642 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:26.713438 10642 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.542320 11189 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:26.739529  8287 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.513671 11205 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.485260 11035 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.523397 11119 consensus_meta.cc:287] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.000s
I20260709 13:02:26.754901  8284 raft_consensus.cc:2410] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:26.756904  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:26.757618  8284 raft_consensus.cc:2410] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:26.757758 11035 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.758479  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2061) took 2234 ms. Trace:
I20260709 13:02:26.758912  8365 rpcz_store.cc:276] 0709 13:02:24.524231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.190718 (+666487us) service_pool.cc:224] Handling call
0709 13:02:25.191008 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.507211 (+316203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.757996 (+1250785us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54001540d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:26.758323 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726238976}
I20260709 13:02:26.759727 10998 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:26.760373 11205 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:26.761010  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:26.519889 11084 consensus_meta.cc:287] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.702s	user 0.006s	sys 0.001s
W20260709 13:02:26.761934  8364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2057) took 2259 ms (client timeout 2253 ms). Trace:
I20260709 13:02:26.762939 11084 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:26.762624  8364 rpcz_store.cc:269] 0709 13:02:24.502942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.628976 (+126034us) service_pool.cc:224] Handling call
0709 13:02:26.761512 (+2132536us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54004619d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:26.761735 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451632000}
I20260709 13:02:26.767521  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:26.504405 11207 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:02:26.769034 11207 consensus_queue.cc:1243] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer 4a50f39e2d8e4886a79849938f2272a6 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:26.773320 10946 raft_consensus.cc:3055] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:26.773852 10946 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:26.774971  8290 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
W20260709 13:02:26.748574  8330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.020s	sys 0.039s
I20260709 13:02:26.487073 11196 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:26.751690 10965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.007s	sys 0.002s
W20260709 13:02:26.788642 10965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.007s	sys 0.003s
I20260709 13:02:26.788926  8893 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:26.790413 11196 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:26.533581 11177 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:26.613281 10841 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:26.616070  8363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2058) took 2111 ms (client timeout 2089 ms). Trace:
W20260709 13:02:26.792032  8363 rpcz_store.cc:269] 0709 13:02:24.504184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.622178 (+117994us) service_pool.cc:224] Handling call
0709 13:02:26.615524 (+1993346us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b540043c454. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:26.615795 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338248960}
I20260709 13:02:26.793488  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:26.617312  8366 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:02:26.620034  8895 consensus_meta.cc:287] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.598s	user 0.017s	sys 0.036s
I20260709 13:02:26.620540 11113 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:26.795104  8361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1617) took 2598 ms (client timeout 1766 ms). Trace:
I20260709 13:02:26.795475  8895 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:26.795764 11113 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.798399 11113 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:26.758383 11188 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.633049 11081 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.799170 11188 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.625454 10951 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.803385 11200 raft_consensus.cc:3055] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:26.689126  8331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.044s	sys 0.103s
W20260709 13:02:26.803287 11220 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:02:26.689481  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.018s	sys 0.013s
I20260709 13:02:26.656742  8362 rpcz_store.cc:276] 0709 13:02:24.926754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.385461 (+458707us) service_pool.cc:224] Handling call
0709 13:02:25.385678 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.458976 (+ 73298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.648272 (+1189296us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b540043ba54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:26.648578 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167291136}
I20260709 13:02:26.801900 11188 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:26.806358  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 798851us
I20260709 13:02:26.140247 11185 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.693266  8285 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:26.725922  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:26.713806 11180 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:26.464540 11197 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.193933  8897 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:26.163168  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:26.738140  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 138979us
I20260709 13:02:26.739445  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:26.064224 10835 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.737862 11032 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.655871  8360 rpcz_store.cc:276] 0709 13:02:25.564198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.584065 (+ 19867us) service_pool.cc:224] Handling call
0709 13:02:25.584434 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.584776 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.584816 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.585253 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.664267 (+ 79014us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:25.664306 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.664372 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.605092 (+940720us) raft_consensus.cc:1685] finished
0709 13:02:26.605148 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.605415 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6573,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":14785,"thread_start_us":78733,"threads_started":1,"wal-append.queue_time_us":150721}
I20260709 13:02:26.753181  8894 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:26.775216 10946 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.484473 11198 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:26.761907  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1638) took 1094 ms. Trace:
W20260709 13:02:26.780128  8330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.021s	sys 0.039s
W20260709 13:02:26.751711  8291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.023s	sys 0.027s
I20260709 13:02:26.760260 11035 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:26.496578 11201 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.791168 10642 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:26.796345 10363 raft_consensus.cc:3055] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:02:26.621456  8288 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.001s	sys 0.001s
I20260709 13:02:26.799290 11081 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:26.803894 11200 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:26.106158  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 92816.8us
W20260709 13:02:26.805940 11174 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.168s	user 0.010s	sys 0.028s
I20260709 13:02:26.207605  8889 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:02:26.687791  8863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.011s	sys 0.016s
I20260709 13:02:26.807675  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:26.791893 10841 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:26.693717  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.797854  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2082) took 1234 ms. Trace:
I20260709 13:02:27.303184  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:27.190028  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.810046  8287 raft_consensus.cc:2410] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:02:26.819887  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 67595.3us
I20260709 13:02:26.858896  8363 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.765966 11084 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:27.308575  8365 rpcz_store.cc:276] 0709 13:02:25.667563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.760538 (+1092975us) service_pool.cc:224] Handling call
0709 13:02:26.761834 (+  1296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.310669  8212 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:26.819113  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 834) took 1860 ms. Trace:
I20260709 13:02:26.817695  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:27.328718  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 75695.4us
W20260709 13:02:27.327044  8285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 2054) took 1377 ms (client timeout 1714 ms). Trace:
I20260709 13:02:27.310839  8358 rpcz_store.cc:276] 0709 13:02:25.563255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.563380 (+   125us) service_pool.cc:224] Handling call
0709 13:02:26.795694 (+1232314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.796131 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.796158 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.796222 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:26.796274 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.796348 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.797578 (+  1230us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000c6550. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:26.797707 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834670848}
W20260709 13:02:27.308291  8361 rpcz_store.cc:269] 0709 13:02:24.196725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.196825 (+   100us) service_pool.cc:224] Handling call
0709 13:02:26.794687 (+2597862us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54000c6554. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:26.794897 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778306944}
W20260709 13:02:27.311091  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.004s
W20260709 13:02:27.327615  8291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.023s	sys 0.036s
W20260709 13:02:27.330585  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.009s	sys 0.004s
I20260709 13:02:26.828043 11003 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:26.824153  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:26.791878 11070 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:27.331323  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.827117  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:27.271275 10820 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.334534  8362 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:27.329249  8285 rpcz_store.cc:269] 0709 13:02:25.935672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.935857 (+   185us) service_pool.cc:224] Handling call
0709 13:02:27.306972 (+1371115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:27.335238  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.307991 10363 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:26.920236 10972 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:26.806759 11069 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:26.806774 11188 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.828248 10928 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:27.347297 11097 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.189837 11204 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:26.856634 11113 consensus_queue.cc:1059] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.485s
I20260709 13:02:27.332638 11003 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:27.352816  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:27.354421  8890 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:02:27.350397  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.352075  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.817955 11222 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.531s
I20260709 13:02:27.347735  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:27.365288  8365 raft_consensus.cc:2410] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:27.327025  8898 rpcz_store.cc:276] 0709 13:02:24.958649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.960571 (+  1922us) service_pool.cc:224] Handling call
0709 13:02:24.960834 (+   263us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:24.961184 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.961210 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:24.961573 (+   363us) log.cc:844] Serialized 52 byte log entry
0709 13:02:25.115446 (+153873us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.224358 (+108912us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b480002f058. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f01176aa1 00007f2f0116db37 00007f2f0116d9ca 00007f2f0126526f 00007f2f01264f37 00007f2f0127955c 00007f2f01279508 00007f2f01279488 00007f2f01279443 00007f2f012786ec 00007f2f001a2a96
0709 13:02:26.652761 (+1428403us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.653206 (+   445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.653336 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.817573 (+164237us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b2400316fb8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef8fe69c4 00007f2ef8fe4acb 00007f2ef919fdc9 00007f2ef919fa55 00007f2ef919efb0 00007f2efbe15488 00007f2efbe15be8 00007f2efbded398 00007f2efbde876a 00007f2efbde7bb6
0709 13:02:26.818649 (+  1076us) raft_consensus.cc:1685] finished
0709 13:02:26.818673 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.818899 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1777624,"prepare.queue_time_us":1581679,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2750,"raft.queue_time_us":8624,"raft.run_cpu_time_us":2360,"raft.run_wall_time_us":309005,"spinlock_wait_cycles":153182720,"thread_start_us":87514,"threads_started":1,"wal-append.queue_time_us":163959}
I20260709 13:02:27.370137  8209 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:27.369657  8213 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:27.375664  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:27.357434 10972 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.350944 11097 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.381265  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2086) took 1369 ms. Trace:
I20260709 13:02:27.365756  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1134) took 1360 ms. Trace:
I20260709 13:02:27.351485 10820 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.385898  8365 rpcz_store.cc:276] 0709 13:02:26.008871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.332064 (+1323193us) service_pool.cc:224] Handling call
0709 13:02:27.378143 (+ 46079us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:27.376228 11099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.005s	sys 0.018s
W20260709 13:02:27.459728 11158 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 2.250s	user 0.006s	sys 0.018s
I20260709 13:02:27.372247 11096 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:27.470863  8896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 837) took 1339 ms (client timeout 1547 ms). Trace:
W20260709 13:02:27.471421  8896 rpcz_store.cc:269] 0709 13:02:26.006065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.051596 (+ 45531us) service_pool.cc:224] Handling call
0709 13:02:27.342162 (+1290566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.471292 10972 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.385118 11069 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.465881  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:27.466296 11099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.005s	sys 0.021s
I20260709 13:02:27.362239 11032 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.476691  8215 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:27.467002  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1140) took 1331 ms. Trace:
W20260709 13:02:27.479609  8863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.566s	user 0.017s	sys 0.021s
I20260709 13:02:27.379941 11186 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:27.479754  8897 rpcz_store.cc:276] 0709 13:02:26.005319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.005418 (+    99us) service_pool.cc:224] Handling call
0709 13:02:27.334415 (+1328997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.368520 10928 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:27.469492  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 89621.3us
I20260709 13:02:27.460068 11035 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.484508  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:27.485199  8288 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.419s	user 0.001s	sys 0.012s
I20260709 13:02:27.485821 11003 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.486606 11032 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:27.488336 11185 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:27.489076 10835 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.489776 10965 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:27.490561 11037 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:27.491232 11197 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:27.485217  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2071) took 2948 ms. Trace:
I20260709 13:02:27.482641 11186 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:27.462947 11188 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.372537 10363 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.496546  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:27.488404  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 831) took 2553 ms. Trace:
I20260709 13:02:27.502373 11181 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.503134 11084 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.504683  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.372509 11200 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.542829 10861 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.543129  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:27.543478 10986 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:27.545209  8184 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:27.549573 11081 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:27.414928  8889 rpcz_store.cc:276] 0709 13:02:26.002529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.006137 (+  3608us) service_pool.cc:224] Handling call
0709 13:02:26.048917 (+ 42780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.325594 (+1276677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.361141 (+ 35547us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:27.554148  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.554311  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2085) took 1989 ms. Trace:
I20260709 13:02:27.562674 10838 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.563237  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2275) took 1846 ms. Trace:
I20260709 13:02:27.461544 11204 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.521914  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:27.521219 10946 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:27.594038  8367 rpcz_store.cc:276] 0709 13:02:24.536225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.252458 (+716233us) service_pool.cc:224] Handling call
0709 13:02:25.252681 (+   223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.252974 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.252996 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.266978 (+ 13982us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.379774 (+112796us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b18003fc580. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1 00007f2efc208a0f
0709 13:02:25.515204 (+135430us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:25.515241 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.515318 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.772134 (+1256816us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:27.484838 (+712704us) raft_consensus.cc:1685] finished
0709 13:02:27.484857 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.485030 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10597,"spinlock_wait_cycles":14517888,"thread_start_us":135257,"threads_started":1,"wal-append.queue_time_us":312263}
I20260709 13:02:27.590344  8363 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:27.481736 10748 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:27.624230  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 265617us
W20260709 13:02:27.626142  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 280091us
I20260709 13:02:27.541152  8893 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
W20260709 13:02:27.654369  8363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2089) took 1641 ms (client timeout 1534 ms). Trace:
I20260709 13:02:27.621192  8331 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:27.624444  8216 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:27.649482  8896 raft_consensus.cc:2410] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:02:27.634588 11185 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.654767  8363 rpcz_store.cc:269] 0709 13:02:26.009637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.793107 (+783470us) service_pool.cc:224] Handling call
0709 13:02:27.651210 (+858103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.658833 10928 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.659657 11186 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.661084 11054 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:27.661315 11186 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.662345  8892 raft_consensus.cc:2368] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10.
I20260709 13:02:27.663148  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 537) took 3216 ms. Trace:
I20260709 13:02:27.663443  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:27.646656  8358 rpcz_store.cc:276] 0709 13:02:25.565303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.331568 (+1766265us) service_pool.cc:224] Handling call
0709 13:02:27.358123 (+ 26555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.497909 (+139786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.497939 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.498544 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.524089 (+ 25545us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:27.524134 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.554020 (+ 29886us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.554064 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:27.554096 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.554236 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30578,"raft.queue_time_us":31917,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":151,"thread_start_us":25140,"threads_started":1,"wal-append.queue_time_us":25485}
I20260709 13:02:27.664559  8897 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:27.647028 11222 consensus_queue.cc:1243] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:27.636567  8891 rpcz_store.cc:276] 0709 13:02:24.934577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.951573 (+ 16996us) service_pool.cc:224] Handling call
0709 13:02:24.955314 (+  3741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.955670 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.955697 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.956197 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.064863 (+108666us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:25.068317 (+  3454us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.560699 (+492382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.565852 (+  5153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.381429 (+1815577us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b2400316fb8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef8fe69c4 00007f2ef8fe4acb 00007f2ef919fdc9 00007f2ef919fa55 00007f2ef919f09d 00007f2efbdd110e 00007f2efbde888c 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221
0709 13:02:27.487898 (+106469us) raft_consensus.cc:1685] finished
0709 13:02:27.487990 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.488167 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353495,"prepare.queue_time_us":1586271,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":8097,"raft.queue_time_us":339866,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":15792,"spinlock_wait_cycles":40174848,"thread_start_us":270982,"threads_started":2,"wal-append.queue_time_us":162840}
W20260709 13:02:27.667104  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.646185 11069 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:27.622488 11096 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.638643 11035 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.664100  8366 rpcz_store.cc:276] 0709 13:02:24.448311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.740877 (+292566us) service_pool.cc:224] Handling call
0709 13:02:26.616676 (+1875799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.794325 (+177649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.662894 (+868569us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540043c450. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:27.663079 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4315158272}
I20260709 13:02:27.675800  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:27.657907 10841 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.683503  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:27.681151  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 62415.4us
I20260709 13:02:27.646023 11180 consensus_queue.cc:1059] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:27.686838 10838 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.687359  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:27.687712 11069 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:27.674829 11084 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.679270 10748 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.688937  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:27.689587 11229 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:27.674486 11037 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.672963 10861 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.642974 10965 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.721719 10965 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:27.722240 10965 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.722680  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:27.722764 10965 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.723349  8358 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:27.723687 10748 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:27.690186  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 145207us
W20260709 13:02:27.688982 11224 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:02:27.691751 11035 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:27.692387  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:27.726006  8258 leader_election.cc:336] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.555s (SENT)
W20260709 13:02:27.692523  8183 connection.cc:256] RPC call timeout handler was delayed by -1.112843770999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:02:27.647358  8291 rpcz_store.cc:276] 0709 13:02:25.716560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.716702 (+   142us) service_pool.cc:224] Handling call
0709 13:02:25.716939 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.717122 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:25.917654 (+200532us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.380754 (+1463100us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.468421 (+ 87667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.475730 (+  7309us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:27.481837 (+  6107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.484152 (+  2315us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.563165 (+ 79013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1507,"prepare.queue_time_us":905928,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":99,"raft.queue_time_us":11108,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9903,"thread_start_us":1596922,"threads_started":2,"wal-append.queue_time_us":841762}
I20260709 13:02:27.705446  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:27.705958  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.706264  8893 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:27.707441 11204 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:27.654493 11181 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.708205  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:27.705837  8896 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:27.718525 11201 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:27.668896 11228 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.236s
I20260709 13:02:27.693478 11137 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:02:27.682365 10928 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:27.719955 10861 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.724211  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:27.729086  8366 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:27.739740 11230 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:27.666468 11185 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.703366 11069 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.706300 11097 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:27.669154 10986 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.755251  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:27.756492  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:27.756668 10986 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.757023  8363 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:27.759122 10748 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:27.759578 10748 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:27.760496 10748 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.761672 10748 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.762133 10861 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.762717 10861 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.763000 11204 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:27.763401 11204 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:27.764670 10861 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.764804 11037 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.765568  8214 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:27.766472 11185 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:27.767136  8892 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:27.768155 11096 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:27.746429  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2056) took 1707 ms. Trace:
I20260709 13:02:27.713018  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:27.768890  8889 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:27.749797 11099 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.751839  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:27.753602 10838 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.754261 11069 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:27.754282  8367 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:27.758550  8896 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:27.764473 11204 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.742791  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:27.771992  8362 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
W20260709 13:02:27.784718  8362 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2087) took 1775 ms (client timeout 1999 ms). Trace:
W20260709 13:02:27.745755  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 52740.1us
I20260709 13:02:27.779573  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:27.785072  8362 rpcz_store.cc:269] 0709 13:02:26.009160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.806546 (+797386us) service_pool.cc:224] Handling call
0709 13:02:27.784665 (+978119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.786293  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:27.786700  8366 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:27.782339 11099 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.787480 11034 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:27.788484  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 71736.5us
W20260709 13:02:27.789206  8258 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.722s (SENT)
I20260709 13:02:27.788929 11034 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.789623  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:27.790302 10946 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:27.791539 11226 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.414s	user 0.002s	sys 0.000s
I20260709 13:02:27.763401 11181 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:27.793959 11034 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.771273  8288 rpcz_store.cc:276] 0709 13:02:26.038593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.038718 (+   125us) service_pool.cc:224] Handling call
0709 13:02:26.039000 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.039191 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:27.550243 (+1511052us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.668324 (+118081us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.701096 (+ 32772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.709596 (+  8500us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:27.718065 (+  8469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.746247 (+ 28182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.746378 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33530,"prepare.queue_time_us":591067,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":95,"raft.queue_time_us":35063,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"thread_start_us":1571741,"threads_started":2,"wal-append.queue_time_us":150333}
I20260709 13:02:27.795348  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2088) took 1785 ms. Trace:
I20260709 13:02:27.795698  8361 rpcz_store.cc:276] 0709 13:02:26.009403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.342589 (+1333186us) service_pool.cc:224] Handling call
0709 13:02:27.370666 (+ 28077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.489685 (+119019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.489723 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.490245 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.593593 (+103348us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:27.593629 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.593697 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.795123 (+201426us) raft_consensus.cc:1685] finished
0709 13:02:27.795140 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.795266 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1623,"raft.queue_time_us":15784,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":102986,"threads_started":1,"wal-append.queue_time_us":166648}
I20260709 13:02:27.797706 10965 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:27.785388  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 60389.6us
I20260709 13:02:27.798267 11230 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.800426 11230 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:27.801375  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:27.801960  8367 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:27.802881  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:27.803624  8367 raft_consensus.cc:2393] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:27.804662  8358 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:27.805503  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:27.806017  8358 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.809757 11209 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.810415 11209 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.813264 10622 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:27.813772 10622 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.814690 11113 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:27.814998  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:27.815106 11113 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:27.815857 10622 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.816378 10622 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:27.816524  8293 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:27.816149 11113 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.816922 10622 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.817643  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:27.818252  8364 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:27.818406  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:27.819074  8291 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.820109 11145 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.784076 11035 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.821038 11035 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.821422  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 835) took 1815 ms. Trace:
I20260709 13:02:27.821766  8890 rpcz_store.cc:276] 0709 13:02:26.005589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.390728 (+385139us) service_pool.cc:224] Handling call
0709 13:02:27.339574 (+948846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.360524 (+ 20950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.821224 (+460700us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54002b34d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:27.821352 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109240192}
I20260709 13:02:27.822445  8285 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:27.823616 11035 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.824213 11152 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.824698 11152 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.818535 10363 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.827057 11204 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.820570 11145 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.833525 11145 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:27.834420  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 48077.5us
I20260709 13:02:27.834905  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:27.835507  8288 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.836122  8359 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:27.836376  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 493366us
W20260709 13:02:27.838498 11229 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:27.839056 10946 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.839555 11113 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.839573 10946 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:27.819083 11245 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.841814 10946 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.765585 11188 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:27.842880  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:27.843025  8291 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
W20260709 13:02:27.843713  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.841548 11245 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:27.804489  8184 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:27.845165  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:28.071882  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.106320  8289 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:02:27.984275  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.892196  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:27.853022  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:28.141178  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 305925us
I20260709 13:02:28.016022  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:27.879765  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.850975  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2084) took 2286 ms. Trace:
I20260709 13:02:28.147495  8290 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:27.915319  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 130111us
I20260709 13:02:27.885115  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:28.148010  8288 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:28.148394  8361 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.141968  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:27.845204  8331 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.145567  8360 rpcz_store.cc:276] 0709 13:02:25.564745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.334263 (+1769518us) service_pool.cc:224] Handling call
0709 13:02:27.353728 (+ 19465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.589182 (+235454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.589211 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.638959 (+ 49748us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.745100 (+106141us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:27.745131 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.745194 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.850772 (+105578us) raft_consensus.cc:1685] finished
0709 13:02:27.850792 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.850919 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14359,"raft.queue_time_us":19277,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":185301,"threads_started":2,"wal-append.queue_time_us":161453}
I20260709 13:02:27.846616  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:27.804386  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.152741  8367 raft_consensus.cc:2410] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:02:28.154112  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 309138us
I20260709 13:02:28.154328  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.155305  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1630) took 3074 ms. Trace:
I20260709 13:02:28.156090  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.158893  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:27.820358 11240 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.157147  8215 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
W20260709 13:02:28.155026  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 252737us
I20260709 13:02:28.159408  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.162585  8292 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:28.156280  8359 rpcz_store.cc:276] 0709 13:02:25.080489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.415627 (+335138us) service_pool.cc:224] Handling call
0709 13:02:25.415947 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.836493 (+2420546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.141939 (+305446us) spinlock_profiling.cc:243] Waited 2.42 s on lock 0x7b5400433d54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:28.155252 (+ 13313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5567471872}
I20260709 13:02:27.845268 11145 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.159984  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 355723us
W20260709 13:02:28.108886 11155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.008s	sys 0.012s
I20260709 13:02:28.156280  8331 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.161705  8285 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:28.162897  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.162495  8213 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:27.877367 10972 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.167498  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:27.890038 11069 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:28.168123  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.850507 11236 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:28.168599  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.170467  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:28.170506  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.161734  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.173566  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.173977  8360 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:28.175840  8293 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:28.176070  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:28.168816 11155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.013s	sys 0.012s
I20260709 13:02:28.180701  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.164453 11035 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.181643  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.188884  8218 raft_consensus.cc:2393] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:28.161882 11152 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:28.184798  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.187289  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.164942 11188 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:28.194337 11188 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.194789 11183 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:28.195065  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.173024  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:28.195518  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 406566us
I20260709 13:02:28.190040  8287 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:27.915242 11051 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.255s
I20260709 13:02:28.193328  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.195755  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.208783  8362 raft_consensus.cc:2393] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:28.194274  8360 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:28.210662  8284 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:28.211119  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.177928 10622 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.211881  8218 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:28.212074  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.214587  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.215337  8213 raft_consensus.cc:2410] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:02:28.216663  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.159057 10363 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:02:28.212827  8331 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.209697  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.208288  8259 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:28.219717  8332 connection.cc:256] RPC call timeout handler was delayed by -1.2546304489999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:02:28.220009  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:28.189110 11248 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.181929 11230 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:28.221923  8332 connection.cc:256] RPC call timeout handler was delayed by -1.242076169000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:02:28.189136 11035 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.182420 11209 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.194806 11188 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.221858  8359 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
W20260709 13:02:28.228969  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 52507.7us
I20260709 13:02:28.230010  8367 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:28.225682  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.216135 11099 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.239884  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.178272 11240 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.196113 11003 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.230926  8898 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.229600  8331 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.239557  8288 raft_consensus.cc:2410] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:02:28.179013 11145 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:28.225867 11230 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.245537  8293 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:28.250005  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 86139.3us
I20260709 13:02:28.267500  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.254691 11069 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.254868 11245 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:28.255272  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.255393 11088 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.245169 11248 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.258008  8257 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:28.258616  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:28.259064 11236 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:28.259639  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1006085220000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2812s for a response
I20260709 13:02:28.245435  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.230746  8218 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:28.265849  8361 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:28.230659 11035 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.252763  8367 raft_consensus.cc:1240] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:28.268289  8285 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:28.272313  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:28.274374 10820 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.275655  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.278717 10965 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:28.269927 11037 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:28.230557 11054 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:28.280339  8258 leader_election.cc:336] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.004s (SENT)
I20260709 13:02:28.281641  8892 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:28.220464 11183 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.304788  8363 raft_consensus.cc:2410] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:28.271025 11230 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.291580  8288 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:28.292155  8289 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:28.309172  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.306533  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.306533  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:28.288259 11070 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.303041  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:28.312137  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 121224us
W20260709 13:02:28.305467  8364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1637) took 2642 ms (client timeout 1724 ms). Trace:
W20260709 13:02:28.316655  8364 rpcz_store.cc:269] 0709 13:02:25.662791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.767077 (+1104286us) service_pool.cc:224] Handling call
0709 13:02:28.305309 (+1538232us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000ad2d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:28.305406 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2416057728}
I20260709 13:02:28.318220  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.318149  8890 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:28.320521 11236 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:28.321453  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.318847  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.330402  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:28.331027  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.331780  8287 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:28.317886  8285 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:28.293443 10965 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.293260 11037 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.307144 10733 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:28.305706 11248 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.334830  8331 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.331558  8209 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:28.336185 11037 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:28.341073  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:28.341630  8890 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.343704  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.344172  8364 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:28.346551  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.347869  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:28.348918  8211 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.322710 11099 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:28.353519  8358 consensus_meta.cc:287] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.000s
I20260709 13:02:28.353823  8358 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:28.355065  8359 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:28.302649 11054 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.322582 11070 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.336309 10965 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.339131 10733 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.358196  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.359690  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:28.360538  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 54145.2us
I20260709 13:02:28.354806  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:28.349866 11209 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:28.363029 11209 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.363396 11209 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:28.365083  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 95567.3us
I20260709 13:02:28.366286  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.367835  8364 raft_consensus.cc:2410] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:28.375871  8215 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:28.371833  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:28.379163  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:28.371382  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:28.381386  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.365091 10733 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:28.367449 11236 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:28.383549  8288 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:28.384109  8358 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:28.385777  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1133) took 2384 ms. Trace:
I20260709 13:02:28.395293  8212 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:28.390409  8894 rpcz_store.cc:276] 0709 13:02:26.001119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.001701 (+   582us) service_pool.cc:224] Handling call
0709 13:02:26.002027 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.342226 (+1340199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.376852 (+1034626us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400391cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:28.385726 (+  8874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722594560}
I20260709 13:02:28.375334 11113 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:02:28.411128 10944 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:28.411368  8864 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.413043  8892 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:28.413800  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:28.414377  8366 raft_consensus.cc:2376] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7. Re-sending same reply.
I20260709 13:02:28.379783 11099 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:28.417421  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 57635.2us
I20260709 13:02:28.418066 11050 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:28.418498 11050 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.418879 11050 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.420006 11172 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.423462  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.394968 11236 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:28.411165 11254 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:02:28.428745  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:28.434293  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:28.434656 11183 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:28.435267 11183 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:28.435585 11183 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.435889 11183 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.439751 11145 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.441140  8211 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:28.442250  8891 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:28.412951 11137 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.446166  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:28.446501  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.449033  8892 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:28.450564  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1555) took 1749 ms. Trace:
W20260709 13:02:28.450798  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 114146us
I20260709 13:02:28.451006  8210 rpcz_store.cc:276] 0709 13:02:26.675956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.676402 (+   446us) service_pool.cc:224] Handling call
0709 13:02:26.742530 (+ 66128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.340787 (+598257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.340818 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.340880 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:27.340922 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.424744 (+1083822us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400472cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:28.424787 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.424904 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358381440}
I20260709 13:02:28.429840 11236 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.454248 11207 consensus_queue.cc:1059] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:28.455649 11207 raft_consensus.cc:3055] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:28.455976 11207 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:28.456902 11207 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.446450 11145 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.465571  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2090) took 2455 ms. Trace:
I20260709 13:02:28.453841  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:28.458464  8894 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.480423  8890 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:28.470544  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.493712  8364 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:28.468820  8898 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:28.495097  8366 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
W20260709 13:02:28.473829  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 90408.2us
I20260709 13:02:28.458887  8211 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:28.489288  8365 rpcz_store.cc:276] 0709 13:02:26.009873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.483161 (+1473288us) service_pool.cc:224] Handling call
0709 13:02:27.548728 (+ 65567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.725636 (+176908us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:27.984378 (+258742us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.212808 (+228430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.212900 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:28.212969 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.465329 (+252360us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54003188d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:28.465372 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.465507 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":512506,"raft.queue_time_us":21967,"raft.run_wall_time_us":11861,"spinlock_wait_cycles":415152000,"thread_start_us":294100,"threads_started":2,"wal-append.queue_time_us":208497}
I20260709 13:02:28.508164  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.458046 11207 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.466430 11200 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:02:28.459057 11250 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:28.490634 11003 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:28.521926  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 93315.9us
I20260709 13:02:28.522642  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.522922  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.459652 11054 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.446105 11186 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:02:28.464005 11240 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.531507  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.469563 11198 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:28.533025  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.555732  8364 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:28.556347  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1641) took 1005 ms. Trace:
I20260709 13:02:28.556641  8364 rpcz_store.cc:276] 0709 13:02:27.551272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.555130 (+1003858us) service_pool.cc:224] Handling call
0709 13:02:28.555493 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.556108 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.556275 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.557734  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1642) took 1006 ms. Trace:
I20260709 13:02:28.534533  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.521696 10972 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:28.535420 11248 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:28.536549 11037 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:28.537479  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.538220  8217 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:28.539976 11035 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:28.541203  8211 raft_consensus.cc:1240] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:28.470890 10965 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:28.542728  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 89008.9us
I20260709 13:02:28.462677 11137 consensus_queue.cc:1059] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:02:28.547004  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:28.547856 11230 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.548233  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.461611 11145 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:28.536566  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:28.460213 11099 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.559392  8864 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.559829  8358 rpcz_store.cc:276] 0709 13:02:27.551652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.556993 (+1005341us) service_pool.cc:224] Handling call
0709 13:02:28.557251 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.557440 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.557462 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.557512 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:28.557546 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.557592 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.557673 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.563045  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2095) took 1062 ms. Trace:
W20260709 13:02:28.563433  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 166180us
I20260709 13:02:28.624055  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.554188 11232 raft_consensus.cc:3055] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:02:28.563184  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 212361us
I20260709 13:02:28.625092 11232 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:28.582696  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.629719  8366 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
W20260709 13:02:28.600291  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 188324us
I20260709 13:02:28.630663  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:28.602843  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.565366  8894 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:28.533620 11003 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:28.633602  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.565267 11180 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:28.626605  8218 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:28.624298  8359 rpcz_store.cc:276] 0709 13:02:27.500744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.228395 (+727651us) service_pool.cc:224] Handling call
0709 13:02:28.354910 (+126515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.357942 (+  3032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.562846 (+204904us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000677d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:28.562985 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252649728}
I20260709 13:02:28.545554 11050 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:28.629817  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 70508.5us
I20260709 13:02:28.625696  8331 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.663661  8331 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.659503  8365 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:28.660902  8216 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:28.602929 11248 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:28.666980  8209 raft_consensus.cc:2368] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
I20260709 13:02:28.666245  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.668277  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.664502  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.669145  8214 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
W20260709 13:02:28.669746  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.668407  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.671581  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.672178  8211 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:28.673367  8217 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:28.676815  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:28.677549 11113 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.678098 11113 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:28.679962 11113 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.681166 11266 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:28.681639  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:28.682713 11248 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.683272 11035 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:28.670563 11051 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:28.729002 11051 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:28.683444 11050 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.729954 11051 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.670663 11198 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:28.733821 11198 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.734198 11198 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:28.734859  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.701910  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:28.736399 10642 raft_consensus.cc:3055] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:28.736771 10642 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:28.671370 11099 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:28.738440 11099 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.740509  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.741561  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2093) took 1241 ms. Trace:
I20260709 13:02:28.741519  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.741954  8363 rpcz_store.cc:276] 0709 13:02:27.500183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.182161 (+681978us) service_pool.cc:224] Handling call
0709 13:02:28.741375 (+559214us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b54003179d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:28.741507 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218272128}
I20260709 13:02:28.742311  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.742815  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.743459  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.744232  8217 raft_consensus.cc:2410] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:28.744618 11236 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:28.746603 11236 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.747349  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:28.747885  8213 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.748425 10972 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:28.748939 10972 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:28.685369  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 148960us
I20260709 13:02:28.750893  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:28.686249  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1644) took 1133 ms. Trace:
I20260709 13:02:28.751845  8359 rpcz_store.cc:276] 0709 13:02:27.552357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.662446 (+1110089us) service_pool.cc:224] Handling call
0709 13:02:28.674194 (+ 11748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.685810 (+ 11616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.685846 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.685934 (+    88us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:28.685979 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.686047 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.686188 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.754575 11228 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:28.690961 11188 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.755216 11230 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.692757 11037 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:28.661828 11003 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.697857 11054 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:28.757294 11054 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:28.757330  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 57401.6us
I20260709 13:02:28.757761 11054 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.758236  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:28.758498  8184 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.759416  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.759511  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.760486 10944 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.699570  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 72637.6us
I20260709 13:02:28.663714 11180 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.760967 11088 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:28.696830  8863 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:28.761794 11088 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.701419  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 554) took 1150 ms. Trace:
I20260709 13:02:28.727545 11209 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.756893 10965 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:28.698957  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.760402  8184 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.699172 11267 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.761408 11180 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.658427 11204 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:28.762023  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 88921.8us
I20260709 13:02:28.599555 10733 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:28.700572  8358 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:28.743031  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:28.782876  8363 raft_consensus.cc:2368] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5.
I20260709 13:02:28.762560  8367 rpcz_store.cc:276] 0709 13:02:27.550933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.356603 (+805670us) service_pool.cc:224] Handling call
0709 13:02:28.369305 (+ 12702us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.373125 (+  3820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.373158 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.384960 (+ 11802us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.564140 (+179180us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:28.695958 (+131818us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.701093 (+  5135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.701172 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.701217 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:28.701230 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.701359 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4819,"prepare.queue_time_us":129196,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":5035,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":35090,"thread_start_us":210391,"threads_started":2,"wal-append.queue_time_us":263426}
W20260709 13:02:28.771505  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.773525  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1648) took 1219 ms. Trace:
W20260709 13:02:28.752446 11258 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.405s	user 0.009s	sys 0.012s
I20260709 13:02:28.783524  8360 rpcz_store.cc:276] 0709 13:02:27.553620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.757003 (+1203383us) service_pool.cc:224] Handling call
0709 13:02:28.773051 (+ 16048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.773221 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.773254 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.773295 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:28.773329 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.773378 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.773471 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.776813  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:28.740448 11099 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:28.675056 10841 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:28.779568 11264 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.761034 10944 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.779969  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:28.780871  8184 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.781387 10820 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:28.761474 10748 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:28.786710 10945 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.801080 10748 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.801529 10748 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.737541 10642 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.787703  8218 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:28.802716 10642 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.774085 11088 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.805397 11268 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:28.805936 11268 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.807670  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1640) took 1256 ms. Trace:
I20260709 13:02:28.808545  8210 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.810485 11172 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:28.808036  8361 rpcz_store.cc:276] 0709 13:02:27.550910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.285998 (+735088us) service_pool.cc:224] Handling call
0709 13:02:28.286322 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:28.291999 (+  5677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.292480 (+   481us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:28.333224 (+ 40744us) log.cc:844] Serialized 52 byte log entry
0709 13:02:28.520672 (+187448us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:28.806948 (+286276us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b18002b6780. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2efbdf54bc 00007f2ef914348b 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915d455 00007f2effc453c7 00007f2efc2579a7 00007f2efc2670bf
0709 13:02:28.807079 (+   131us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.807296 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.807378 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.807417 (+    39us) raft_consensus.cc:1685] finished
0709 13:02:28.807496 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.807619 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":770,"prepare.queue_time_us":172400,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3988,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"spinlock_wait_cycles":16452352,"thread_start_us":294270,"threads_started":2,"wal-append.queue_time_us":292068}
I20260709 13:02:28.815418 10733 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.816411  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:28.664054 11183 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.789101  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:28.782289  8863 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:28.795575  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 114126us
I20260709 13:02:28.796904  8212 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:28.777441 11230 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:28.798846  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 100007us
I20260709 13:02:28.800130 10363 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:28.800191 11264 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.788488  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 561) took 1229 ms. Trace:
I20260709 13:02:28.847483  8358 rpcz_store.cc:276] 0709 13:02:27.553266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.666659 (+1113393us) service_pool.cc:224] Handling call
0709 13:02:28.700338 (+ 33679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.782270 (+ 81932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.782482 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:28.812914  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.848742  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.812827 11070 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.813838  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:28.819546  8213 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:28.851120  8216 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:28.791070  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:28.854542  8360 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:28.856355  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 77674.4us
I20260709 13:02:28.808027 11268 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.839218 11188 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:28.799305 11099 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.844082 10363 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.875674  8259 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.862226 11204 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:28.700700 11232 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.857285  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:28.858664  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:28.842545  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 53556.6us
I20260709 13:02:28.790095 11155 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:02:28.862264  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 44263.5us
I20260709 13:02:28.841675 10945 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:28.865437  8367 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:28.838901 10820 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:28.866693 11099 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:28.844615  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 50074.3us
I20260709 13:02:28.872633  8216 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:02:28.886128  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 105401us
I20260709 13:02:28.847157 11137 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.875133 10363 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.896777  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:28.881165 11268 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.899201  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:28.899487  8364 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 8. Ops: []
I20260709 13:02:28.865607 11088 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.902240 10622 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:28.895757  8184 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.905254  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:28.905812  8890 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:28.902631 10622 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:28.901470 11268 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.923242 10820 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.923785 10622 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.925031 10622 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.926725  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:28.927052 10733 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:28.928839  8892 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:28.930378  8894 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:28.928853 10733 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:02:28.932565 11198 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:28.933527  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.894974 11188 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:02:28.939671 11145 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:28.940416 10944 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:28.942457 11204 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:28.943243  8898 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:28.944226  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:28.944823  8897 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:28.945749  8362 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:28.946471 11275 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:28.946868  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:28.947412 11275 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:28.893214 11099 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.948137 11152 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:28.949626 11152 raft_consensus.cc:2764] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:28.951341 11183 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:02:28.951973 11183 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:28.952092  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1647) took 1398 ms. Trace:
I20260709 13:02:28.952484  8359 rpcz_store.cc:276] 0709 13:02:27.553277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.752950 (+1199673us) service_pool.cc:224] Handling call
0709 13:02:28.753332 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:28.753767 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.753796 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:28.780095 (+ 26299us) log.cc:844] Serialized 52 byte log entry
0709 13:02:28.866781 (+ 86686us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:28.866815 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.866877 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.951877 (+ 85000us) raft_consensus.cc:1685] finished
0709 13:02:28.951897 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.952039 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":500,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":86307,"threads_started":1,"wal-append.queue_time_us":116922}
I20260709 13:02:28.984633  8210 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:28.896752 11137 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:28.991593  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 97812.8us
W20260709 13:02:28.992322  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 108209us
I20260709 13:02:28.898844 10945 raft_consensus.cc:697] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:28.923907 11268 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.001331  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:29.003204  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:28.947825 11275 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:28.928398 11054 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:29.020169  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:29.014150  8359 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:29.005661  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.022253  8895 raft_consensus.cc:2368] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:29.022536  8360 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.017841  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.022934  8358 raft_consensus.cc:2410] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:29.023288  8365 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:28.958425 11183 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:29.021719  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 701) took 1102 ms. Trace:
I20260709 13:02:29.024086  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:29.025588  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:29.025914  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:28.998667 11137 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.001750 11245 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:29.009896  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 84468.4us
I20260709 13:02:29.028473  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:29.052343  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:28.998275 10748 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.053406 11198 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.023826 11276 consensus_queue.cc:1059] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:02:29.054445  8359 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:29.054579 11276 raft_consensus.cc:3055] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:29.054476 10748 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.054944 11230 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.031090 11232 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:29.055274 11054 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:29.055411 11198 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.055636 11230 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:29.056293 11230 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.022243 11275 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.055140 10944 consensus_queue.cc:1059] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:29.054986 11276 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:29.026669  8286 rpcz_store.cc:276] 0709 13:02:27.892502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.892610 (+   108us) service_pool.cc:224] Handling call
0709 13:02:28.144048 (+251438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.144233 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:28.168096 (+ 23863us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.811347 (+643251us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18004428a0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded23a 00007f2efc257a2a
0709 13:02:28.960813 (+149466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.960861 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:28.994272 (+ 33411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.994460 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.994590 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":991,"prepare.queue_time_us":24138,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":7336,"raft.queue_time_us":95,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":11080,"spinlock_wait_cycles":28265856,"thread_start_us":149163,"threads_started":1}
I20260709 13:02:29.058674 11276 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.059834 11276 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.020903 11084 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:29.065636 11003 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.066573  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.041467 11088 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.040829  8113 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 4, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:29.042798  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 563) took 1482 ms. Trace:
I20260709 13:02:29.042500 10945 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.001142 11281 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:29.046195  8361 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:29.024539  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.049938  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 694) took 1381 ms. Trace:
I20260709 13:02:29.084992  8891 rpcz_store.cc:276] 0709 13:02:27.673110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.680231 (+  7121us) service_pool.cc:224] Handling call
0709 13:02:29.049792 (+1369561us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540003dc54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:29.049888 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677553024}
I20260709 13:02:29.055491 10748 consensus_queue.cc:1059] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:29.038508 11207 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.036298  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 557) took 1484 ms. Trace:
I20260709 13:02:29.067698 11003 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:29.045210 11183 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:29.069422 11180 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:29.070291 11253 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.825s	user 0.007s	sys 0.004s
I20260709 13:02:29.095160 10748 raft_consensus.cc:3055] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:29.040114 11264 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:29.095604 10748 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:02:29.072944  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 181495us
I20260709 13:02:29.096549 10748 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.097720 10748 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.098388  8258 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.099807 11236 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:29.100175 11236 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:29.100558 11236 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.074038  8332 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:29.101938 11207 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:29.102358  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.076040 11204 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.075627  8358 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:29.091526  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 234404us
I20260709 13:02:29.081298  8367 rpcz_store.cc:276] 0709 13:02:27.560093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.795152 (+1235059us) service_pool.cc:224] Handling call
0709 13:02:28.823607 (+ 28455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.891642 (+ 68035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.042551 (+150909us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b5400434254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:29.042745 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82849536}
I20260709 13:02:29.086252  8364 rpcz_store.cc:276] 0709 13:02:27.551977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.558558 (+1006581us) service_pool.cc:224] Handling call
0709 13:02:28.602737 (+ 44179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.900986 (+298249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.036033 (+135047us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54001536d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:29.036224 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682374016}
I20260709 13:02:29.001355 10972 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:29.091113  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 66685.4us
I20260709 13:02:29.113621  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.092274  8113 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.115203  8113 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 5, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.115979 11264 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.116457 11264 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.116796 11264 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.116868  8113 catalog_manager.cc:5697] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 5, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:29.082237 11152 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.118268 11152 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.118647 11152 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.094125  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.122507  8361 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:29.123399  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:29.124773  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.070515 10363 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.095026 11180 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:29.100247  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:29.102833  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:29.075134  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.131464 11088 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.131783 10363 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.132097 11088 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:29.125844  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.126953 11264 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.133168 11088 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.138716  8361 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:29.140228  8361 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:02:29.145520  8361 pending_rounds.cc:85] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 6
I20260709 13:02:29.146342  8361 pending_rounds.cc:107] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:02:29.152073  8361 raft_consensus.cc:2889] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:29.134536  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 59550.8us
I20260709 13:02:29.143252  8113 catalog_manager.cc:5697] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:29.083667 11281 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.156038  8367 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.111239  8863 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:29.150734  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 50580.7us
I20260709 13:02:29.110109 11204 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:29.160465  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 49329.6us
I20260709 13:02:29.152585  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.161381  8364 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:29.110145 11084 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:29.004081  8897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:29.157629  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2099) took 1604 ms. Trace:
I20260709 13:02:29.157847  8258 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.150820  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:29.158413  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 55676.5us
I20260709 13:02:29.154816  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.166776 11070 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.167171 11070 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:29.167507 11070 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:29.170431 11286 log.cc:927] Time spent T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:29.175859 10972 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:29.164161 11180 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:29.178396  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.179121  8289 raft_consensus.cc:2376] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6. Re-sending same reply.
I20260709 13:02:29.180210  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.180970  8286 raft_consensus.cc:2410] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:29.180743 11070 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:29.181767  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.182416  8290 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:29.183254 11172 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:29.183596  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.183794 11172 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:29.184376  8287 raft_consensus.cc:2410] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:29.184818 11172 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.186453 11099 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.188481 11287 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:29.189167 11230 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:29.165030  8358 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.189998 11287 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:29.190791  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:29.160146 11285 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:29.162573 11204 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.183287  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.161224  8863 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.192480 10622 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.194190  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.318627  8285 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:29.195123  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.191540  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.319614  8286 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.162936  8113 catalog_manager.cc:5697] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.322840  8113 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:29.324204  8113 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 6, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 6 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.158290 11281 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.191900  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.194487  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.163652  8897 raft_consensus.cc:606] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:29.197896  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:29.328683  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 137292us
I20260709 13:02:29.328964  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.329385  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.191470 11186 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:29.333043  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 142381us
I20260709 13:02:29.334116  8284 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:29.334239  8897 raft_consensus.cc:614] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:29.337908  8258 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:29.332675  8113 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 4, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.331594  8290 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:29.332827  8291 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:29.342396  8359 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:29.188444 11099 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:29.161721 11264 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:29.178748 11183 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.162286 11152 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:29.342257  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 147939us
I20260709 13:02:29.396421  8358 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:29.423264  8286 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:29.467268  8291 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:29.201000 11180 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:29.400043  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 44474.2us
I20260709 13:02:29.330737 11084 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:29.374578  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.368563 11198 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:29.473057  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 312036us
I20260709 13:02:29.347565  8113 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 6, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 6 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.398146  8360 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:29.366158 10944 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:29.492313  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.388479  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 50664.5us
I20260709 13:02:29.331812 10972 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:29.490658 11180 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.495944  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:29.427889 11070 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:29.355974 10363 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:29.368471 11200 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:29.341415 11186 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:29.348031 11232 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:29.496816 11291 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:29.406692  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 696) took 1577 ms. Trace:
I20260709 13:02:29.498721  8285 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.497053 11183 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:29.416765 11209 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.365468 11230 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:29.503556  8863 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.332669 10622 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.436547 11275 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:29.528244  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.528824  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:29.570760  8360 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:29.571221  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:29.560636  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 553) took 2010 ms. Trace:
I20260709 13:02:29.557969  8896 rpcz_store.cc:276] 0709 13:02:27.829182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.829303 (+   121us) service_pool.cc:224] Handling call
0709 13:02:27.829570 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.829847 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:28.150191 (+320344us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.343136 (+192945us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.467058 (+123922us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b18003df600. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:28.535191 (+ 68133us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b18003df600. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef912e2a6 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1
0709 13:02:28.816712 (+281521us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b18003df600. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:28.845944 (+ 29232us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18003df600. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef912e2a6 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9
0709 13:02:29.195776 (+349832us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b18003df600. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915d455 00007f2efc245060 00007f2efc257716 00007f2efc268287 00007f2efc268208
0709 13:02:29.406315 (+210539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:29.406375 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:29.406430 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.406500 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.406630 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21680,"prepare.queue_time_us":323436,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":29143,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7743,"spinlock_wait_cycles":82105984,"thread_start_us":356205,"threads_started":2,"wal-append.queue_time_us":257546,"wal-append.run_cpu_time_us":1415,"wal-append.run_wall_time_us":1007242}
I20260709 13:02:29.571779  8362 rpcz_store.cc:276] 0709 13:02:27.550617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.262635 (+712018us) service_pool.cc:224] Handling call
0709 13:02:28.741701 (+479066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.946185 (+204484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.469955 (+523770us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54003179d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:29.560472 (+ 90517us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54003179d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:29.560585 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530580096}
I20260709 13:02:29.417982 11204 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.574255 11204 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:29.561079  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.567442  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 64045.5us
I20260709 13:02:29.521456 11268 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.568770  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:29.565164  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 46827.1us
I20260709 13:02:29.515156 11137 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:29.557190 11290 log.cc:927] Time spent T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:02:29.577425  8363 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.552983 11232 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.164714  8366 rpcz_store.cc:276] 0709 13:02:27.553653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.761800 (+1208147us) service_pool.cc:224] Handling call
0709 13:02:29.067490 (+305690us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:29.067664 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.067967 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:29.068258 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.153279 (+ 85021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:29.153335 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:29.157408 (+  4073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.157472 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.157576 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2501,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":41,"raft.queue_time_us":50091,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":25317632,"thread_start_us":43926,"threads_started":1}
I20260709 13:02:29.549259 11186 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.518149 10363 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:29.567946  8113 catalog_manager.cc:5697] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 3, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.584764  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.589570  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.590579  8293 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
W20260709 13:02:29.591249  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 95430.9us
I20260709 13:02:29.575420 10944 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:29.577087 10733 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:29.592165  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.595172  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.601567  8285 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:29.598968  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.595755  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.581604 11245 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:29.600589 11113 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:29.584281 11267 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:29.593529  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:29.601534  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.599098 11228 raft_consensus.cc:3055] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:29.602568  8290 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:29.610611 11228 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:29.602910  8289 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:29.609593  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.586349 11232 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.558576 11200 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.612937  8291 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:29.589170 10363 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:29.608868  8183 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.594799  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.615989  8285 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:29.616956  8113 catalog_manager.cc:5697] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 2, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:02:29.623415  8363 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:29.625619  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.593904 10944 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.594794 11099 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.626636  8290 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.627552  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.629195  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.609283 11245 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.589586 11070 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:02:29.613605 11113 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.588250 11285 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:02:29.612418 11230 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:02:29.613125 11267 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:29.645154  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.646456 11268 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:29.678886  8895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 679) took 2292 ms (client timeout 2209 ms). Trace:
W20260709 13:02:29.679821  8895 rpcz_store.cc:269] 0709 13:02:27.373245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.375344 (+  2099us) service_pool.cc:224] Handling call
0709 13:02:29.647206 (+2271862us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54003ce6d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:29.647338 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3784082304}
I20260709 13:02:29.626313 11051 raft_consensus.cc:2764] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:02:29.642364 10733 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:29.632972 10944 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.696141  8864 leader_election.cc:400] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5.
I20260709 13:02:29.686738  8287 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:29.688086  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.642565 11113 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.640162 11299 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:29.692076  8183 connection.cc:256] RPC call timeout handler was delayed by -1.1471851439999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:02:29.692893 11275 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:29.624845 11172 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:02:29.592600 11084 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.692516  8113 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.689066 11152 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.697129  8364 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:29.685211  8332 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:29.697758  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.696516  8864 leader_election.cc:403] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.701913  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.611564 11228 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:29.702584  8362 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:29.703207  8290 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:29.647396 11267 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.643251 11183 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:29.699474 11236 consensus_meta.cc:287] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.000s
I20260709 13:02:29.692459 11298 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:29.705832  8113 catalog_manager.cc:5697] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:29.682129 11287 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:02:29.717147  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.711375  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.701316 11299 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:29.717759  8287 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:29.718021  8290 raft_consensus.cc:2410] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:29.641517 11099 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.706269 11302 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:29.718179 11264 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:02:29.720594  8113 catalog_manager.cc:5697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 3, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:29.723320  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.724288  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.721850 11302 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:29.725823 11302 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:29.726934 11302 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.714473 11275 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:29.722014 11228 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.738462  8863 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.714859 11183 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.740638  8290 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:29.742095  8863 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.718768 11070 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:29.743829  8366 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:29.720333 11298 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.747292  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.747697 11204 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:29.747999 11298 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:29.748230 11264 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:29.718592 11236 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.749004 11245 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.749938 11264 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:29.742177  8864 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.751329  8361 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.744058  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.766009  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:29.768131  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:29.768680  8210 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.769498  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.774613  8210 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:29.720082 11299 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.780793  8218 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:29.766551  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:29.781435  8217 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:29.776286  8287 raft_consensus.cc:2393] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:29.763715  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.760963  8331 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.750336 11264 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:29.750593 11183 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.779363  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:29.779875  8293 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:29.724748 10622 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.784380  8331 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:29.791827  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:29.784837 11070 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.785112 11276 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:29.747642 11297 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:29.802448  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:29.785641  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:29.803037  8894 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.803583  8214 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:29.786027  8288 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:29.784888  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.804917  8291 raft_consensus.cc:2368] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:29.805783  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:29.806519  8291 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:29.807116  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:29.807817  8212 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:29.808465  8291 raft_consensus.cc:1240] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:29.785326  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:29.809506  8215 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.787575 11003 consensus_queue.cc:1059] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:02:29.810868 11003 raft_consensus.cc:3055] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:29.811188 11003 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:29.816684 11070 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:29.817673 11070 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:29.822309  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:29.823024  8891 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.823143  8894 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:29.823992  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:29.824842  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:29.825484  8892 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:29.779881 10841 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:29.789718  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.792342  8363 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.793455  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:29.785527 11264 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.792935  8257 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.798346 11245 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.789038  8359 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:29.795398  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:29.836633  8895 raft_consensus.cc:2368] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:29.782620 11303 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:29.845088  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 52251.3us
W20260709 13:02:29.843921  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 177740us
I20260709 13:02:29.846369  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:29.846586  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.849242  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:29.849990  8293 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:29.862640  8258 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.863950  8258 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.865840  8258 leader_election.cc:400] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:29.868427  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:29.796509 11268 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:29.875617  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 823525us
I20260709 13:02:29.847930  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.873517  8361 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:29.795267 11230 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:29.876892  8215 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:29.877923 11152 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:29.878371 11152 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:29.892874  8863 leader_election.cc:400] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:29.880229  8862 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:29.878547  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.893188  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:29.893647  8863 leader_election.cc:403] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.892580  8895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:29.902812  8895 raft_consensus.cc:606] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:29.903272  8895 raft_consensus.cc:614] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:29.904978  8363 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:29.842901 11276 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:29.837729 11200 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:29.910771  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:29.874382 11204 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.859555 11240 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:29.859268 11302 raft_consensus.cc:2764] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:29.910116  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:29.912164  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:29.873971 11155 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.879235 10622 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.858621 11088 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:02:29.927234  8212 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:29.901775 11298 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:29.904222 11152 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.892863 10841 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:29.907053 11284 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:29.933596  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 87325.7us
I20260709 13:02:29.901895 11268 raft_consensus.cc:697] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:29.921368 10733 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:02:29.965108  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 70714.2us
I20260709 13:02:29.906620 11230 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:29.943554  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 141321us
I20260709 13:02:29.858968 11186 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.928824 10622 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.901170 11267 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.967917  8863 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:29.967916 11298 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:29.958611 11155 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:29.973626  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:29.978915  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 67090.4us
I20260709 13:02:29.901405 11003 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.977711  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:29.928694 11204 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.987813 11084 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:02:29.981135 11281 consensus_meta.cc:287] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.005s
I20260709 13:02:29.996863 11281 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:29.994211  8289 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:29.990744  8892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "864d288163824eac975181159a2708d9"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:30.001382  8892 raft_consensus.cc:606] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:29.999240  8285 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.002493  8892 raft_consensus.cc:614] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:30.000761  8891 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:29.994740  8363 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:02:29.976181 10622 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.968294 11311 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:30.026007  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 113051us
I20260709 13:02:30.031240  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:30.032929  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:30.036949  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 144992us
I20260709 13:02:30.038396  8862 leader_election.cc:400] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
I20260709 13:02:30.038996  8862 leader_election.cc:403] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.039613  8285 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:30.039855 11200 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6.
I20260709 13:02:29.995820 11186 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:29.988168 11297 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:30.059680 10363 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.054466 11188 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:30.060801  8209 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:30.063970  8862 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:30.066782 10363 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.013898 11311 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:30.067680  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.068532  8215 raft_consensus.cc:2393] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:30.069497  8862 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:30.065989 11188 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:30.070685 11306 log.cc:927] Time spent T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:30.071108  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:30.085001  8183 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:30.072137 11317 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:30.076757 11099 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:30.077808  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:30.061009 11180 consensus_meta.cc:287] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.002s
I20260709 13:02:30.082355  8290 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:30.091933  8862 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:30.061550 11287 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.060760 11236 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.064620 11297 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:30.068918 11302 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.054464 11245 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:02:30.083206 11188 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:30.095095 10748 consensus_queue.cc:1059] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:02:29.994467 10841 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.087399 11228 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:30.105506  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:30.081278 11311 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.109985 11302 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.032284 11276 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.124461 11267 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.122153 11186 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.118368 11319 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.126183 10944 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.126893 11299 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.128464 11232 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.130285 11204 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:30.130950 11275 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5.
I20260709 13:02:30.080941 11268 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.095345 11088 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.108887 11155 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.117385 11298 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.098044 11099 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.106987 11297 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:30.068267 11230 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:30.098871 11180 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.153755 10622 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.141170 11113 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:30.236325 10944 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:30.239840 11302 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.147900 10972 raft_consensus.cc:3055] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:30.151785 11200 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:30.270789 10972 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:30.276762 11152 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:30.277096 10972 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.278317  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:30.278474 10972 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.241900 11264 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.242933 11311 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.282228  8897 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:30.283104 11311 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:30.288200 11321 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:02:30.290050 11301 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.290719 11301 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.293006  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2093) took 1094 ms. Trace:
I20260709 13:02:30.293417  8288 rpcz_store.cc:276] 0709 13:02:29.199086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.199196 (+   110us) service_pool.cc:224] Handling call
0709 13:02:29.199466 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.804348 (+604882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.292728 (+488380us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5400044f54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:30.292941 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349237504}
I20260709 13:02:30.294697  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:30.297216  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.297753  8892 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:30.298098  8891 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:30.298547 11281 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.300325 11293 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:30.300700 11293 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:30.301055  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.301609  8891 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:30.303196  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.303752  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.304414  8898 raft_consensus.cc:2393] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:30.304549  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.305178  8894 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:30.237007 11188 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.307632 11188 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.307961 11003 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:30.309075  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 331593us
I20260709 13:02:30.313315  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.314131  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.314510  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.314678  8217 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.316244  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:30.236866 11183 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.234834 11284 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:30.236295 11299 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:30.237754  8284 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:30.234339 11204 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.235582 11232 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:30.246258  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 278522us
I20260709 13:02:30.251577 10363 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.256083  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 169743us
I20260709 13:02:30.260614 11113 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:30.262391  8292 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 8. Ops: []
I20260709 13:02:30.266552  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:30.267946 10622 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.269245 11180 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:30.267897 11137 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.273434 11305 raft_consensus.cc:2764] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:02:30.323258  8892 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:30.324280  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:30.415059  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 90919.1us
I20260709 13:02:30.415992  8332 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:30.322626  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:30.317411  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:30.329056  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:30.336479  8359 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:30.337162  8891 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:30.338085  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.338332  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:30.339134  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 430413us
I20260709 13:02:30.338107  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.366961 10363 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.418131  8898 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:30.418351  8895 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 9: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:30.371501  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:30.372330  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:30.373154  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:30.393240  8285 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:30.301491 11293 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:30.396968  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:30.419057  8288 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:30.327955 11198 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:30.400786  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:30.424055  8287 raft_consensus.cc:2393] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:30.401382  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:30.403867  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:30.424360  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.428754  8863 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:30.441483  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:30.441483  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:30.445389 11051 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:30.445770 11293 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.375865 11186 consensus_queue.cc:1059] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:02:30.451524  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 346080us
I20260709 13:02:30.458653  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:30.460592  8891 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:02:30.462913  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.463655  8895 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
W20260709 13:02:30.464212 11327 log.cc:927] Time spent T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:02:30.466264  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 137359us
I20260709 13:02:30.467118  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:30.415249 11264 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:30.474381  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 58484.6us
I20260709 13:02:30.409335 11088 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:02:30.528824  8286 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:30.527072  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.529675  8898 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:30.531810  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:30.528308  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 108060us
I20260709 13:02:30.535827  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.536160  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.541201  8293 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
W20260709 13:02:30.542577  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 70454us
W20260709 13:02:30.533874  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 58883.5us
I20260709 13:02:30.532704  8890 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:30.545323  8863 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:30.547485  8889 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:30.548561  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.472679 11198 raft_consensus.cc:697] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:30.550495  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:30.550149  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:30.550873  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:30.544219  8258 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:30.558321  8209 raft_consensus.cc:2368] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5.
I20260709 13:02:30.526651 11180 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.562557 11186 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:30.563071 11186 raft_consensus.cc:697] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:30.563903  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.474787 11305 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:30.548498  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.567622  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:30.568409  8218 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:30.556452  8217 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:30.530503 11276 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:30.559454  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:30.559495  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.558647  8258 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:30.532532 11088 consensus_queue.cc:1243] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:30.534757 11152 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:30.560647  8286 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:30.561019  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.561190  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.544673  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:30.564193  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.565837  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:30.560344  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 142066us
I20260709 13:02:30.573522  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:30.565145 11172 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:02:30.616575  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.617666  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.618424  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.587409 11328 consensus_queue.cc:1059] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:30.620398  8211 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.622696  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.623174  8210 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:30.623764  8892 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:30.624398  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.625339  8898 raft_consensus.cc:2393] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:30.625644  8218 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:30.556285 11264 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.549988 11323 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.627859  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.563910 11186 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.560495 11281 raft_consensus.cc:2764] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:02:30.630410  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.658042  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.629562  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:30.631258  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 71890.5us
I20260709 13:02:30.631703 11172 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:30.632211  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 73677us
I20260709 13:02:30.634258 10622 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:30.545931 11324 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:30.573652 11051 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:30.635622 11331 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:30.637503  8892 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:30.644753  8216 raft_consensus.cc:2410] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:30.645678  8213 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:30.535576 10944 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:02:30.647557  8896 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:30.648005  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:30.654981  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:30.527757 11297 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.627631  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:30.660898  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 116949us
I20260709 13:02:30.758308  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:30.759450  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:30.760296 11336 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:30.760536 11337 consensus_queue.cc:1059] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:30.664407  8211 raft_consensus.cc:2410] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:30.622107  8889 raft_consensus.cc:2376] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9. Re-sending same reply.
I20260709 13:02:30.761720 11337 raft_consensus.cc:3055] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:30.618950 11183 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:30.654219 11301 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:30.661933  8258 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:30.761978  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:30.762735  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 100936us
I20260709 13:02:30.763357  8889 raft_consensus.cc:2410] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:30.665012  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:30.764266  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.653962 11323 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.764884 11323 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.765014  8889 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:30.765846  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.766386  8286 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:02:30.754443  8214 raft_consensus.cc:2368] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:30.754676  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.754861  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.763474  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:30.753558  8891 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:30.769461  8892 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:30.756487 11328 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.786397  8890 raft_consensus.cc:2410] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:30.762144 11337 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:30.760875 11335 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:30.758061  8893 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:30.625629 11155 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.644129 11305 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:30.787021  8258 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:30.666790 11152 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:30.792999  8891 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:30.726912 10622 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:30.763530 11267 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.665918 11276 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:30.796880  8894 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.793948  8896 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:30.686735 11172 raft_consensus.cc:697] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:30.805037 11172 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.789315 11301 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.806418 11051 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:30.790377 11328 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.803658 11276 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.809084  8894 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:30.809918  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:30.810546  8892 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
W20260709 13:02:31.170305  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 270722us
I20260709 13:02:30.890466  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 705) took 1104 ms. Trace:
I20260709 13:02:30.809085  8891 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:30.898342  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 139018us
I20260709 13:02:31.211334  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2299) took 1229 ms. Trace:
I20260709 13:02:30.889779 10363 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:31.209530  8897 rpcz_store.cc:276] 0709 13:02:29.792199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.795303 (+  3104us) service_pool.cc:224] Handling call
0709 13:02:30.890257 (+1094954us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b540067edd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:30.890401 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052469504}
W20260709 13:02:31.092386  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 143911us
I20260709 13:02:30.909878  8284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2284) took 1221 ms. Trace:
I20260709 13:02:31.303772 10363 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:30.894937  8257 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:31.306658  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 411999us
I20260709 13:02:31.308697  8288 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:31.308985  8293 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:02:31.043181  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.170581 11332 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.509s	user 0.001s	sys 0.000s
W20260709 13:02:31.167848 11334 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.395s	user 0.000s	sys 0.000s
I20260709 13:02:30.797904 11267 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.027045  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:31.318411  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:31.305214  8292 rpcz_store.cc:276] 0709 13:02:29.982298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.982438 (+   140us) service_pool.cc:224] Handling call
0709 13:02:29.994776 (+ 12338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.409997 (+415221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.909405 (+499408us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54004024d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:31.211270 (+301865us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615035648}
I20260709 13:02:31.319192  8288 raft_consensus.cc:2368] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:31.301985  8284 rpcz_store.cc:276] 0709 13:02:29.688609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.688771 (+   162us) service_pool.cc:224] Handling call
0709 13:02:29.691232 (+  2461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.339030 (+647798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.909631 (+570601us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54001d60d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:30.909807 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151000448}
I20260709 13:02:30.802121 11137 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:31.148325 11152 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:31.026985 11320 log.cc:927] Time spent T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:02:31.312582  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 308639us
I20260709 13:02:31.192191 11335 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:31.210806  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 592379us
I20260709 13:02:30.795140 11302 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.532s
I20260709 13:02:30.795140 11099 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.537s
I20260709 13:02:31.006299 11200 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.942781 10841 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.943038 11281 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.867048 11314 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:31.327165 11267 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.335958  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:31.215359 11336 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:31.341254  8363 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:31.342665  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:31.054450 11183 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.280s
I20260709 13:02:31.009495 10622 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:30.922695 11209 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:30.884408 11326 log.cc:927] Time spent T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:02:31.318754  8895 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
W20260709 13:02:31.330549 11323 consensus_meta.cc:287] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.000s
W20260709 13:02:31.345458  8332 connection.cc:256] RPC call timeout handler was delayed by -1.6540082330000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 13:02:31.343255  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:31.344689  8331 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:31.356195  8359 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:31.344137  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:31.343533  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:31.402047  8897 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:30.797840 11155 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.113744 11305 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:31.381302  8360 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:31.343252 11324 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:02:31.388482  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 67815.9us
I20260709 13:02:31.390892  8361 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:31.394119  8891 raft_consensus.cc:2393] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:31.310860 11297 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:31.398847  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:30.795256 11198 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.389384 11347 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.389617 11314 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:30.875625 11337 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.396831  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:31.366873 11200 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.424508  8890 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:31.424500  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:31.525648  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:31.522713 11349 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:31.526656 11349 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:31.522650  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:31.529088 11349 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:31.388863 11281 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:31.424369  8332 connection.cc:256] RPC call timeout handler was delayed by -1.4488082330000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 13:02:31.388953 10841 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.479308  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:31.470145  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:31.469415 11137 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:31.534391  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2297) took 1605 ms. Trace:
W20260709 13:02:31.536366  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 192088us
I20260709 13:02:31.524853  8891 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:31.406133 11328 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:31.526674  8890 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:02:31.540792  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1932082330000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:02:31.574239  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 151240us
I20260709 13:02:31.479383 11297 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.556231  8291 rpcz_store.cc:276] 0709 13:02:29.929000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.929132 (+   132us) service_pool.cc:224] Handling call
0709 13:02:29.958271 (+ 29139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.043991 (+ 85720us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:30.244495 (+200504us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.416947 (+172452us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:30.452388 (+ 35441us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.452560 (+   172us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:30.452595 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.452664 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.534173 (+1081509us) raft_consensus.cc:1685] finished
0709 13:02:31.534193 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.534331 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17788,"prepare.queue_time_us":86404,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":36199,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":22443,"thread_start_us":325111,"threads_started":3,"wal-append.queue_time_us":312832}
W20260709 13:02:31.602133  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.421815 11209 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:31.606777  8890 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:31.608948  8257 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:31.552556 11355 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:31.532059 11363 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:31.612180  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:31.606889  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 44909.9us
I20260709 13:02:31.617259  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:31.562762 11186 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.631145  8895 raft_consensus.cc:1240] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:31.633266  8215 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:31.598664 11349 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:31.406231 11323 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.565502 11359 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:31.524729 11152 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:31.469245 11335 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.608109 11297 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.532733 11347 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.719627  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1152) took 1174 ms. Trace:
I20260709 13:02:31.706718 11359 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:31.556032 11137 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:31.725747  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:31.727057  8288 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:31.730189  8891 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:31.727885  8889 rpcz_store.cc:276] 0709 13:02:30.545439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.766803 (+221364us) service_pool.cc:224] Handling call
0709 13:02:30.767126 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.767605 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:30.896016 (+128411us) log.cc:844] Serialized 14 byte log entry
0709 13:02:31.027310 (+131294us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.041944 (+ 14634us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.042134 (+   190us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:31.113554 (+ 71420us) log.cc:844] Serialized 14 byte log entry
0709 13:02:31.145852 (+ 32298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.154520 (+  8668us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.702589 (+548069us) raft_consensus.cc:1685] finished
0709 13:02:31.704513 (+  1924us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.714130 (+  9617us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141235,"prepare.queue_time_us":526948,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":8250,"raft.queue_time_us":164962,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":61686,"thread_start_us":149794,"threads_started":2,"wal-append.queue_time_us":480824}
I20260709 13:02:31.757000 11323 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:31.734910 11346 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:31.757488 11347 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:31.642292 11355 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:31.758005  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:31.758661  8889 raft_consensus.cc:2376] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7. Re-sending same reply.
I20260709 13:02:31.759701 11355 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:31.754961  8288 pending_rounds.cc:85] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting all ops after (but not including) 4
I20260709 13:02:31.762712  8288 pending_rounds.cc:107] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:31.762990  8288 raft_consensus.cc:2889] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.611564 11336 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:31.759603 11155 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:31.641937 11363 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:31.762194 11351 log.cc:927] Time spent T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:02:31.793721 11347 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.653043 11314 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:31.823602 10841 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:31.899706 11230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.634s	user 0.014s	sys 0.028s
I20260709 13:02:31.823789 11359 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:31.975812 11367 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:32.180594 11369 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.353s
W20260709 13:02:32.184504  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 575910us
I20260709 13:02:31.995158 11155 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:32.142190 11230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.877s	user 0.014s	sys 0.029s
I20260709 13:02:32.225597  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:32.265493  8259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 1.799s (SENT) [suppressed 19 similar messages]
I20260709 13:02:32.185046 11281 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.266903 11361 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.312281  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 297798us
I20260709 13:02:32.321111 11381 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.321573 11088 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.322911  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 103558us
I20260709 13:02:32.362938  8257 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:32.323257  8890 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:32.323983  8889 raft_consensus.cc:1240] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:02:32.364457  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:32.364567  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:32.365017  8890 raft_consensus.cc:2376] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6. Re-sending same reply.
I20260709 13:02:32.365727  8889 raft_consensus.cc:2393] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 4: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:02:32.326308  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.018s
W20260709 13:02:32.366268  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.000s	sys 0.019s
I20260709 13:02:32.320767  8892 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:32.367372  8889 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:32.370667  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.327910 11297 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:32.329592  8288 pending_rounds.cc:85] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting all ops after (but not including) 6
I20260709 13:02:32.332938 11299 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.371556 11299 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.372269  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:32.373800 11299 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:32.303125  8895 raft_consensus.cc:2376] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9. Re-sending same reply.
I20260709 13:02:31.758111 11346 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.375450  8895 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:32.376168 11346 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.376250  8288 pending_rounds.cc:107] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:02:32.376746  8288 raft_consensus.cc:2889] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.376276  8889 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:32.380887 11333 log.cc:927] Time spent T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 1.763s	user 0.005s	sys 0.018s
W20260709 13:02:32.382550  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39866 (request call id 708) took 1818 ms (client timeout 2186 ms). Trace:
W20260709 13:02:32.383167  8216 rpcz_store.cc:269] 0709 13:02:30.564423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.564536 (+   113us) service_pool.cc:224] Handling call
0709 13:02:32.382275 (+1817739us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b5400423954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:32.382444 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48680704}
I20260709 13:02:32.351269  8332 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:32.387286  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:32.390401  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:32.393194  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:32.106384 11347 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:32.356030  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 738774us
I20260709 13:02:32.232649 11369 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:32.226999 11367 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.360159 11365 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:32.368038  8892 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:32.327771 11355 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:32.218494 11209 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:32.397230  8890 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:32.400172  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:32.398979  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:32.293462 11155 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:32.410527  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 47662us
I20260709 13:02:32.400398  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:32.453078  8363 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:32.448735  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 868) took 1041 ms. Trace:
I20260709 13:02:32.449167  8895 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:32.454311  8890 rpcz_store.cc:276] 0709 13:02:31.407457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.365673 (+958216us) service_pool.cc:224] Handling call
0709 13:02:32.365957 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.448489 (+ 82532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.448682 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.401952 11299 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:02:32.456791  8332 leader_election.cc:336] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.639s (SENT)
W20260709 13:02:32.462808  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.468446  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:32.468859  8213 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:32.475858  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:32.478137  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:32.480036  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:32.491062 11301 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.492691  8213 raft_consensus.cc:2368] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:32.492861 11183 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:32.476516  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:32.493284 11183 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.493782 11183 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:32.494838 11347 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.495927  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 726) took 1137 ms. Trace:
I20260709 13:02:32.496284  8891 rpcz_store.cc:276] 0709 13:02:31.358779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.557244 (+198465us) service_pool.cc:224] Handling call
0709 13:02:31.557492 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.755066 (+197574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.495720 (+740654us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400524ed4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:32.495872 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396865920}
I20260709 13:02:32.497426  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:32.501682  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 102765us
I20260709 13:02:32.502748  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:32.461774 11346 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:32.508167  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:32.457370 11200 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:32.399824 11088 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.504071  8891 raft_consensus.cc:2393] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:32.505586  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.528237  8213 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:32.505842  8366 raft_consensus.cc:2410] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:02:32.489329  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 223898us
I20260709 13:02:32.501199  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:32.529177  8892 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:32.462469 11297 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.447218 11198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.004s	sys 0.027s
I20260709 13:02:32.451484 11355 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.526844  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.394713 11381 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.395174 11361 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.509223  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:32.536056  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:32.446770 11369 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.503741 11378 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.445572 11362 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.124s
W20260709 13:02:32.543601  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 87007.8us
I20260709 13:02:32.509454 11347 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:32.508925 11391 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:32.564677  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:32.578990  8363 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:32.543123 11377 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:32.564966  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:32.571311  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:32.577589  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.534686 11198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.005s	sys 0.027s
I20260709 13:02:32.447945 11365 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.533286 11382 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.584301  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:32.492914 11301 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.535754 11346 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:32.589804  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:32.583254  8862 leader_election.cc:400] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 4. Current term is 5.
I20260709 13:02:32.585646  8367 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.587595  8892 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:32.595494  8862 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:32.571715 11386 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.564734 11209 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:32.572520 11396 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.598240  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:32.599537  8862 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:32.602398  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:32.565073 11363 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.564188 11354 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:32.583813 11391 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.589293 11347 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.608069 11388 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:32.609213 11298 raft_consensus.cc:3055] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:32.609838 11390 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:32.539377 11297 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.616025  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:32.614635  8366 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:32.602638 10622 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.621397 11384 log.cc:927] Time spent T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:02:32.622212  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 727) took 1263 ms. Trace:
I20260709 13:02:32.622684 11393 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.624683 11364 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:02:32.631783  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:32.619920  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:32.603443 11200 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:32.638832  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:32.641067  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:32.640475  8285 raft_consensus.cc:2410] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:02:32.632916 11267 consensus_meta.cc:287] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.211s	user 0.005s	sys 0.005s
I20260709 13:02:32.645037 11371 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:32.645299  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:32.581373 11378 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.645604 11371 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.645835 11376 consensus_queue.cc:1059] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:02:32.634115 11298 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:32.646931 11376 raft_consensus.cc:3055] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:32.647548 11375 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:02:32.647117 11298 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.647697 11371 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.648032 11407 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:32.626406 11299 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:32.639849  8897 rpcz_store.cc:276] 0709 13:02:31.359047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.573068 (+214021us) service_pool.cc:224] Handling call
0709 13:02:31.606221 (+ 33153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.606577 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.606603 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.218638 (+612035us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.396506 (+177868us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:32.396565 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.396681 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.621945 (+225264us) raft_consensus.cc:1685] finished
0709 13:02:32.621964 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.622140 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":688502,"raft.queue_time_us":2579,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":19664,"thread_start_us":176716,"threads_started":1,"wal-append.queue_time_us":352065}
I20260709 13:02:32.648633 11407 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.649360  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:32.648159 11298 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:32.651081 11394 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:02:32.652071 11393 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:32.652608 11393 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.653002  8363 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:32.653014 11155 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:32.641006 11364 consensus_queue.cc:1243] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:32.654359 11347 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.655092  8367 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:32.656064 11355 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:32.656239 11391 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.658392 11393 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:32.647420 11408 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:32.659758  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 861) took 1316 ms. Trace:
I20260709 13:02:32.589238 11382 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.650480  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:32.663681  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 43852.8us
I20260709 13:02:32.633314 11373 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.644284 10622 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.666287  8862 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:32.631577 11363 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.663470  8897 raft_consensus.cc:2376] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5. Re-sending same reply.
I20260709 13:02:32.713019  8290 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:32.710605  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.711858  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.710764  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.717319  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.710413  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.661404  8893 rpcz_store.cc:276] 0709 13:02:31.343764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.527542 (+183778us) service_pool.cc:224] Handling call
0709 13:02:31.527893 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.538970 (+ 11077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.549231 (+ 10261us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.642237 (+ 93006us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.112731 (+470494us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:32.113383 (+   652us) log.cc:844] Serialized 14 byte log entry
0709 13:02:32.366243 (+252860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.366319 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.659592 (+293273us) raft_consensus.cc:1685] finished
0709 13:02:32.659612 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.659709 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219087,"prepare.queue_time_us":181,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":230984,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":19210,"thread_start_us":408221,"threads_started":2,"wal-append.queue_time_us":953361}
I20260709 13:02:32.739530  8213 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:32.586941 11377 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.740379  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.742425  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.743224  8217 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:32.741659  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:32.744014  8893 raft_consensus.cc:2376] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5. Re-sending same reply.
I20260709 13:02:32.744496  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.611022 11386 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.647388 11378 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:32.664901 11376 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:32.669724 11267 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.618208 11396 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.712775 11346 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.644124 11388 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.766919  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:32.848918  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:32.861197  8893 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:32.764670  8361 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:32.747025  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:32.843665  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.737774 11371 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.712620 11299 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:32.866039  8210 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:32.867187  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 201069us
I20260709 13:02:32.880998  8862 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:32.707705 11391 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.815243 11367 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.873965 11420 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:32.753034  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:32.812700  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 219539us
W20260709 13:02:32.814512 11349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.011s	sys 0.037s
I20260709 13:02:32.882035  8862 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:32.882599  8292 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:32.873394  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:32.884588  8897 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.814163 11415 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.754119 11411 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.768908 11088 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.766624 11155 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.768719 11301 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:32.768350 11311 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.768342 11398 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.865828 11354 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:32.738559 11363 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.901743 11391 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.804096 11381 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:32.766193 11382 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.878604 11419 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.764554 11183 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.737465 11373 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.881057 11371 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:33.134511  8210 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:33.133668  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:32.882704 10944 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:32.938283  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.908522  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:33.002985  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 54726.9us
I20260709 13:02:33.137763  8897 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:33.139215  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:32.888540 11349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.011s	sys 0.038s
I20260709 13:02:33.141232  8332 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:33.145077  8897 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:33.136543 10622 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:33.024957 11397 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:02:33.033557 11418 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:02:33.146237  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 237902us
I20260709 13:02:33.148083  8211 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:02:33.148772 11423 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.145699 11354 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.900977 11365 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.023054 11412 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:33.151527  8215 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:33.151819  8211 pending_rounds.cc:85] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 2
I20260709 13:02:32.911116 11361 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:32.946405 11405 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:33.153400  8211 pending_rounds.cc:107] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:02:33.154266 11416 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.154636  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 871) took 1576 ms. Trace:
I20260709 13:02:33.156065 11297 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.155552 11420 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.156771  8895 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:33.158541  8211 raft_consensus.cc:2889] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.144953 11298 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:33.156549 11361 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:02:33.160180 11267 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:33.006866 11367 consensus_queue.cc:1059] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:02:32.911347 11155 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:33.144186 11349 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:33.191264  8895 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:33.194876  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:33.154671 11396 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.159425 11381 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:33.162216 11420 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.142220 11417 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.159s
I20260709 13:02:32.903982 11415 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:33.165114 11405 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:33.143786 11419 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:33.160351 11412 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:32.904793 11411 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:32.904654 11376 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:33.142364 11398 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:33.164584 11298 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:33.252880  8892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:33.162585 11355 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:33.450291  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 568548us
I20260709 13:02:33.206755  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:33.313697  8863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.029s	sys 0.032s
W20260709 13:02:33.449996  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.509459  8863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.039s	sys 0.041s
W20260709 13:02:33.510352  8259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.002s
I20260709 13:02:33.510775  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:33.509445  8862 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:33.511686  8893 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:02:33.460520  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.306998  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:33.513093 11396 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.513834 11405 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:33.508147  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:33.515270  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:33.199247 11391 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.513576 11396 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:33.338789 11374 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.925s	user 0.002s	sys 0.002s
W20260709 13:02:33.510665  8259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.009s	sys 0.002s
I20260709 13:02:33.505628 11371 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.517102  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:33.199498 11420 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.517168  8358 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:33.522194 10944 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.204885 11381 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:33.522763  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:33.524454 11396 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:33.524999 11423 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:33.287793 11386 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:33.322602 11172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.023s	sys 0.035s
I20260709 13:02:33.521565  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:33.379314 11088 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.561563  8218 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:33.616979  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:33.386174 11363 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:33.354676 11183 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.524456 11311 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:33.449694 11388 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.498951 11377 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.166524 11416 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:33.223887 11349 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.210632 11407 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.210902  8863 leader_election.cc:400] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:33.516764 11427 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.211632 11172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.031s	sys 0.063s
W20260709 13:02:34.010346  8361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.009s	sys 0.024s
W20260709 13:02:34.215595  8361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.010s	sys 0.040s
W20260709 13:02:34.213764  8258 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.006s	sys 0.002s
W20260709 13:02:34.216288  8258 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.006s	sys 0.002s
W20260709 13:02:34.213081  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 704011us
W20260709 13:02:34.216699  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 708182us
I20260709 13:02:33.658576  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.219033  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2132) took 1353 ms. Trace:
I20260709 13:02:34.219321  8363 rpcz_store.cc:276] 0709 13:02:32.865828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.658303 (+792475us) service_pool.cc:224] Handling call
0709 13:02:34.218979 (+560676us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.015686  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.211362  8863 leader_election.cc:403] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:34.220258 11285 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:33.161204  8889 rpcz_store.cc:276] 0709 13:02:31.578148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.370617 (+792469us) service_pool.cc:224] Handling call
0709 13:02:32.375875 (+  5258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.377911 (+  2036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.154439 (+776528us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b5400636350. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:33.154576 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10713984}
I20260709 13:02:34.221483  8358 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 3.
W20260709 13:02:33.961948  8256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.012s	sys 0.039s
W20260709 13:02:34.223289  8256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.016s	sys 0.043s
I20260709 13:02:33.511790 11361 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.225575 11361 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:34.228401 11361 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.617381  8892 raft_consensus.cc:606] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:34.132005  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.222545 11311 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:33.774324  8216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.017s	sys 0.024s
I20260709 13:02:34.243091 11388 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:33.994827 11398 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.247354 11003 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:33.511127 11373 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.231688  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:34.231868  8183 connection.cc:256] RPC call timeout handler was delayed by -2.1431325240000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:02:34.286032  8183 connection.cc:256] RPC call timeout handler was delayed by -2.1377325240000573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:02:34.286509  8183 connection.cc:256] RPC call timeout handler was delayed by -2.1170325240000238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:02:33.616671 11297 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:34.233259 11268 raft_consensus.cc:3055] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:34.235296 11427 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.253929 11407 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.236272  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:34.220258  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.221946  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1688) took 1331 ms. Trace:
I20260709 13:02:34.212438 11088 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:34.242385  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:34.299124  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 83507.3us
I20260709 13:02:34.300694  8291 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:34.299706  8358 rpcz_store.cc:276] 0709 13:02:32.890849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.600027 (+709178us) service_pool.cc:224] Handling call
0709 13:02:34.221894 (+621867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.245144  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.301925  8285 raft_consensus.cc:2410] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:34.246876  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:34.242923 11376 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:33.791813 11358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.762s	user 0.007s	sys 0.023s
W20260709 13:02:33.963109 11374 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:02:33.720938 11411 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.993943 11298 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:33.956089 11419 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:33.992843 11381 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:33.657902 10944 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.322844  8889 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 9: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:34.332063  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2233) took 1198 ms. Trace:
I20260709 13:02:34.332513  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:34.333184  8889 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:34.333730 10944 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.334153  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:34.334532  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:34.292063 11412 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.335209  8891 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:34.336588 11155 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.323190  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2225) took 1613 ms. Trace:
I20260709 13:02:34.337324  8257 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:34.268610  8894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 719) took 3940 ms (client timeout 1917 ms). Trace:
W20260709 13:02:34.338488  8894 rpcz_store.cc:269] 0709 13:02:30.327804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.337771 (+  9967us) service_pool.cc:224] Handling call
0709 13:02:34.268403 (+3930632us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54005cf154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:34.268534 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870867968}
I20260709 13:02:34.332433  8218 rpcz_store.cc:276] 0709 13:02:33.133772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.134658 (+   886us) service_pool.cc:224] Handling call
0709 13:02:34.326569 (+1191911us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400425254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:34.331995 (+  5426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967509248}
I20260709 13:02:34.339910  8894 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:02:34.340279 11155 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:34.257676  8898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1160) took 3710 ms (client timeout 1998 ms). Trace:
W20260709 13:02:34.341333  8898 rpcz_store.cc:269] 0709 13:02:30.547598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.628530 (+ 80932us) service_pool.cc:224] Handling call
0709 13:02:34.257472 (+3628942us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002b34d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:34.257611 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3454273792}
I20260709 13:02:34.278301  8892 raft_consensus.cc:614] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:34.279932  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.007s	sys 0.032s
W20260709 13:02:34.342442  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.007s	sys 0.032s
W20260709 13:02:34.342739  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 1.17897e+06us
I20260709 13:02:34.343950  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1674) took 1807 ms. Trace:
I20260709 13:02:34.344331  8367 rpcz_store.cc:276] 0709 13:02:32.536504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.543369 (+  6865us) service_pool.cc:224] Handling call
0709 13:02:34.343806 (+1800437us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b54003188d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:34.343895 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8423680}
I20260709 13:02:34.345232  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:34.281154  8216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.023s	sys 0.033s
I20260709 13:02:34.345990  8367 raft_consensus.cc:2410] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:34.230223 11416 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.248098 11396 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:34.288868  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.346535  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2134) took 1459 ms. Trace:
I20260709 13:02:34.349398 11441 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.352617 11441 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.354777  8864 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:34.354974  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2222) took 1646 ms. Trace:
W20260709 13:02:34.306677 11358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.456s	user 0.025s	sys 0.038s
I20260709 13:02:34.351485  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2232) took 1218 ms. Trace:
W20260709 13:02:34.349682  8332 leader_election.cc:336] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.998s (SENT)
I20260709 13:02:34.350718  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:34.353017  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.329891  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:34.351441  8890 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:34.358832  8896 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:34.356961  8332 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:34.320119  8893 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:34.248230 11183 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:02:34.254199 11363 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:34.299825  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2137) took 1165 ms. Trace:
I20260709 13:02:34.377085  8363 rpcz_store.cc:276] 0709 13:02:33.134578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.220031 (+1085453us) service_pool.cc:224] Handling call
0709 13:02:34.299765 (+ 79734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.243597  8258 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:34.303745  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.378696  8285 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
W20260709 13:02:34.378970  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 135519us
I20260709 13:02:34.379436  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.380030  8258 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:34.304076  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.305446  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.380739  8358 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:34.380828  8291 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:34.289510 11398 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.381142  8358 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1682) took 1492 ms (client timeout 1947 ms). Trace:
W20260709 13:02:34.381471  8358 rpcz_store.cc:269] 0709 13:02:32.889224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.301558 (+1412334us) service_pool.cc:224] Handling call
0709 13:02:34.381098 (+ 79540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.380332  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:34.318439  8331 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.026s	sys 0.043s
I20260709 13:02:34.288172 11268 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:34.319244  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.350345  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:34.390381  8331 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.027s	sys 0.043s
W20260709 13:02:34.390741  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 816605us
I20260709 13:02:34.358167  8284 raft_consensus.cc:2410] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:34.360625  8367 rpcz_store.cc:276] 0709 13:02:32.887432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.345005 (+1457573us) service_pool.cc:224] Handling call
0709 13:02:34.346488 (+  1483us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.394376  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.378046  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.395388  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 601) took 1230 ms. Trace:
I20260709 13:02:34.395640  8363 rpcz_store.cc:276] 0709 13:02:33.164907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.377788 (+1212881us) service_pool.cc:224] Handling call
0709 13:02:34.395337 (+ 17549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.381541  8258 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:34.257596 11424 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:34.322583  8897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.005s	sys 0.009s
I20260709 13:02:34.409091  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:34.369091  8366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1684) took 1479 ms (client timeout 1947 ms). Trace:
W20260709 13:02:34.363852 11324 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.815s	user 0.014s	sys 0.018s
I20260709 13:02:34.304772 11423 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.312496 11336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.005s	sys 0.025s
I20260709 13:02:34.355356  8216 rpcz_store.cc:276] 0709 13:02:32.708942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.710942 (+  2000us) service_pool.cc:224] Handling call
0709 13:02:32.711280 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:32.846488 (+135208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.846519 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:32.891764 (+ 45245us) log.cc:844] Serialized 52 byte log entry
0709 13:02:34.346356 (+1454592us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:34.346394 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.346455 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.354771 (+  8316us) raft_consensus.cc:1685] finished
0709 13:02:34.354790 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.354920 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26407,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3102,"thread_start_us":1314990,"threads_started":1,"wal-append.queue_time_us":1304241}
I20260709 13:02:34.430540 11361 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.429813 11268 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.390901  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1686) took 1500 ms. Trace:
I20260709 13:02:34.356737  8214 rpcz_store.cc:276] 0709 13:02:33.133481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.133584 (+   103us) service_pool.cc:224] Handling call
0709 13:02:33.133865 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.134202 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.134227 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.138790 (+  4563us) log.cc:844] Serialized 26 byte log entry
0709 13:02:33.597052 (+458262us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:33.597102 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.597182 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.351266 (+754084us) raft_consensus.cc:1685] finished
0709 13:02:34.351288 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.351411 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":404,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6512,"thread_start_us":374172,"threads_started":1,"wal-append.queue_time_us":1116277}
I20260709 13:02:34.375433 11155 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:34.406728  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.432313  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1690) took 1267 ms. Trace:
I20260709 13:02:34.432171 11155 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:34.406850  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:34.322652 10622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.004s	sys 0.012s
I20260709 13:02:34.355818 11412 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.307456 11407 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:34.330986 11346 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.001s	sys 0.014s
I20260709 13:02:34.288466 11388 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:34.323336 11426 log.cc:927] Time spent T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 13:02:34.409154  8897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.006s	sys 0.009s
W20260709 13:02:34.410287  8366 rpcz_store.cc:269] 0709 13:02:32.889835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.329605 (+1439770us) service_pool.cc:224] Handling call
0709 13:02:34.369015 (+ 39410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.413529  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:34.433014 10622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.004s	sys 0.012s
W20260709 13:02:34.413784  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 196386us
I20260709 13:02:34.407994  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:34.353116 11427 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.416289  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:34.416543  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 66926.1us
I20260709 13:02:34.454973  8285 raft_consensus.cc:2410] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:02:34.455530  8332 connection.cc:256] RPC call timeout handler was delayed by -1.5681831269999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:02:34.455936  8332 connection.cc:256] RPC call timeout handler was delayed by -1.4700831269999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 13:02:34.456224  8332 connection.cc:256] RPC call timeout handler was delayed by -1.3999401709999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4197s for a response
W20260709 13:02:34.456486  8332 connection.cc:256] RPC call timeout handler was delayed by -1.2667401709999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4345s for a response
W20260709 13:02:34.456861  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1973831269999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 13:02:34.355850 11441 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.349387 11337 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:34.460618 11302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.080s	user 0.034s	sys 0.051s
W20260709 13:02:34.461055 11302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.095s	user 0.035s	sys 0.052s
I20260709 13:02:34.419922  8890 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 6. Ops: []
I20260709 13:02:34.460915  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:34.462224  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:34.462517  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.463115  8366 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:34.463663 11302 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.464035 11302 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:34.464066  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.464526 11302 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.466922  8864 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:34.467301 11407 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.464726  8366 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:34.416862  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.420257  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:34.421201  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.413151 11230 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:34.424801 11354 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.410437 11363 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.413259 11360 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:34.471495 11360 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:34.471886 11360 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:34.472777 11363 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.425832  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:34.472469 11302 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.473436  8898 raft_consensus.cc:2376] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7. Re-sending same reply.
I20260709 13:02:34.413264 11377 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:02:34.475265 11302 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.430956 11361 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.431097  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.437820 11423 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.432700  8358 rpcz_store.cc:276] 0709 13:02:33.167790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.382039 (+1214249us) service_pool.cc:224] Handling call
0709 13:02:34.432257 (+ 50218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.478439 11361 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.479382  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.479969  8358 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:34.480638 11423 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.480832  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.439064 11336 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:34.481580  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:34.481513 11336 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.411227 11416 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:34.481904  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:34.433848  8291 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:34.407650 11429 log.cc:927] Time spent T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:02:34.372264  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:34.429370  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.490355  8367 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:34.486903  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:34.434643  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 147700us
I20260709 13:02:34.356072 11311 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.356887  8211 rpcz_store.cc:276] 0709 13:02:32.709725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.709847 (+   122us) service_pool.cc:224] Handling call
0709 13:02:32.739936 (+ 30089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.167882 (+427946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.322953 (+1155071us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400377dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:34.323136 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936267136}
I20260709 13:02:34.488517  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.411089 11433 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:34.415014 11324 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.883s	user 0.014s	sys 0.018s
W20260709 13:02:34.416409 11420 consensus_meta.cc:287] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.002s
I20260709 13:02:34.431582 11268 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:34.448414  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.494824  8289 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:34.450577  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2124) took 3111 ms. Trace:
I20260709 13:02:34.356297 11396 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.435284 11155 consensus_queue.cc:1243] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer 4a50f39e2d8e4886a79849938f2272a6 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:34.498113  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:34.458040  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 50150.9us
I20260709 13:02:34.458250  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:34.498695  8367 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:34.499248  8259 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:34.460217  8862 leader_election.cc:400] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:34.454201 11346 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.478441 11438 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.470664  8284 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 3.
I20260709 13:02:34.513952 11438 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.431438  8360 rpcz_store.cc:276] 0709 13:02:32.890365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.350089 (+1459724us) service_pool.cc:224] Handling call
0709 13:02:34.390850 (+ 40761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.517141  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.517799  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2139) took 1001 ms. Trace:
I20260709 13:02:34.518112  8360 rpcz_store.cc:276] 0709 13:02:33.516393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.516921 (+1000528us) service_pool.cc:224] Handling call
0709 13:02:34.517748 (+   827us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.513741  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 597) took 1899 ms. Trace:
I20260709 13:02:34.478653  8363 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:34.519905  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:34.520591  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.349699 11088 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.519480  8361 rpcz_store.cc:276] 0709 13:02:32.614682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.862577 (+247895us) service_pool.cc:224] Handling call
0709 13:02:32.880283 (+ 17706us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:32.880638 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.880664 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:32.881161 (+   497us) log.cc:844] Serialized 52 byte log entry
0709 13:02:34.216010 (+1334849us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.216049 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.216114 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.513521 (+297407us) raft_consensus.cc:1685] finished
0709 13:02:34.513539 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.513685 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245,"raft.queue_time_us":805,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":21214,"thread_start_us":1313517,"threads_started":1,"wal-append.queue_time_us":1389569}
W20260709 13:02:34.522977  8183 connection.cc:256] RPC call timeout handler was delayed by -1.8848325240000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:02:34.484264  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:34.482796 11441 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:34.486938 11336 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.491459  8290 raft_consensus.cc:2410] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:02:34.437314  8331 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:34.492486  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:34.492743  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:34.492944  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:34.493597  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.543053  8890 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.470012 11388 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.495633  8364 rpcz_store.cc:276] 0709 13:02:31.339173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.340670 (+  1497us) service_pool.cc:224] Handling call
0709 13:02:31.381811 (+ 41141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.405202 (+ 23391us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:31.467525 (+ 62323us) log.cc:844] Serialized 14 byte log entry
0709 13:02:32.361005 (+893480us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.446095 (+ 85090us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.446876 (+   781us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:32.453379 (+  6503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.453675 (+   296us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.026298 (+572623us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18003fcd00. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef912e2a6 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9160522 00007f2ef91627c1
0709 13:02:33.027649 (+  1351us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b18003fcd00. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9160522 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:33.145707 (+118058us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:34.450333 (+1304626us) raft_consensus.cc:1685] finished
0709 13:02:34.450357 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.450511 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":256937,"prepare.queue_time_us":63812,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":6452,"raft.queue_time_us":779934,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":17926,"spinlock_wait_cycles":66941184,"thread_start_us":312170,"threads_started":2,"wal-append.queue_time_us":702482}
I20260709 13:02:34.506695  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.545040  8291 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:34.545418  8367 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:34.501452  8285 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:34.545677 11088 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:34.545840  8183 connection.cc:256] RPC call timeout handler was delayed by -1.762883200000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:02:34.546594  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:34.547003  8183 connection.cc:256] RPC call timeout handler was delayed by -1.6215832000000319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 13:02:34.500276  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 128195us
I20260709 13:02:34.418723 11398 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:34.510146  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 50078.9us
W20260709 13:02:34.560344  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 123127us
I20260709 13:02:34.469918  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.497709 11423 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:34.562556  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1166) took 1992 ms. Trace:
I20260709 13:02:34.506342 11070 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:02:34.511904 11346 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.506269 10733 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.512364 11416 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:34.522013  8365 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:34.521040  8898 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:34.519047  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:34.524633 10841 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:34.525033 11411 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:34.527216  8363 pending_rounds.cc:85] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 4
I20260709 13:02:34.482933  8358 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:34.581646  8363 pending_rounds.cc:107] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:02:34.501341 11419 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:34.530725 11368 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 2.707s	user 0.005s	sys 0.047s
I20260709 13:02:34.563549 11051 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:34.501075 11420 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.413592 11424 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:34.538981  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 54808.1us
W20260709 13:02:34.594830  8332 leader_election.cc:336] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.607s (SENT)
W20260709 13:02:34.543820  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 50976.6us
I20260709 13:02:34.508132  8259 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:02:34.551470  8183 connection.cc:256] RPC call timeout handler was delayed by -1.5806325240000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2554s for a response
I20260709 13:02:34.595178  8332 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:34.561553  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 602) took 1395 ms. Trace:
I20260709 13:02:34.562178  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:34.595449  8183 connection.cc:256] RPC call timeout handler was delayed by -1.3569832000000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:02:34.595760  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:34.595882  8183 connection.cc:256] RPC call timeout handler was delayed by -1.2597832000000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 13:02:34.596488  8183 connection.cc:256] RPC call timeout handler was delayed by -1.1679832000000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:02:34.596839  8862 leader_election.cc:400] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7.
I20260709 13:02:34.595705  8366 rpcz_store.cc:276] 0709 13:02:33.165854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.469681 (+1303827us) service_pool.cc:224] Handling call
0709 13:02:34.561488 (+ 91807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.564433  8897 rpcz_store.cc:276] 0709 13:02:32.569992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.150013 (+580021us) service_pool.cc:224] Handling call
0709 13:02:33.159626 (+  9613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.163342 (+  3716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.163672 (+   330us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.196402 (+ 32730us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.453684 (+1257282us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.547451 (+ 93767us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.562296 (+ 14845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.562365 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.562401 (+    36us) raft_consensus.cc:1685] finished
0709 13:02:34.562412 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.562507 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":495,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3753,"thread_start_us":1275834,"threads_started":2,"wal-append.queue_time_us":1232245}
I20260709 13:02:34.564301  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:34.560194 11373 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:34.546307 11088 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:34.535826 11360 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.581935  8363 raft_consensus.cc:2889] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.587265  8890 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:34.559908 11172 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.546761 11446 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:34.588879  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 598) took 1430 ms. Trace:
I20260709 13:02:34.535437 11396 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:34.580403 11340 log.cc:927] Time spent T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 2.395s	user 0.016s	sys 0.045s
I20260709 13:02:34.563694 11423 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:34.589452  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:34.571372 11070 consensus_queue.cc:1243] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer 4a50f39e2d8e4886a79849938f2272a6 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:34.597738  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:34.580762 11337 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.589942 11411 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.582672 11152 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.602042  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:34.619168 11349 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:34.588266 11419 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.604620  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:34.650955  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 46425.6us
I20260709 13:02:34.651278 11462 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.614641  8360 rpcz_store.cc:276] 0709 13:02:33.158163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.588266 (+1430103us) service_pool.cc:224] Handling call
0709 13:02:34.588493 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.588625 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.588645 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.588675 (+    30us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:34.588703 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.588751 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.588832 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.617233  8358 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
W20260709 13:02:34.617802  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.591423 11051 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:34.588105 10733 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:34.622469  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.604810 11427 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:34.591063 10841 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.612300 11311 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:34.606261 11441 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:34.580989 11416 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:34.632513  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:34.643016  8864 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:34.603168  8332 leader_election.cc:336] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.623s (SENT)
I20260709 13:02:34.646755  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2136) took 1735 ms. Trace:
I20260709 13:02:34.618880 11388 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:34.620039 11281 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.618391 11446 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:34.603741 11373 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:34.611204  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 103200us
W20260709 13:02:34.651942  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0631325240000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3129s for a response
I20260709 13:02:34.653797  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2138) took 1458 ms. Trace:
I20260709 13:02:34.629755 11423 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:34.618618 11230 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:02:34.618736 11390 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:02:34.641031 11396 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.667608 10841 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:34.664940  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 61836.3us
I20260709 13:02:34.664743  8367 rpcz_store.cc:276] 0709 13:02:32.911395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.548582 (+1637187us) service_pool.cc:224] Handling call
0709 13:02:34.562925 (+ 14343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:34.589186 (+ 26261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.589214 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:34.591967 (+  2753us) log.cc:844] Serialized 52 byte log entry
0709 13:02:34.644151 (+ 52184us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.644190 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.644258 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.646505 (+  2247us) raft_consensus.cc:1685] finished
0709 13:02:34.646524 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.646694 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17783,"raft.queue_time_us":26391,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2439,"thread_start_us":25663,"threads_started":1,"wal-append.queue_time_us":41691}
I20260709 13:02:34.655376 11051 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:34.661031  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 600) took 1499 ms. Trace:
I20260709 13:02:34.658743 11336 raft_consensus.cc:2764] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:34.618563 11447 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:02:34.654386 11419 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:34.648276 11349 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:34.667569  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2135) took 1766 ms. Trace:
I20260709 13:02:34.668107  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.685809  8360 rpcz_store.cc:276] 0709 13:02:33.195037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.653043 (+1458006us) service_pool.cc:224] Handling call
0709 13:02:34.653345 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.653516 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.653544 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.653580 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.653613 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.653658 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.653748 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.687096  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.682498  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:34.660460 11311 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:34.689519 11446 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:34.649150 11438 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.648679 11356 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:34.691071  8358 rpcz_store.cc:276] 0709 13:02:33.161379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.652473 (+1491094us) service_pool.cc:224] Handling call
0709 13:02:34.660651 (+  8178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.660804 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.660819 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.660846 (+    27us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:34.660865 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.660896 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.660980 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.618544 11172 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:34.662144 11452 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:02:34.690284  8332 leader_election.cc:336] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.035s (SENT)
I20260709 13:02:34.696266 11346 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:34.696812  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 64405.4us
I20260709 13:02:34.697041 11433 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:34.699101  8367 raft_consensus.cc:3055] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:34.666688 11443 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:02:34.646678 11459 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:34.668398 11416 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:34.693282 11353 log.cc:927] Time spent T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 2.959s	user 0.011s	sys 0.049s
I20260709 13:02:34.700788  8361 rpcz_store.cc:276] 0709 13:02:32.901099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.524927 (+1623828us) service_pool.cc:224] Handling call
0709 13:02:34.525271 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:34.525627 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.525657 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:34.526260 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:02:34.580291 (+ 54031us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:34.580318 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.580375 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.667376 (+ 87001us) raft_consensus.cc:1685] finished
0709 13:02:34.667395 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.667517 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2279,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":53654,"threads_started":1,"wal-append.queue_time_us":84589}
I20260709 13:02:34.653731 11152 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:34.697690 11449 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:02:34.709712  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 66810.5us
I20260709 13:02:34.740309  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:34.684083 11388 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:34.713796  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 62300.8us
I20260709 13:02:34.714309 11356 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.713352 11275 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:34.657984 11462 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.719323  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:34.690178 11281 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:34.707788 11349 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.721308  8862 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:34.723140 11424 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.723948 11360 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.788044 11396 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:34.686008 11361 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:34.728186  8358 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:34.710667 11373 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:34.726302  8367 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:34.735787  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.723301 10733 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:34.746569  8290 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:34.746718 11356 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:34.746992 11275 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.754526  8258 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:34.710402 11311 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:34.729948 11459 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.744333 11388 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.753630 11398 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:34.802896  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 151719us
I20260709 13:02:34.802364  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.042897  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 736) took 1531 ms. Trace:
W20260709 13:02:34.879313  8259 leader_election.cc:336] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 1.947s (SENT)
I20260709 13:02:34.887710  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:35.053658  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 174477us
W20260709 13:02:34.803454  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 49034.4us
W20260709 13:02:35.044236  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 361979us
W20260709 13:02:35.054890  8259 leader_election.cc:336] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 2.110s (SENT)
I20260709 13:02:35.057143  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.057282  8183 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:34.798039  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 76823.3us
I20260709 13:02:34.807461  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:35.056195  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.059427  8890 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:34.887409  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:35.061276  8897 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:34.888801  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 112626us
W20260709 13:02:34.830207  8362 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 579) took 4968 ms (client timeout 1855 ms). Trace:
I20260709 13:02:34.867465  8894 pending_rounds.cc:85] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 4
I20260709 13:02:35.117733  8894 pending_rounds.cc:107] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:02:35.118178  8894 raft_consensus.cc:2889] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.117936  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:35.118219  8362 rpcz_store.cc:269] 0709 13:02:29.830097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.266248 (+436151us) service_pool.cc:224] Handling call
0709 13:02:34.791095 (+4524847us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b5400050d54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:34.798873 (+  7778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5023401728}
I20260709 13:02:35.121282  8890 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:35.120402  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 58349.1us
I20260709 13:02:34.822626  8367 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.091159  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.063717  8211 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:34.790366 11344 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.124357  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:35.125062  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 70239.2us
I20260709 13:02:35.128247  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.131721  8361 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:35.131985  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.133567  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:34.860476 11360 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:34.859925 10733 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.137200  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.140007  8217 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:35.137862  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.140853  8213 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:35.141001  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:35.137892  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:34.790501 11264 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:35.054312  8895 rpcz_store.cc:276] 0709 13:02:33.511872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.211164 (+699292us) service_pool.cc:224] Handling call
0709 13:02:34.211651 (+   487us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:34.212119 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.212145 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:34.212692 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 13:02:34.415654 (+202962us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.417034 (+  1380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.417099 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.042066 (+624967us) raft_consensus.cc:1685] finished
0709 13:02:35.042634 (+   568us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.042821 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26756,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9702,"thread_start_us":202590,"threads_started":1,"wal-append.queue_time_us":289222}
I20260709 13:02:34.859651 11180 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:34.821312 11275 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:34.795516 11420 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.145535  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:34.903903 11369 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:35.152916  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.153815  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.153988  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.154630  8361 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:35.152130  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.059785 11459 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.917318 11411 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.150597  8214 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:34.797699 11088 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:35.158438  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2311) took 2940 ms. Trace:
I20260709 13:02:35.159248  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.161922  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.162534  8362 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:35.164737  8358 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:35.165510  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.166983  8897 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:35.166062  8890 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:35.159175  8288 rpcz_store.cc:276] 0709 13:02:32.209218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.220097 (+ 10879us) service_pool.cc:224] Handling call
0709 13:02:32.329377 (+109280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:32.451089 (+121712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.451118 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:32.451614 (+   496us) log.cc:844] Serialized 52 byte log entry
0709 13:02:35.142375 (+2690761us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b1800498100. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2efbdf54bc 00007f2ef914348b 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1
0709 13:02:35.142524 (+   149us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.142560 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.142630 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.142672 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:35.142684 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.149440 (+  6756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75985,"raft.queue_time_us":133718,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":8867,"spinlock_wait_cycles":10634112,"thread_start_us":36850,"threads_started":1,"wal-append.queue_time_us":145755,"wal-append.run_cpu_time_us":1546,"wal-append.run_wall_time_us":1036144}
I20260709 13:02:35.130030 11344 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:35.142473 11360 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.133594 11433 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:35.146533 11172 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:35.145977 11137 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:35.164448 11276 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.797060 11464 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.379s
I20260709 13:02:35.185907  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.186959  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.203521  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:35.203699 11180 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:35.204210 11180 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:35.204676  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:35.205216  8362 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:35.206566 11472 log.cc:927] Time spent T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:02:35.208325 11468 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:02:35.209550  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58924 (request call id 11) took 1987 ms. Trace:
I20260709 13:02:35.209945  8892 rpcz_store.cc:276] 0709 13:02:33.221835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.252745 (+ 30910us) service_pool.cc:224] Handling call
0709 13:02:35.209375 (+1956630us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54004c86d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc247853 00007f2f0121560a 00007f2efa79b7d4 00007f2efa79b762 00007f2efa79b691 00007f2efa79b60c 00007f2efa79a8c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:35.209473 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263411968}
I20260709 13:02:35.211246  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.212360  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.212960  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.178768 11088 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:35.183531 11360 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.215020  8362 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:35.190867  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.216560  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.217592  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:35.195319  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.220009 11349 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:35.221735 11446 consensus_meta.cc:287] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.000s
I20260709 13:02:35.159914 11471 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:35.170367 11264 raft_consensus.cc:697] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:35.190057  8895 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:35.201936 11415 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.215183 11462 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.227156  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.214161  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.200809  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.214699  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2133) took 2332 ms. Trace:
I20260709 13:02:35.222990  8361 raft_consensus.cc:2376] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8. Re-sending same reply.
I20260709 13:02:35.231588  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.213449  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:35.225329 11423 consensus_meta.cc:287] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.000s
I20260709 13:02:35.276638 11423 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.184763 11398 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:35.278429 11398 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.227600 11361 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.227099 11264 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:35.275748  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 44816.6us
I20260709 13:02:35.281651  8863 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.283761  8863 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.222889 11137 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:35.285036 11137 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.285876 11398 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:35.288094  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.286911  8863 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.183172 11344 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.285051  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.307979  8895 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:35.308871  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.309571  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:35.287148 11396 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:35.310635  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.311214  8898 raft_consensus.cc:2376] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7. Re-sending same reply.
I20260709 13:02:35.311964  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.233551  8210 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:35.314757  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.315719  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.316636  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.317278  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.318501 10733 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:35.319118 11051 consensus_meta.cc:287] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.620s	user 0.004s	sys 0.004s
I20260709 13:02:35.318526  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.309959  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.232609  8897 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:35.233174  8363 rpcz_store.cc:276] 0709 13:02:32.882529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.526693 (+1644164us) service_pool.cc:224] Handling call
0709 13:02:34.527011 (+   318us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:34.714595 (+187584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.714624 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:34.715093 (+   469us) log.cc:844] Serialized 78 byte log entry
0709 13:02:35.118864 (+403771us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:35.118903 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.118971 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.214469 (+ 95498us) raft_consensus.cc:1685] finished
0709 13:02:35.214487 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.214646 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11173,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8211,"thread_start_us":433543,"threads_started":2,"wal-append.queue_time_us":431351}
I20260709 13:02:35.320407  8863 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.312960  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:35.234871 11366 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:35.234596 11088 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.234607 11200 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:02:35.316778 11275 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.260921  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:35.334921  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 275122us
I20260709 13:02:35.337131  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.287350 11428 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:35.339620  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.342476  8362 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:35.340283  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.222054 11349 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:35.322705 11335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.013s	sys 0.018s
I20260709 13:02:35.188550 11441 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 13:02:35.346405  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.319562 11051 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:35.347890  8210 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:35.351183  8363 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.372756  8898 raft_consensus.cc:2368] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
I20260709 13:02:35.324659 11183 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.380146  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:35.380659  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 323575us
I20260709 13:02:35.324682 11366 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:35.384893  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:35.225371 11471 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:35.385851  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.232282 11446 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.224925 11416 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.392364  8210 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:35.379057 11323 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.231462 11276 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.399255 11474 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:02:35.402352  8365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1669) took 2911 ms (client timeout 1799 ms). Trace:
I20260709 13:02:35.402597  8359 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:35.341715 11396 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.397984  8895 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:35.401264 11323 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.409571  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:35.410152  8895 raft_consensus.cc:2376] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7. Re-sending same reply.
I20260709 13:02:35.411018  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:35.411772  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.412099 11276 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:35.412847 11051 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:35.415280  8216 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:35.342244 11428 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:35.372262 11335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.013s	sys 0.019s
I20260709 13:02:35.308763 11466 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:02:35.373816 11398 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.403294  8890 raft_consensus.cc:2376] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5. Re-sending same reply.
I20260709 13:02:35.402818  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2322) took 1144 ms. Trace:
W20260709 13:02:35.403878  8365 rpcz_store.cc:269] 0709 13:02:32.491680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.510205 (+ 18525us) service_pool.cc:224] Handling call
0709 13:02:35.402170 (+2891965us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400108e54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:35.402284 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4536696704}
I20260709 13:02:35.426035  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.406381  8358 raft_consensus.cc:2393] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:35.424527  8289 rpcz_store.cc:276] 0709 13:02:34.258445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.495465 (+237020us) service_pool.cc:224] Handling call
0709 13:02:34.515799 (+ 20334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.515943 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.515964 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.515998 (+    34us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:34.516032 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.516082 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.402669 (+886587us) spinlock_profiling.cc:243] Waited 9.03 ms on lock 0x7b5400146c50. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:35.402767 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20772224}
I20260709 13:02:35.401083  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.416267  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.431196  8216 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:35.419229 11428 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.411223 11323 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:35.419608  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:35.420224  8892 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:35.421738  8895 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:35.431875  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 50251.8us
I20260709 13:02:35.432076  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.337575 11088 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.433667  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:35.433192  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 302202us
I20260709 13:02:35.434504  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.402141 11183 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:35.436637  8365 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 4. Current term is 6. Ops: []
I20260709 13:02:35.439724  8210 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:35.403642 11311 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.437619  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.438997  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.443122  8212 raft_consensus.cc:2410] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:35.446537  8216 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:02:35.439052 11419 consensus_meta.cc:287] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.003s
I20260709 13:02:35.425155 11180 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.448963 11360 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.450667 11311 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:35.432693  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:35.464416 11180 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:35.464533 11360 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.466015 11474 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:35.468003 11474 consensus_queue.cc:1059] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:35.468983 11481 raft_consensus.cc:3055] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:35.469339 11481 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:35.470108 11481 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.470924 11275 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:35.471387 11481 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.429137 11398 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.480733  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.481393  8216 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:35.450667 11088 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.476948  8258 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:35.423920 11366 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.464478 11416 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.461089 11471 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:35.494724  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:35.440497  8259 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.476186 11379 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:35.490685 11356 consensus_meta.cc:287] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 13:02:35.502689  8365 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:35.497596  8183 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.509336  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:35.535624  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.509935  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 69547.1us
I20260709 13:02:35.513376 10622 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:35.513818 11415 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:35.517328 11137 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.626928 11386 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:35.627151 11344 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:35.628417  8364 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 4: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:35.518504 11478 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:35.519006 11471 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:35.507807 11467 consensus_queue.cc:1059] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:02:35.521775 11458 log.cc:927] Time spent T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.781s	user 0.008s	sys 0.000s
I20260709 13:02:35.631175 11467 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:35.631546 11467 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:02:35.632011 11388 consensus_meta.cc:287] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.001s
I20260709 13:02:35.632467 11467 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.633261  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.633868  8212 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:35.634727  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:35.492136 11373 consensus_queue.cc:1059] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 13:02:35.637238 11373 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:35.637579 11373 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:35.638391 11373 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.474381 11419 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.640189  8218 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:35.547469 10841 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.641239 11419 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.646272 11366 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.479475 11376 consensus_queue.cc:1059] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:02:35.650674 11376 raft_consensus.cc:3055] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:35.651094 11376 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:35.652580 11376 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.658484  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.659880  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.476186 11459 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:35.532514 11379 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.671012 11379 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.547931 11285 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:35.674474 11285 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:35.675441 11285 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.553838  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:35.547943  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2104) took 3821 ms. Trace:
I20260709 13:02:35.632490 11388 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.680825  8292 rpcz_store.cc:276] 0709 13:02:31.726553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.893125 (+166572us) service_pool.cc:224] Handling call
0709 13:02:31.976122 (+ 82997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.889033 (+912911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.547664 (+2658631us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54002751d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:35.547877 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085224832}
I20260709 13:02:35.548441 11356 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:35.715919  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.716751  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.717056  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.491741 11230 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:35.507617 11088 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.321s
I20260709 13:02:35.764510  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:35.830639  8897 raft_consensus.cc:2393] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:35.797606 11415 raft_consensus.cc:697] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:35.653833 11376 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:35.873237 11379 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:35.899720  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.890015 11344 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:35.885201 11428 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:35.900345  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.903512 11137 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:35.902464  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 405113us
W20260709 13:02:35.937463 11264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.012s	sys 0.012s
I20260709 13:02:35.910506 11416 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:35.909811  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 145474us
I20260709 13:02:35.912325 11088 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:35.913725 11415 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.914289 11230 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:35.926515 11459 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:35.927237 11467 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:35.888016 11388 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:35.903156  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2118) took 1463 ms. Trace:
I20260709 13:02:35.899078  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:35.899700  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:35.966414  8212 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.928403  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:35.967339  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 67731.4us
W20260709 13:02:35.938578  8862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.017s	sys 0.031s
I20260709 13:02:35.908601  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:35.943288  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.950295  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.909027 11373 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.959630  8183 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:35.958113 11264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.012s	sys 0.012s
I20260709 13:02:35.960502 11416 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:35.926736 11152 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:36.001519  8862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.024s	sys 0.037s
W20260709 13:02:35.978768  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.004129  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 607799us
I20260709 13:02:35.960652 11446 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:36.005270  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 45720.1us
I20260709 13:02:36.004834 11416 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:36.009541  8216 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.961862 11088 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:36.012585  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:35.966092  8291 rpcz_store.cc:276] 0709 13:02:34.439927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.563577 (+123650us) service_pool.cc:224] Handling call
0709 13:02:34.563928 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.564155 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.564177 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.564600 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.630725 (+ 66125us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:34.630771 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.630844 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.521259 (+890415us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:35.902860 (+381601us) raft_consensus.cc:1685] finished
0709 13:02:35.902880 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.903100 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94029696,"thread_start_us":36972,"threads_started":1,"wal-append.queue_time_us":111731}
I20260709 13:02:36.013904  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.014665  8360 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.016506  8259 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.018975  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:36.019649  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.023694  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.968122 11137 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:36.024463  8862 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:35.965996 11356 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.029356 11496 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:35.962412 11419 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:02:36.026413 11446 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:36.024245 11264 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:36.024792 11388 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.036870 11496 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.046593  8360 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:36.028611 11486 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.045384  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:36.047824  8216 raft_consensus.cc:2410] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:36.051239  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:36.047930  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.052141  8360 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.049108  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:36.038154 11137 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:36.041064 11446 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:36.058542 11388 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:36.043438 11366 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.039897 11356 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.046370 11379 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.047547 11459 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.048704 11496 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.049986 11486 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:36.060185 11137 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:36.082366  8896 raft_consensus.cc:2393] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:36.060756 10841 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.034096 11088 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.092705 11366 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.094470 11366 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.094837 11088 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:36.096614 11366 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.064209 11446 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.100330  8212 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:36.076853 11311 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:36.102547 11311 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.104535 11311 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.104935  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 744) took 1785 ms. Trace:
I20260709 13:02:36.074412 11264 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:36.080353 11388 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:36.106346 11264 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.105433  8889 rpcz_store.cc:276] 0709 13:02:34.319949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.341738 (+ 21789us) service_pool.cc:224] Handling call
0709 13:02:34.342052 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.631666 (+289614us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:34.692464 (+ 60798us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.787390 (+ 94926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.787449 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:34.787507 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.104660 (+1317153us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54006aa754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:36.104713 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.104871 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6432,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":79,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"spinlock_wait_cycles":637050240,"thread_start_us":95961,"threads_started":2,"wal-append.queue_time_us":209654}
I20260709 13:02:36.107030 11388 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.108464 11264 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.109364  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:36.110363 11428 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.112385 11230 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:36.112955 11465 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.205s	user 0.006s	sys 0.013s
I20260709 13:02:36.114323  8216 raft_consensus.cc:2410] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:02:36.109396 11489 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:02:36.115309  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 599) took 2955 ms. Trace:
I20260709 13:02:36.115669  8366 rpcz_store.cc:276] 0709 13:02:33.159674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.597921 (+1438247us) service_pool.cc:224] Handling call
0709 13:02:34.598261 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.613504 (+ 15243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.613532 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.620084 (+  6552us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.702569 (+ 82485us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:34.702606 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.702665 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.112470 (+1409805us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:36.115023 (+  2553us) raft_consensus.cc:1685] finished
0709 13:02:36.115043 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.115250 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14883,"raft.queue_time_us":15028,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4260,"spinlock_wait_cycles":2570624,"thread_start_us":41722,"threads_started":1,"wal-append.queue_time_us":96399}
I20260709 13:02:36.117177 11416 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.079391 11356 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.120007 11356 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:36.122825 11492 log.cc:927] Time spent T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:02:36.124379  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.125530  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.126040  8211 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:36.134196  8893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 735) took 2820 ms (client timeout 2118 ms). Trace:
I20260709 13:02:36.092571 11486 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.138710  8365 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:36.148797  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.149399  8215 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:36.135848  8893 rpcz_store.cc:269] 0709 13:02:33.314000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.521349 (+207349us) service_pool.cc:224] Handling call
0709 13:02:36.133979 (+2612630us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b54004934d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:36.134122 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228529408}
W20260709 13:02:36.157634  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 199889us
I20260709 13:02:36.160693  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 734) took 1023 ms. Trace:
I20260709 13:02:36.162597  8257 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.165783  8257 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.163892  8892 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:36.163859  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.167754  8257 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.186965  8210 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:36.237483  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 725) took 1148 ms. Trace:
I20260709 13:02:36.168959  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 737) took 2652 ms. Trace:
I20260709 13:02:36.280854  8218 rpcz_store.cc:276] 0709 13:02:35.088848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.089049 (+   201us) service_pool.cc:224] Handling call
0709 13:02:35.089381 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.640589 (+551208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.237200 (+596611us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54004740d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:36.237411 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266924288}
I20260709 13:02:36.358628  8367 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:36.359687  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 168340us
I20260709 13:02:36.359836  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:36.163457  8215 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:36.268548  8360 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:36.170733  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2147) took 1052 ms. Trace:
I20260709 13:02:36.280961  8891 rpcz_store.cc:276] 0709 13:02:33.516809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.335760 (+818951us) service_pool.cc:224] Handling call
0709 13:02:34.336005 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.362262 (+ 26257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.362293 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.362335 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:34.362373 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.168761 (+1806388us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54004c86d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:36.168800 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.168908 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59897088}
I20260709 13:02:36.167085  8211 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:36.246619  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.410192  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.163029  8209 rpcz_store.cc:276] 0709 13:02:35.137457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.137958 (+   501us) service_pool.cc:224] Handling call
0709 13:02:35.138288 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.493726 (+355438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.493754 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.501216 (+  7462us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.954337 (+453121us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:36.059803 (+105466us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.060007 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.060133 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.160491 (+100358us) raft_consensus.cc:1685] finished
0709 13:02:36.160510 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.160637 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28912,"prepare.queue_time_us":53561,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":22,"raft.queue_time_us":93237,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":32883,"thread_start_us":765897,"threads_started":3,"wal-append.queue_time_us":450582}
I20260709 13:02:36.410861  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.410267  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:36.412730  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.170804  8362 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:36.411865  8363 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.418308  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:36.419255  8218 raft_consensus.cc:2410] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:36.179705 11314 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.168322 11232 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.161288 11505 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:36.420701  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:36.423594  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:36.424619  8212 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:36.382437 10363 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.425333 10363 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.425702 10363 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.419303  8367 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:36.424803  8360 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 9. Ops: []
I20260709 13:02:36.235646 11398 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.427668  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1691) took 3231 ms. Trace:
I20260709 13:02:36.381910 11450 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.429594  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.412362 11383 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:02:36.171319 11496 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.204685 11446 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.380206 11417 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:02:36.428459 11232 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.479900 11232 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.440699  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2151) took 1091 ms. Trace:
W20260709 13:02:36.444690 11488 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.813s	user 0.015s	sys 0.009s
I20260709 13:02:36.446142  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.446529 11423 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.450765 11416 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.176064 11486 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.496268 11393 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.496718 11393 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.497051 11393 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.497155 11486 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.410576 11371 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:36.497500 11484 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.460503  8367 rpcz_store.cc:276] 0709 13:02:33.195830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.683785 (+1487955us) service_pool.cc:224] Handling call
0709 13:02:34.684070 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.169466 (+1485396us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5400256320. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc1c2a1d 00007f2efc1a91a4 00007f2efc22b447 00007f2efc243fe7 00007f2efc2457de 00007f2efc24fb49 00007f2efc250416 00007f2efc24cd8f 00007f2efc24c83e 00007f2f01211419
0709 13:02:36.426324 (+256858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.427616 (+  1292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4056960}
I20260709 13:02:36.499205 11484 consensus_queue.cc:1059] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:36.500245 11305 raft_consensus.cc:3055] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:36.500625 11305 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:36.500825 11498 log.cc:927] Time spent T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.980s	user 0.003s	sys 0.013s
I20260709 13:02:36.421290  8358 rpcz_store.cc:276] 0709 13:02:35.118025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.172508 (+ 54483us) service_pool.cc:224] Handling call
0709 13:02:36.170505 (+997997us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400433d54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:36.170671 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431933696}
I20260709 13:02:36.474906 11337 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:36.502415  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2240) took 1296 ms. Trace:
I20260709 13:02:36.503253  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:36.382277  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 214684us
I20260709 13:02:36.476009  8214 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:36.508589  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2237) took 1303 ms. Trace:
I20260709 13:02:36.508947  8214 rpcz_store.cc:276] 0709 13:02:35.205274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.213754 (+  8480us) service_pool.cc:224] Handling call
0709 13:02:36.246424 (+1032670us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800002798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:36.508519 (+262095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36200832}
W20260709 13:02:36.248219 11493 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.723s	user 0.004s	sys 0.009s
W20260709 13:02:36.434877  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.480811  8365 rpcz_store.cc:276] 0709 13:02:35.349575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.124090 (+774515us) service_pool.cc:224] Handling call
0709 13:02:36.138534 (+ 14444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.139133 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.440482 (+301349us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b54000c6550. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:36.440626 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32400640}
W20260709 13:02:36.459117 11485 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.939s	user 0.008s	sys 0.013s
W20260709 13:02:36.475308  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 462988us
I20260709 13:02:36.536373  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.537456  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.537596  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:36.538205  8218 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:36.538506  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:02:36.460179 11350 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:02:36.488865  8363 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:36.562949  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:36.240962 11281 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.510535  8257 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:36.511304 10363 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.502833  8213 rpcz_store.cc:276] 0709 13:02:35.206106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.224974 (+ 18868us) service_pool.cc:224] Handling call
0709 13:02:35.414658 (+189684us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b5800002798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:35.414834 (+   176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.415136 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.415162 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.415669 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.499392 (+ 83723us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:35.499436 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.499508 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.186682 (+687174us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b48001c0158. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f01176aa1 00007f2f0116db37 00007f2f0116d9ca 00007f2f0126526f 00007f2f01264f37 00007f2f0127955c 00007f2f01279508 00007f2f01279488 00007f2f01279443 00007f2f012786ec 00007f2f001a2a96
0709 13:02:36.500211 (+313529us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:36.502186 (+  1975us) raft_consensus.cc:1685] finished
0709 13:02:36.502209 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.502351 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1198,"raft.run_cpu_time_us":14770,"raft.run_wall_time_us":769157,"spinlock_wait_cycles":340086272,"thread_start_us":83347,"threads_started":1,"wal-append.queue_time_us":104696}
I20260709 13:02:36.512436  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.481211 11505 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:36.514437 11152 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.516355  8891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b137d34f34145b18037845635e297eb"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:36.516605  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 755) took 1716 ms. Trace:
I20260709 13:02:36.575738 10363 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.519590  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.501864 11305 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.521672  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:36.522670  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.524247 11496 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.524614 11337 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.460740 11450 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.454021 11137 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.529214  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1678) took 3951 ms. Trace:
I20260709 13:02:36.529381  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:36.530906  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.526751 11423 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.582253 11417 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:36.598330 11495 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.078s	user 0.009s	sys 0.004s
I20260709 13:02:36.608166 11423 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.579200 11314 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.609616  8259 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:36.564980 11428 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.594493 11505 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.611033 11428 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.612761 11450 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.613210 11428 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:36.539777  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.613972  8218 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:36.610607  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 81338.8us
I20260709 13:02:36.533071  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.598147  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.565371  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:36.574301  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 63926.3us
I20260709 13:02:36.564555  8862 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:36.575842  8891 raft_consensus.cc:606] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:36.580549  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 68228us
I20260709 13:02:36.580165  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.530123 11424 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:02:36.610636 11268 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:36.602428  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1703) took 1461 ms. Trace:
I20260709 13:02:36.623484  8362 rpcz_store.cc:276] 0709 13:02:35.140977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.451619 (+310642us) service_pool.cc:224] Handling call
0709 13:02:36.170644 (+719025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.413555 (+242911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.602234 (+188679us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400433d50. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:36.602366 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597065600}
I20260709 13:02:36.614389  8359 rpcz_store.cc:276] 0709 13:02:32.578204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.659402 (+ 81198us) service_pool.cc:224] Handling call
0709 13:02:35.402298 (+2742896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.402947 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.529012 (+1126065us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b5400108e50. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:36.529150 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6310556544}
I20260709 13:02:36.616708  8366 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:36.577769  8358 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:36.617261  8891 raft_consensus.cc:614] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:36.617326  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.563277 11347 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:36.617614  8332 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:36.565919 11356 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.578521  8894 rpcz_store.cc:276] 0709 13:02:34.800128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.800814 (+   686us) service_pool.cc:224] Handling call
0709 13:02:34.867230 (+ 66416us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:35.143626 (+276396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.143657 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:35.144299 (+   642us) log.cc:844] Serialized 78 byte log entry
0709 13:02:35.500135 (+355836us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.510655 (+ 10520us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.533356 (+ 22701us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.533520 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.533588 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.112106 (+578518us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b1800399c40. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:36.444132 (+332026us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:36.516380 (+ 72248us) raft_consensus.cc:1685] finished
0709 13:02:36.516401 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.516555 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33670,"prepare.queue_time_us":13578,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":45941,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":5435,"spinlock_wait_cycles":85353856,"thread_start_us":313182,"threads_started":1,"wal-append.queue_time_us":470276}
I20260709 13:02:36.563541 11405 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.619850  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:36.620918  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 55666.1us
W20260709 13:02:36.618423  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 53964.9us
I20260709 13:02:36.626559  8257 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.576040 11172 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.637375  8862 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:36.629457  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.640035  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.641326  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.613664 11486 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.575691 11373 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:36.596179 11337 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.590062 11305 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.635291  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.610991 11264 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.632407 11450 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:36.655763 11371 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.671710 11371 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.672129 11371 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.672237 11393 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.648897 11373 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:36.674440 11373 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:36.659469 11415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.031s
I20260709 13:02:36.671381 11314 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.681787  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.631979 11347 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.683234  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.683993  8291 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:36.684254 11347 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.684808  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.685432  8292 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:36.642958  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.686378  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.686866 11386 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.687183  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:36.687873  8289 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:36.604302 11446 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:36.645009  8257 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:36.689284  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 44389.9us
I20260709 13:02:36.643741 11405 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.643754 11417 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:36.690416 11420 consensus_queue.cc:1059] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.690985  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.691294 10363 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.691430 11420 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:36.691946 10363 raft_consensus.cc:3055] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:36.692243 10363 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:36.692786 11420 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.693202 11420 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.692963 10363 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.693593 11420 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.636097 11483 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.694291 11483 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:36.572762 10841 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.619830 11423 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:36.650691  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:36.644179 11466 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.626636 11462 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.626933 10944 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:36.619238 11301 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.664101 11416 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:36.665015 11486 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:36.667299 11232 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.637846 11356 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.669617  8218 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:36.732401  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:36.649670 11348 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.659168 11264 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:36.670420 11376 consensus_queue.cc:1059] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:36.688305  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.645605  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:36.686360  8896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 752) took 2195 ms (client timeout 1773 ms). Trace:
I20260709 13:02:36.678498  8363 raft_consensus.cc:2393] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:36.696190  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.696882  8358 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:36.697315  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.755615  8291 raft_consensus.cc:2393] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:36.699226  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.695832  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.701526 10363 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:36.756299  8257 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.643913 11172 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.654487  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:36.701648  8365 raft_consensus.cc:2410] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:02:36.702661  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 454426us
W20260709 13:02:36.760309  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.689399 11446 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:36.759199  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.711942  8293 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:36.714917  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.715787  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:36.706907 11361 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.011s	sys 0.019s
I20260709 13:02:36.700897 11386 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.678567 11415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.007s	sys 0.031s
I20260709 13:02:36.649544 11496 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:02:36.733585  8213 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:36.739804  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 102533us
I20260709 13:02:36.784228  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:36.752082 11509 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.744661  8331 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.749665  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.754181 11264 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:36.754288  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 108810us
W20260709 13:02:36.753911  8896 rpcz_store.cc:269] 0709 13:02:34.491167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.492217 (+  1050us) service_pool.cc:224] Handling call
0709 13:02:36.686140 (+2193923us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400675554. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:36.686273 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3541627648}
I20260709 13:02:36.713902 10944 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.757905  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.708142  8366 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:36.763039  8288 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:36.763690  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.766937  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:36.759114  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:36.758131 11152 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.805327  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:36.764206 11361 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.251s	user 0.011s	sys 0.019s
I20260709 13:02:36.785216  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:36.804500  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.806896  8862 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:36.807768  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:36.742169  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:36.810792  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.784893  8358 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:36.805009 11347 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:36.816596  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:36.796501  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46966.9us
I20260709 13:02:36.785676  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2152) took 1434 ms. Trace:
I20260709 13:02:36.713577 11462 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.785425 11446 raft_consensus.cc:697] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:36.802479  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.763015 11172 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.758272 11466 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.776320  8257 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:36.729785 11301 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.762394 11388 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:36.800485  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 55942.1us
I20260709 13:02:36.821499 11347 raft_consensus.cc:697] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:36.805069 11496 consensus_queue.cc:1243] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:36.804153 10944 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.818866  8364 rpcz_store.cc:276] 0709 13:02:35.351655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.128795 (+777140us) service_pool.cc:224] Handling call
0709 13:02:36.129127 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.129315 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:36.540233 (+410918us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.785328 (+245095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.785383 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:36.785428 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.785492 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.785618 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":556834,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":423,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7808,"thread_start_us":652100,"threads_started":2}
I20260709 13:02:36.799376  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:36.848734  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 49462.3us
I20260709 13:02:36.849560  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:36.802970 11506 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.828882  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:36.821653  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:36.829617  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:36.831173 11356 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.834826 11371 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.797564 11386 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.810321 11393 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.859696 11348 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.864946 11446 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.846237  8366 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:36.852947 11496 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:36.866475 11496 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:36.866840 11496 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:36.818017 11428 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:36.868147 11428 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:36.869097 11301 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.869000 11428 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.861529 11230 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.773314 11483 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.870658 11386 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.803498 11509 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.843832 11268 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:36.859961 11248 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:36.872627 11509 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.872390 11248 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.821852 11462 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.874390 11248 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:36.879645 11371 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.883456 11506 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.880617 11496 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.885620 11496 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.827574 11486 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.897044 11347 consensus_queue.cc:237] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.860656 11137 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.904991 11264 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:36.886459 11356 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:36.829504  8286 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:36.847726  8287 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:36.965217  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:36.968335  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 149242us
I20260709 13:02:36.970556  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2158) took 1033 ms. Trace:
W20260709 13:02:36.840785  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 83297.4us
I20260709 13:02:36.971905  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:36.973814  8210 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:36.823611  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2241) took 1617 ms. Trace:
I20260709 13:02:36.862011  8332 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:37.004433  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 142463us
I20260709 13:02:37.005004  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.006850  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:37.007571  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.007923  8288 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:37.009281  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:37.011518  8293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 2108) took 4618 ms (client timeout 1645 ms). Trace:
W20260709 13:02:37.012111  8293 rpcz_store.cc:269] 0709 13:02:32.392686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.392944 (+   258us) service_pool.cc:224] Handling call
0709 13:02:37.010965 (+4618021us) spinlock_profiling.cc:243] Waited 4.32 s on lock 0x7b5400445cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:37.011205 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9935745280}
I20260709 13:02:37.013026 11376 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.002530  8217 rpcz_store.cc:276] 0709 13:02:35.206402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.225259 (+ 18857us) service_pool.cc:224] Handling call
0709 13:02:36.174041 (+948782us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b5800002798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:36.174265 (+   224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.174642 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.174669 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.358486 (+183817us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.702388 (+343902us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:36.702433 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.702501 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.823300 (+120799us) raft_consensus.cc:1685] finished
0709 13:02:36.823319 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.823539 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9181,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":9449216,"thread_start_us":322679,"threads_started":1,"wal-append.queue_time_us":429943}
I20260709 13:02:36.975041  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2119) took 2532 ms. Trace:
I20260709 13:02:36.983677 11264 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.984017  8358 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:36.986229 11172 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:36.910059 11356 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.022987 11356 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.991017 11232 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:36.994480 11419 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.026609  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:36.997200  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.913301 11462 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:37.025178  8215 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:37.027069  8210 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:37.009234  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:37.044365 11337 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.027236 11172 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:37.045430 11268 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:36.973915 10841 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:37.042702  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:36.974026  8257 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.106408  8292 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:36.971167  8361 rpcz_store.cc:276] 0709 13:02:35.937039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.147139 (+210100us) service_pool.cc:224] Handling call
0709 13:02:36.147436 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.147627 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:36.636156 (+488529us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.968424 (+332268us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.969140 (+   716us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.969363 (+   223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.969445 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:36.969557 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.969749 (+   192us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.970161 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":538885,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":52553,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":282,"thread_start_us":817725,"threads_started":2}
I20260709 13:02:37.114795  8291 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.103011 10841 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:37.117182  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 147413us
I20260709 13:02:37.045895 11376 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.121555  8359 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:37.124102  8288 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:37.125694  8288 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:37.126402  8290 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:37.127982  8290 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.131102 11462 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:37.132275 11512 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:37.132738 11512 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:37.133172 11512 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.133939 11376 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:37.132273  8290 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:37.138227  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:37.140244  8284 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
W20260709 13:02:37.135455  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.138319  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 132714us
I20260709 13:02:37.136950  8290 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.121613  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.119098 10841 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.138366  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.141549 11373 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.161306  8332 leader_election.cc:400] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
I20260709 13:02:37.161837  8332 leader_election.cc:403] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:02:37.161407  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 187917us
I20260709 13:02:37.177300 11466 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
W20260709 13:02:37.178635 11305 consensus_meta.cc:287] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.518s	user 0.014s	sys 0.003s
I20260709 13:02:37.018003  8285 rpcz_store.cc:276] 0709 13:02:34.442660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.566848 (+124188us) service_pool.cc:224] Handling call
0709 13:02:34.567256 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.580844 (+ 13588us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:34.657413 (+ 76569us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.160826 (+1503413us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b18004971a0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded23a 00007f2efc257a2a
0709 13:02:36.672440 (+511614us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.672903 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.673036 (+   133us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:36.673066 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.673145 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.974317 (+301172us) raft_consensus.cc:1685] finished
0709 13:02:36.974510 (+   193us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.974822 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45525,"prepare.queue_time_us":58280,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":4800,"raft.queue_time_us":35747,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":9866,"spinlock_wait_cycles":9507584,"thread_start_us":545503,"threads_started":2,"wal-append.queue_time_us":2160860}
I20260709 13:02:37.187912  8257 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:37.188234 11348 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.161619 11268 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.168088 11376 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.203467 11446 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.204460 11446 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.205412  8257 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:37.207625  8287 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.208922  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:37.209120  8218 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 9. Ops: []
I20260709 13:02:37.200086  8213 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.212970  8214 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:02:37.213500  8288 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:37.214655 11371 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:37.216025  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1173) took 2018 ms. Trace:
I20260709 13:02:37.216543  8892 rpcz_store.cc:276] 0709 13:02:35.173491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.110269 (+936778us) service_pool.cc:224] Handling call
0709 13:02:36.161769 (+ 51500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.167599 (+  5830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.190801 (+1023202us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54004934d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:37.191056 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117826432}
I20260709 13:02:37.218672 11535 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.219432 11535 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.220000  8212 raft_consensus.cc:3055] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:37.220444  8212 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:37.221632  8212 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.233800 11348 consensus_queue.cc:1059] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:37.235299 11348 raft_consensus.cc:3055] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:37.235743 11348 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:37.236959 11348 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:37.234185  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 112897us
W20260709 13:02:37.240031 11497 log.cc:927] Time spent T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 1.716s	user 0.011s	sys 0.004s
I20260709 13:02:37.240420 11268 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:37.240919 11268 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:37.241343 11268 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:37.244925 11514 log.cc:927] Time spent T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.494s	user 0.003s	sys 0.000s
I20260709 13:02:37.246131 11373 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:37.246446  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:37.228441 11371 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:37.247805 11520 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.497s	user 0.000s	sys 0.000s
I20260709 13:02:37.238931  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.247987 11371 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.249550 11419 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.250381  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:37.254932 11420 consensus_meta.cc:287] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.012s
I20260709 13:02:37.255519 11420 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:37.256323  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.257102  8217 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:37.222088 11535 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:37.258781  8289 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:37.262652  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 404654us
I20260709 13:02:37.263718  8862 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:37.264459  8361 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.265468  8257 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.266955 11314 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.267571 11446 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:37.269084 11361 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:37.273056 11348 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.274104 11496 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.274857 11496 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.240326 11232 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:02:37.278360 11474 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.279093  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:37.241405 11510 raft_consensus.cc:3055] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:37.279982  8367 raft_consensus.cc:2393] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:37.280503 11446 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:37.281069  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:37.281206 11446 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:37.279861 11510 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:37.283113 11510 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:37.297549 11366 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:37.298135 11366 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:37.298611 11398 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:37.299062 11398 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:37.305063  8291 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:37.265376 11337 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:37.286916 11510 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.290529 11420 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:37.308651 11398 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.327975 11511 consensus_queue.cc:1059] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:37.328730  8216 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:37.329486 11088 raft_consensus.cc:3055] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:37.329795  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.330574  8216 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:37.330644 11496 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:37.331651  8212 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.331673  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.332405  8216 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:37.333209  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.334386  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.335563 11496 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.335994 11088 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:37.336134 11496 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.337281 11088 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.338564 11496 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:37.338716 11088 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:37.335026  8216 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:37.340818  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:37.342185  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.342447  8217 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:37.344120  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:37.346580  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 96353.2us
I20260709 13:02:37.348882 11462 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:37.349375 11505 consensus_queue.cc:1059] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:37.350145 11462 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:37.350895 11373 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:37.351274 11373 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:37.351504  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:37.350363 11505 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:37.353025 11505 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:37.352217 11373 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.353117  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:37.353286  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.353789  8366 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:37.318285 11446 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.354672 11373 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.354136 11505 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:37.363395 11505 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:37.364295 10944 consensus_meta.cc:287] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.007s
I20260709 13:02:37.364756 10944 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.371510 10841 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:37.372730  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.373374 11268 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:37.371549  8258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.787s (SENT) [suppressed 31 similar messages]
I20260709 13:02:37.354761  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:37.373867 10841 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:37.384600  8358 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:37.387609 11356 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.388860 11535 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.389657 11536 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.390456 11496 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:37.400216  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.404016  8213 raft_consensus.cc:2410] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:37.373409  8214 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:37.391095  8863 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:37.409047  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.409353  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.410043  8896 raft_consensus.cc:2368] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5.
I20260709 13:02:37.410404  8891 raft_consensus.cc:2393] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:37.391053 11264 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.413370  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 60258.9us
I20260709 13:02:37.400480 11478 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:37.403185 11419 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.412708 11376 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.406468 11511 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.412497 11474 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.424923  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.450613  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.452214  8892 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:37.299373 11366 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:37.419819 11478 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:37.459220 11496 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.453780 11535 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.463495 11496 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:37.464068  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 51143us
I20260709 13:02:37.464572 11535 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:37.465107  8184 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:37.444087 11264 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.470513  8364 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 13:02:37.470887  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 80127.4us
I20260709 13:02:37.472414 11510 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:37.452641 11536 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:37.473356  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 312436us
I20260709 13:02:37.454246 11371 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.473963 11366 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.480127 11536 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:37.476291 11510 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.481186 11510 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.486958  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.488327  8288 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:37.488921  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.489567  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.470366 11524 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.490201  8217 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.490823  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.491329  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.491819  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:37.493501  8284 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:37.493932 11512 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.495419 11264 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:37.465229 11478 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:37.489647  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:37.495985  8211 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:37.490406  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.489655  8213 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:37.511694  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:37.499797  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.514784  8288 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:37.515936  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.499626 11512 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:37.517588  8214 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:37.456331 11511 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.518873  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:37.520890  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.521028 11356 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:37.521433 11268 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:37.522274 11549 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:37.523952  8863 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:37.526965  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:37.560434  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 107298us
I20260709 13:02:37.560945  8288 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:37.532907 11524 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.534127  8290 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:37.534714  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.536383  8894 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:37.536324  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.538439  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.543850  8285 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:37.548727 11510 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.555593 11405 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:37.500129 10944 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:37.562526  8898 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:37.566388  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:37.589823  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.589389  8892 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:37.590278  8897 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:02:37.579188  8183 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.578467  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:37.587188  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 66553.9us
W20260709 13:02:37.578294  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.595340  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1717) took 1061 ms. Trace:
I20260709 13:02:37.625327  8365 rpcz_store.cc:276] 0709 13:02:36.534142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.796615 (+262473us) service_pool.cc:224] Handling call
0709 13:02:37.594976 (+798361us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54001527d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:37.595170 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128140544}
I20260709 13:02:37.595060  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:37.589934  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:37.581836  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 966977us
I20260709 13:02:37.587687  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:37.631433  8367 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:02:37.570708  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46921.8us
I20260709 13:02:37.580338  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:37.627681  8286 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:37.633399  8287 raft_consensus.cc:2410] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:37.633040  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.586513  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:37.570997 11356 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:37.566579 11366 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.642802  8214 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.585454  8112 catalog_manager.cc:5697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:02:37.648545  8891 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:37.630287 11512 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.651213 11405 consensus_queue.cc:1059] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:37.655166  8892 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:02:37.656327  8288 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:37.658923  8894 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:37.662844 11232 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:37.663178  8257 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:37.664060 11405 raft_consensus.cc:3055] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:37.664444 11405 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:37.664912 11232 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:37.665297 11405 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.666738 11398 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.665962 11232 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:37.667212 11405 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.667784 11232 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:37.671685  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 92683.4us
I20260709 13:02:37.674674  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.644711 11356 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.561977 11371 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.681737  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.682909 11348 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:37.686800  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.683317  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.671473 11232 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.686342 11348 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.689512  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.689806  8214 raft_consensus.cc:2410] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:37.690295  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.681321 11356 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.687708  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:37.699752  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:37.707314  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.707288  8360 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.715728  8212 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.714547  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.721231  8215 raft_consensus.cc:2410] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:37.723654 11478 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:37.721221  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:37.690349  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.730489  8257 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.732069  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.732992 11433 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.733110  8257 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.734004  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.734676  8212 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.735138  8257 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:37.736034 11137 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:37.736382 11137 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.736681 11450 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:37.737111 11450 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:37.738314  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 87037us
I20260709 13:02:37.741616  8212 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:37.740398  8259 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.734579 11383 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.764778  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:37.763484  8894 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:37.736701 11137 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.768920  8211 raft_consensus.cc:2393] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:37.767431  8113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35666 (request call id 373) took 20120 ms (client timeout 15000 ms). Trace:
I20260709 13:02:37.759059  8112 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 5, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 5 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:37.772586  8258 leader_election.cc:336] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.118s (SENT)
I20260709 13:02:37.769083  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.734019 11388 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.726536 10841 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:02:37.769351  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.743472 11510 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:37.779484  8363 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:37.773026  8258 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.761581 10944 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:37.782317 11484 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.885456  8892 raft_consensus.cc:2410] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:37.814527  8211 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:37.807188  8898 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:37.888073  8893 raft_consensus.cc:2410] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:37.826889  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1623) took 1080 ms. Trace:
W20260709 13:02:37.848810  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 46588.4us
I20260709 13:02:37.807739  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.818675  8210 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.887992  8863 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:37.815119  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48547us
W20260709 13:02:37.891366  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.817937  8862 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:37.829380  8212 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:37.892117  8891 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:37.772212 11536 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 13:02:37.818750 11559 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:02:37.888988  8218 rpcz_store.cc:276] 0709 13:02:36.746725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.103500 (+356775us) service_pool.cc:224] Handling call
0709 13:02:37.123320 (+ 19820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.218263 (+ 94943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.826625 (+608362us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b5400128754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:37.826815 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196567424}
W20260709 13:02:37.895069  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 75515.7us
W20260709 13:02:37.895392  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 205272us
I20260709 13:02:37.828145  8217 pending_rounds.cc:85] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 5
I20260709 13:02:37.831522  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:37.897176  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 89957us
I20260709 13:02:37.806757 11383 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:37.890854  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:37.899452  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:37.893644  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:37.885991  8112 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 3 to 5, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 5 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:37.913098  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.819751 11348 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:37.928625 11536 raft_consensus.cc:3055] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:37.946971 11536 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:37.947902 11536 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.949400 11536 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.741221 11450 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.929939 11371 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:37.933501  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 207201us
I20260709 13:02:37.898553  8217 pending_rounds.cc:107] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:02:37.952327  8217 raft_consensus.cc:2889] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.953004  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.955904  8215 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:37.924518  8862 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:37.816141 11433 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.959481  8366 raft_consensus.cc:2393] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:37.959602  8257 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:37.927800  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.928598  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.824558 11511 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:37.930483 11524 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:37.931041 11506 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:02:37.931342  8892 raft_consensus.cc:1240] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:37.931830  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:37.932098  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:37.932762 11350 consensus_queue.cc:1059] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:37.972090 11350 raft_consensus.cc:3055] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:37.972487 11350 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:37.976423  8112 catalog_manager.cc:5697] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:37.982676 11137 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.933418 11553 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:37.934719  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.935353  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.935966  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.938346 11232 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:37.940296 11305 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:37.942345  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 137797us
I20260709 13:02:37.942729 11264 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:37.997066 11264 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.997463 11264 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.997709  8287 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:37.999544  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.000335  8183 leader_election.cc:400] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5.
I20260709 13:02:38.001838  8358 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:38.002116  8293 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.004129 11281 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:37.770023  8113 rpcz_store.cc:269] 0709 13:02:17.504639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.504950 (+   311us) service_pool.cc:224] Handling call
0709 13:02:37.578052 (+20073102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:30.032536 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:30.078850 (+ 46314us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:30.078900 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:02:30.078931 (+    31us) tablet.cc:662] Decoding operations
0709 13:02:30.114918 (+ 35987us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:30.123284 (+  8366us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:30.123316 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:02:30.124556 (+  1240us) tablet.cc:701] Row locks acquired
0709 13:02:30.124603 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:02:30.124877 (+   274us) write_op.cc:270] Start()
0709 13:02:30.125044 (+   167us) write_op.cc:276] Timestamp: P: 1783602150124801 usec, L: 0
0709 13:02:30.125063 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:30.125701 (+   638us) log.cc:844] Serialized 5825 byte log entry
0709 13:02:31.027409 (+901708us) op_driver.cc:464] REPLICATION: finished
0709 13:02:31.634352 (+606943us) write_op.cc:301] APPLY: starting
0709 13:02:31.676808 (+ 42456us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:31.822499 (+145691us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:31.822643 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:31.824377 (+  1734us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:31.824728 (+   351us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:02:31.824771 (+    43us) write_op.cc:312] APPLY: finished
0709 13:02:31.825157 (+   386us) log.cc:844] Serialized 107 byte log entry
0709 13:02:33.225719 (+1400562us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2ef91430ac 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b
0709 13:02:34.414107 (+1188388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:34.441346 (+ 27239us) write_op.cc:454] Released schema lock
0709 13:02:34.453612 (+ 12266us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:34.471461 (+ 17849us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:34.471491 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66798,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":537913,"apply.run_cpu_time_us":68679,"apply.run_wall_time_us":2871014,"num_ops":15,"prepare.queue_time_us":169536,"prepare.run_cpu_time_us":13607,"prepare.run_wall_time_us":249433,"raft.queue_time_us":405744,"raft.run_cpu_time_us":51093,"raft.run_wall_time_us":470183,"replication_time_us":889300,"spinlock_wait_cycles":17114496,"thread_start_us":3197990,"threads_started":5,"wal-append.queue_time_us":2688890,"wal-append.run_cpu_time_us":15207,"wal-append.run_wall_time_us":2329831}]]}
I20260709 13:02:38.004299  8359 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:38.005892  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.007395 11419 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:37.944437  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:38.008901  8889 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:38.013322  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 114456us
I20260709 13:02:37.826520 11478 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:37.815860 11565 log.cc:927] Time spent T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:37.899711 11388 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:38.014355  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:37.960777  8360 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
W20260709 13:02:37.962162  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.015282  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:37.970777  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:37.942771 11550 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:02:37.971421 11348 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.891764 11484 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:02:37.897456 11398 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.017102  8286 raft_consensus.cc:2393] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:38.001880  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:38.023221  8889 raft_consensus.cc:2410] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:38.024377  8293 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:38.026376  8212 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:02:38.027716 11423 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.028221 11423 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.028602 11423 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.029021  8183 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.030579 11301 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:38.031222 10944 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:38.032567  8112 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:37.964954 11371 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:38.034647  8112 catalog_manager.cc:5697] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 3, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.036306 11232 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:38.037123  8112 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:38.039270  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 107608us
I20260709 13:02:37.973475 11350 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:38.018218  8184 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:38.046216  8292 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:38.030804  8183 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.048971  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:38.054443  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:38.056362  8216 raft_consensus.cc:2393] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:38.057627  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.060463 11419 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:38.066174 10944 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:38.047694 10841 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:38.067987  8112 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 4, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:38.069315 11446 raft_consensus.cc:3055] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:38.004560 11281 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:38.026680 11398 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.069523  8112 catalog_manager.cc:5697] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 1 to 3, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.077912 11553 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:38.078348 11553 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:38.079243 11553 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:38.081516 11424 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:38.081920 11424 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.083454 11553 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.050235 11088 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:38.047606 11506 raft_consensus.cc:2764] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:38.031239 11301 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:38.095054 11088 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:38.095558 11301 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.096088 11088 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.085944  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:38.098498 11281 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.099468  8212 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:38.100035 11281 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.085400 11398 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.076113  8112 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.069819 11446 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:38.104405 11446 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.105405 11446 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:38.107483 11356 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.108916  8112 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:02:38.110858  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.124735  8257 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.126490 10944 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:38.127430 11350 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.111565 11348 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.102246 11264 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.131045  8212 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
W20260709 13:02:38.131865  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.139494 11137 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:38.074352 11512 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:38.086794 11424 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:38.135257  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 104604us
I20260709 13:02:38.167644  8257 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:38.109834 11356 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:38.093904 11419 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:38.176137  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 236288us
I20260709 13:02:38.050689 11478 consensus_queue.cc:1059] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
W20260709 13:02:38.187402  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 170851us
W20260709 13:02:38.142454  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.142028 11366 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:38.189078  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 131608us
I20260709 13:02:38.186949 11137 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:38.192611  8183 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:38.196996  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.197091  8358 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:38.197738  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:38.200527 11383 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:38.192373  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.205900  8332 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:38.234863  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 239851us
I20260709 13:02:38.218693 11137 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:38.242480  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 227392us
W20260709 13:02:38.243135  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 57929.6us
I20260709 13:02:38.203539 11419 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.233858 11505 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:38.268615  8864 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:38.276866 11337 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:38.277230  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.277464 11337 raft_consensus.cc:697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:38.278506 11337 consensus_queue.cc:237] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:38.279562 11137 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.292707  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:38.242848 11383 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.295629  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:38.301643  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.276192 10944 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:38.278471 11446 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:38.292312 11264 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:38.270167 11356 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:02:38.275950 11281 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:02:38.279183 11575 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:02:38.300273 11505 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:38.325819  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 46824.4us
W20260709 13:02:38.326910  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 129689us
I20260709 13:02:38.308501 11512 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:38.297763 11305 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:02:38.333714  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:38.312654 10944 raft_consensus.cc:697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:38.327879  8863 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:38.357537  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:38.357079  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:38.359889  8218 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:38.322896 11505 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:38.362228  8292 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:38.363011  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.362339  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.324787 11581 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:38.366396  8863 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:38.330543 11512 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:38.368492  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.370478  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.373987  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:38.374706  8212 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.376454  8287 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:38.381877  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:38.365096 11505 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.364892 11484 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:38.365754 11373 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.402820  8214 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:38.348537 11264 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:02:38.368175 11581 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:38.369737 11478 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:38.370222 11512 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:38.370087 11575 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.375716 10841 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:38.362066 11388 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:02:38.371052 11446 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:38.425406  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 234891us
I20260709 13:02:38.416568 11301 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:38.441951 11580 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:38.419642 11575 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.444205 11575 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:38.447443 11446 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.447988 11446 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.454294 11398 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.456545 11398 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:38.457124 11398 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.433265 11356 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:38.466157 11509 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:38.468923  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:38.470111  8212 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:38.472592  8218 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:38.410930 11581 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:38.408622 11373 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.410789 11419 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:38.474897  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 48734.4us
I20260709 13:02:38.419279 11474 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:38.427901 11587 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:38.536553  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.466773 11509 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:38.466413 11383 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:38.538980  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 172768us
I20260709 13:02:38.430374 11484 raft_consensus.cc:697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:38.449999 11446 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:38.563601  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.571887  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.472620 10841 raft_consensus.cc:2764] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:02:38.582103  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:38.538354 11587 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:38.441905 11301 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:38.585115  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.593480  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 211873us
I20260709 13:02:38.433777 10944 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.595762  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.602643  8367 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:38.606704  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 260070us
I20260709 13:02:38.608570  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:38.590448 11591 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.628834  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.597388 11419 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.613067 11510 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:38.641180  8864 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:38.626675 11281 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.647360  8287 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:38.645130 11509 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.651393 11553 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:38.651798 11553 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:38.652704 11553 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:38.655730 11478 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:38.656749 11478 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:38.657052 11478 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:38.649951 11505 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:38.647061  8258 leader_election.cc:336] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.502s (SENT)
I20260709 13:02:38.649869 11450 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:38.670580 11423 consensus_meta.cc:287] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.002s
I20260709 13:02:38.671038 11423 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.673238 11423 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:38.673911 11510 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:38.674955 11510 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:38.642270 11419 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:38.677384 11301 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:38.661273 11574 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:02:38.640448 11484 consensus_queue.cc:237] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:38.653903 11553 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.665866 11281 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.664731 11591 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.658047 11424 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:38.629709 11264 consensus_queue.cc:1243] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:38.701054 11424 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.134334 11505 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:38.704475 11595 log.cc:927] Time spent T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:38.695267 11581 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.144994 11337 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:41.145793 11581 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:38.708595 11591 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:38.662405 11586 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:02:38.694103 11587 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.168402 11404 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:41.168964 11404 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:39.447973 11512 consensus_meta.cc:287] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 1.024s	user 0.009s	sys 0.003s
I20260709 13:02:41.169962 11512 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.170424  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:39.718568  8147 debug-util.cc:398] Leaking SignalData structure 0x7b0800212180 after lost signal to thread 7088
I20260709 13:02:41.172089 11512 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:39.967242 11619 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.976823  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.172627 11584 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.173203 11584 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:40.061102 11620 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.174371 11620 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.175251 11584 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.176427 11620 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.176937 11620 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.177414 11583 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.178220 11505 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.178169 11583 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.178773 11505 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.180553 11583 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.181072 11505 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.182260 11474 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.183195 11474 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.183629  8213 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:41.185402 11474 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.185539 11404 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.186753 11625 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:40.069725  8862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.466s	user 0.016s	sys 0.008s
W20260709 13:02:41.187915  8862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.585s	user 0.017s	sys 0.009s
W20260709 13:02:41.172297  8147 debug-util.cc:398] Leaking SignalData structure 0x7b0800329ee0 after lost signal to thread 7091
W20260709 13:02:41.189635  8147 debug-util.cc:398] Leaking SignalData structure 0x7b080003d280 after lost signal to thread 8150
I20260709 13:02:41.190428  8216 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:02:41.190855  8147 debug-util.cc:398] Leaking SignalData structure 0x7b080035aac0 after lost signal to thread 8242
W20260709 13:02:41.192009  8147 debug-util.cc:398] Leaking SignalData structure 0x7b08004032a0 after lost signal to thread 8317
W20260709 13:02:41.193229  8147 debug-util.cc:398] Leaking SignalData structure 0x7b080038bc00 after lost signal to thread 8391
I20260709 13:02:41.194139  8210 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:41.194913  8889 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:41.194406  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.196444  8894 raft_consensus.cc:2368] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9.
I20260709 13:02:41.196576  8211 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:02:40.184613 11510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.486s	user 0.012s	sys 0.018s
I20260709 13:02:40.229321 11600 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:41.197557 11510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.499s	user 0.012s	sys 0.018s
I20260709 13:02:41.197825 11600 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:40.557394  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 1.91711e+06us
W20260709 13:02:40.558157 11398 consensus_meta.cc:287] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 2.101s	user 0.016s	sys 0.010s
I20260709 13:02:41.198165  8213 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:41.198575 11398 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:41.199031  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.199249 11424 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:41.199409  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:41.199798  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.200596 11635 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:41.200861 11232 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:40.595270 11616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.850s	user 0.004s	sys 0.008s
I20260709 13:02:41.201836  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:40.622531  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1748) took 2150 ms. Trace:
I20260709 13:02:41.202984  8366 rpcz_store.cc:276] 0709 13:02:38.471985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.472080 (+    95us) service_pool.cc:224] Handling call
0709 13:02:40.621694 (+2149614us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:40.621908 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.622141 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.622164 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:40.622211 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:40.622249 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.622309 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.622441 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168880896}
I20260709 13:02:40.660879 11383 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:41.203272  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:40.663990 11314 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.204531 11314 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.204638 11619 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.206691 11314 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:40.666417  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.206956  8890 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:40.666603 11623 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.208403 11623 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.209944 11619 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.210595 11619 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:40.675489 11509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.022s	user 0.010s	sys 0.015s
W20260709 13:02:41.211423 11509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.558s	user 0.011s	sys 0.015s
W20260709 13:02:40.696359 11405 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.168s	user 0.033s	sys 0.048s
W20260709 13:02:41.212235 11405 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.684s	user 0.034s	sys 0.048s
I20260709 13:02:40.703132 11366 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.721623 11420 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.729305  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1749) took 2223 ms. Trace:
W20260709 13:02:40.738065  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 2.0919e+06us
I20260709 13:02:40.749293 11626 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.691702 11281 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:40.760192  8212 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:40.760814 11450 consensus_meta.cc:287] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 2.090s	user 0.012s	sys 0.016s
I20260709 13:02:40.763973 11348 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:41.211443  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:38.677604 11576 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:40.766892  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.213480  8361 rpcz_store.cc:276] 0709 13:02:38.505665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.539271 (+ 33606us) service_pool.cc:224] Handling call
0709 13:02:40.728389 (+2189118us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:40.728626 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.728865 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.728890 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:40.728938 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:40.728983 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.729052 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.729212 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144497408}
I20260709 13:02:41.213383 11366 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:40.783370 11433 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.216351 11433 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:40.784437 11627 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.216961 11366 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.217381 11627 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.214629  8898 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:41.219919 11627 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:40.784968 11478 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.220129  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.221230 11478 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:41.221608  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:40.796028  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.223009  8292 raft_consensus.cc:2410] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:40.798060  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:41.223460 11619 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.224093  8293 raft_consensus.cc:2393] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:40.798805  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:40.800128  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.225023  8890 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:02:41.225461  8287 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:40.801779  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:40.802237  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.226933  8290 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:40.812633 11388 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.227715 11388 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.229655 11388 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:40.817386  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.216238  8891 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:41.230386  8360 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
W20260709 13:02:41.230903  8360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2181) took 2797 ms (client timeout 2142 ms). Trace:
W20260709 13:02:40.818962 11371 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.352s	user 0.032s	sys 0.037s
I20260709 13:02:41.231606  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1747) took 2760 ms. Trace:
I20260709 13:02:40.819924  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:40.821099 11629 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.827178  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:40.829625 11088 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.380s	user 0.012s	sys 0.020s
I20260709 13:02:40.831403 11634 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.838852 11524 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.847021 11373 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.233068 11634 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.233639 11373 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.234150 11373 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.235287 11634 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.236007 11373 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.232026  8358 rpcz_store.cc:276] 0709 13:02:38.471632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.471738 (+   106us) service_pool.cc:224] Handling call
0709 13:02:40.778857 (+2307119us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128eee 0000000000375939 00007f2f0119c1e0 00007f2f012650c4 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:40.779029 (+   172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.163886 (+384857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.163916 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.164403 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.212845 (+ 48442us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:41.212886 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.212950 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.231325 (+ 18375us) raft_consensus.cc:1685] finished
0709 13:02:41.231344 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.231551 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":384403,"raft.queue_time_us":385532,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":147298304,"thread_start_us":48101,"threads_started":1,"wal-append.queue_time_us":47624}
I20260709 13:02:41.236516 11373 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.855031  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2178) took 2844 ms. Trace:
I20260709 13:02:40.849951  8217 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:40.858006 11484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.176s	user 0.007s	sys 0.017s
I20260709 13:02:41.238241 11626 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:41.238920 11484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.557s	user 0.007s	sys 0.018s
I20260709 13:02:40.861636 11506 raft_consensus.cc:3055] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:41.239560 11506 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:41.240461 11506 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.241202 11576 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:40.863698 10944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.187s	user 0.006s	sys 0.015s
I20260709 13:02:41.241967  8892 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
W20260709 13:02:40.887398 11613 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 2.155s	user 0.004s	sys 0.008s
I20260709 13:02:40.894747  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1193) took 3149 ms. Trace:
I20260709 13:02:40.900096 11419 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:41.012575  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.875814  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:41.262516  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 2.61911e+06us
I20260709 13:02:41.057603  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2182) took 2606 ms. Trace:
I20260709 13:02:41.263335  8363 rpcz_store.cc:276] 0709 13:02:38.450773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.450940 (+   167us) service_pool.cc:224] Handling call
0709 13:02:38.451209 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.451378 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:38.483103 (+ 31725us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.057053 (+2573950us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18001f3360. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef90dac0a 00007f2f0281a219 00007f2ef9162a40 00007f2ef915d4e4 00007f2ef915d455 00007f2efc245060 00007f2efc257716 00007f2efc268287 00007f2efc268208
0709 13:02:41.057225 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:41.057289 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:41.057335 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.057401 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.057541 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66433,"prepare.queue_time_us":85891,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":35,"raft.queue_time_us":2517625,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":5773056}
I20260709 13:02:41.265396 11512 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:41.265764  8183 leader_election.cc:400] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9.
W20260709 13:02:41.058701  8214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.470s	user 0.013s	sys 0.022s
W20260709 13:02:41.266541  8214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.678s	user 0.013s	sys 0.022s
I20260709 13:02:41.139170 11356 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:41.267078 11356 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:41.142457  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 2.66674e+06us
I20260709 13:02:41.267302  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2267) took 2835 ms. Trace:
I20260709 13:02:41.267515 11419 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:41.268236 11419 consensus_queue.cc:1243] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer 4a50f39e2d8e4886a79849938f2272a6 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:41.269172  8332 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:41.240404 11626 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.270147  8214 rpcz_store.cc:276] 0709 13:02:38.432009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.432155 (+   146us) service_pool.cc:224] Handling call
0709 13:02:38.475417 (+ 43262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.551270 (+ 75853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.551297 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.574230 (+ 22933us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.266923 (+2692693us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:41.266968 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.267039 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.267079 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:41.267090 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.267213 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22448,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":17169,"thread_start_us":2678344,"threads_started":1,"wal-append.queue_time_us":140602,"wal-append.run_cpu_time_us":1816,"wal-append.run_wall_time_us":1001846}
I20260709 13:02:41.271625 11404 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:41.273062 11512 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:41.273330 11356 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.274581 11356 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:41.275924  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.277494  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.278720  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.279062  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.271275 11484 consensus_queue.cc:1059] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:02:41.279906  8213 raft_consensus.cc:2410] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:41.280294  8217 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:02:41.279840  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.199693 11587 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:41.281119 11484 raft_consensus.cc:3055] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:41.279325  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.279240  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:41.280339  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.282625 11583 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:41.282969  8210 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:41.283208 11484 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:41.284366 11484 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.286011 11484 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:41.289139  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 115235us
I20260709 13:02:41.160171 11381 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.160717 11589 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:41.290766  8332 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:41.161286 11588 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:41.161798 11305 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.291136 11381 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.162282 11350 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:41.292246 11350 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:41.292538  8332 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:41.145606 11337 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.166926 11591 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:38.731331 11592 log.cc:927] Time spent T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:02:41.293385 11381 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.293141 11350 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.294394  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1647) took 3170 ms. Trace:
I20260709 13:02:41.294746  8209 rpcz_store.cc:276] 0709 13:02:38.124117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.141814 (+ 17697us) service_pool.cc:224] Handling call
0709 13:02:38.187550 (+ 45736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.204424 (+ 16874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.204456 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.224321 (+ 19865us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.405720 (+181399us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:38.405765 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.405831 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.294165 (+2888334us) raft_consensus.cc:1685] finished
0709 13:02:41.294185 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.294306 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10692,"raft.queue_time_us":17014,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7930,"thread_start_us":158051,"threads_started":1,"wal-append.queue_time_us":343854}
I20260709 13:02:41.166412 11593 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:41.291772 11305 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:40.649308 11511 raft_consensus.cc:3055] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:41.297327 11511 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:41.298161 11511 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.298632 11305 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:41.202725 11616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.458s	user 0.004s	sys 0.008s
I20260709 13:02:41.296486 11593 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.202582  8893 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:41.232651 11629 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.301492 11593 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:40.666898  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.301828 11629 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:40.883862  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:41.302585  8291 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:41.177392 11620 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.305366 11620 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:41.242252 10944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.566s	user 0.007s	sys 0.016s
I20260709 13:02:41.213505 11420 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.236945  8359 rpcz_store.cc:276] 0709 13:02:38.010925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.011105 (+   180us) service_pool.cc:224] Handling call
0709 13:02:38.011524 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:38.326193 (+314669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.326222 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:38.347595 (+ 21373us) log.cc:844] Serialized 52 byte log entry
0709 13:02:38.536915 (+189320us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:38.536950 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.537016 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.854804 (+2317788us) raft_consensus.cc:1685] finished
0709 13:02:40.854822 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.854971 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59284,"raft.queue_time_us":252022,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":10962,"thread_start_us":389988,"threads_started":2,"wal-append.queue_time_us":366531,"wal-append.run_cpu_time_us":2162,"wal-append.run_wall_time_us":1009411}
I20260709 13:02:41.291230 11589 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.307457 11420 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.307816 11589 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.307964 11420 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.308508 11420 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.309257  8893 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:41.181874 11505 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.310316  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.310089 11505 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.310665 11337 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.310894  8893 raft_consensus.cc:2376] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8. Re-sending same reply.
I20260709 13:02:41.311676  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.312155 11505 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.241914 11506 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:41.314469  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.314193  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:41.315343  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:41.317790 11512 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.318549 11512 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.320187  8210 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:41.320535 11512 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.321046 11512 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.239750  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.204252 11383 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:41.232774 11088 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.783s	user 0.012s	sys 0.021s
W20260709 13:02:41.232100 11371 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.765s	user 0.032s	sys 0.038s
I20260709 13:02:41.243510 11373 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.242681 11474 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:41.326480 11383 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.324304 11629 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.242677 11618 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.214228 11348 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:41.327665 11629 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:41.243966  8258 connection.cc:256] RPC call timeout handler was delayed by -2.5520924729999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260709 13:02:41.213116  8897 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:41.233212 11524 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.212281 10841 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.332379 10841 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.333333 11629 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:41.333901  8101 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ca43983edda443fa9d74c1f80252f1fc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:41.334380 10841 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.327800 11618 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.334929 11596 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:41.242159 11576 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.333257  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.251972  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.252403 11581 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.252817  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.254292  8287 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:41.231261  8360 rpcz_store.cc:269] 0709 13:02:38.433170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.472421 (+ 39251us) service_pool.cc:224] Handling call
0709 13:02:40.817180 (+2344759us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f012130a0 00007f2f01212984 00007f2efa78d6d4 00007f2efa78d662
0709 13:02:41.230808 (+413628us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168503040}
I20260709 13:02:41.254405 11635 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.255009 11509 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.255520 11398 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:41.255421  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:41.256201 11536 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:41.350274  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:41.256584  8862 connection.cc:256] RPC call timeout handler was delayed by -1.1625509699999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 13:02:41.259513  8896 rpcz_store.cc:276] 0709 13:02:37.744829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.744952 (+   123us) service_pool.cc:224] Handling call
0709 13:02:37.768301 (+ 23349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:37.928836 (+160535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.928868 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:37.929518 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 13:02:38.205669 (+276151us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:38.221805 (+ 16136us) log.cc:844] Serialized 14 byte log entry
0709 13:02:38.222184 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 13:02:38.222350 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.864229 (+2641879us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b180039b560. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9160522 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:40.894350 (+ 30121us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540072f6d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:40.894407 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.894459 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:40.894473 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.894659 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3,"prepare.queue_time_us":2658305,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":2049,"raft.queue_time_us":39505,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":9580,"spinlock_wait_cycles":293056640,"thread_start_us":275669,"threads_started":1,"wal-append.queue_time_us":389018,"wal-append.run_cpu_time_us":24863,"wal-append.run_wall_time_us":2368157}
I20260709 13:02:41.259852  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.288983 11583 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:41.290439 11625 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.291555 11404 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.165690 11636 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.379413  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.296819 11640 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.296458 11591 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.202812 11600 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.291546 11588 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:40.866705 11553 consensus_meta.cc:287] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 2.172s	user 0.014s	sys 0.014s
I20260709 13:02:41.322064  8890 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:41.210759 11623 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.318496  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:41.385005  8215 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:41.326900 11474 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:41.329201  8258 connection.cc:256] RPC call timeout handler was delayed by -2.5484924729999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 13:02:41.244558  8898 raft_consensus.cc:2368] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:41.299750 11511 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.330952 11627 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:41.399737  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.249281 11619 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.334987  8211 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:41.402781  8362 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:41.250427 11433 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:41.339926  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 74326us
I20260709 13:02:41.355894 11581 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.345307  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.349063  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:41.350852  8147 debug-util.cc:398] Leaking SignalData structure 0x7b080040dc40 after lost signal to thread 8922
I20260709 13:02:41.351339  8257 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:41.409587  8363 raft_consensus.cc:2410] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:41.409531  8217 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:41.410719  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.382284 11550 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:41.411796  8147 debug-util.cc:398] Leaking SignalData structure 0x7b080039c1e0 after lost signal to thread 8923
I20260709 13:02:41.312597  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.354246  8889 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:41.354298  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:41.328686 11348 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.355702  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.358059  8862 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:41.326592 11373 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.371748  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.326500 11420 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.376426  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.373983  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.421252  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.376722  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.421826  8287 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:41.378545  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.380618  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.321506 11512 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.385567  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.423656  8210 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:41.384008  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.423806  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.397737  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.330034  8212 raft_consensus.cc:2410] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:41.330829 11405 consensus_queue.cc:1059] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:02:41.399974  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.348336 11596 consensus_queue.cc:1059] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:41.401482  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.428992  8366 raft_consensus.cc:2410] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:41.309257  8291 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:41.382447 11593 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.230960  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.413144  8217 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 5.
I20260709 13:02:41.412892  8893 raft_consensus.cc:2376] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4. Re-sending same reply.
I20260709 13:02:41.414608  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.414737  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.377858 10944 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:02:41.431248  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:41.416627  8147 debug-util.cc:398] Leaking SignalData structure 0x7b080033a780 after lost signal to thread 11268
W20260709 13:02:41.432415  8147 debug-util.cc:398] Leaking SignalData structure 0x7b080035c4e0 after lost signal to thread 11361
W20260709 13:02:41.433141  8147 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd320 after lost signal to thread 11525
I20260709 13:02:41.417830  8365 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:41.417954  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.372591 11536 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.372452 11398 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:41.419004  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 61065.2us
I20260709 13:02:41.432019  8184 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:41.381098 11625 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.442775  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.418469 11137 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.419162  8359 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:41.383983 11635 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.420449  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:41.420863  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 205302us
I20260709 13:02:41.335893 11576 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:41.420977  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.450802  8284 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:41.422763  8218 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:41.425386  8895 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:41.425493 11582 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:41.404461 11404 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.426640  8896 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:41.427021  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:41.427764  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 85619.7us
I20260709 13:02:41.425818 11638 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:41.380702 11509 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.430460  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.432040  8291 raft_consensus.cc:2410] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:02:41.415254  8258 leader_election.cc:336] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.773s (SENT)
I20260709 13:02:41.441779  8889 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:41.384402 11640 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.442391  8216 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:41.418620  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 67371.6us
W20260709 13:02:41.419955  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.447396  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.447831  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.481657  8893 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:41.447832  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.426023 11383 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:41.458770  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.482339  8892 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.449406  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:41.462509  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.481544  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:41.483093  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.465845  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.462677  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.472581  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.483067  8890 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:41.474495  8213 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:41.481492  8289 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:41.482272  8363 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:41.429710 11622 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.480732  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:41.487973  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.488161  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.488713  8891 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:41.483276  8287 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:41.388597 11636 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.441854 11593 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:41.514395  8183 connection.cc:256] RPC call timeout handler was delayed by -2.1378093910000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:02:41.475216  8358 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:41.511387  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.483712  8285 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:41.485514  8184 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:41.486001  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.492409  8889 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:41.516232  8363 raft_consensus.cc:2410] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:41.486943  8210 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:41.470738  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.462607  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.470117  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.517771  8898 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:41.447201 10841 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:41.520043  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.520651  8893 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:41.509332  8366 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:41.515561  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.523074  8288 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:41.517918  8367 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:41.519572  8896 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:41.517382  8257 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:41.524930  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 109748us
I20260709 13:02:41.524765  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.526106  8363 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
W20260709 13:02:41.526131  8258 connection.cc:256] RPC call timeout handler was delayed by -2.2553330739999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3178s for a response
I20260709 13:02:41.457132 11348 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.529861  8287 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:02:41.530748  8258 connection.cc:256] RPC call timeout handler was delayed by -2.1459355199999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:02:41.531133  8258 connection.cc:256] RPC call timeout handler was delayed by -2.0306224709999583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 13:02:41.424822 11550 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.489902 11383 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:41.541004  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.535465  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.559728  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:41.462334 11553 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:41.573243  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:41.574162  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.567742  8291 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:41.563572  8209 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:41.571722  8898 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:41.576370  8289 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:41.561676  8331 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:41.577168  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:41.536129  8258 connection.cc:256] RPC call timeout handler was delayed by -1.9476462420000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 13:02:41.535233  8257 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:41.578048  8258 connection.cc:256] RPC call timeout handler was delayed by -1.8689303679999512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:02:41.578495  8258 connection.cc:256] RPC call timeout handler was delayed by -1.85385131299995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2889s for a response
I20260709 13:02:41.534404  8891 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:41.563094  8893 raft_consensus.cc:1240] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:41.524904 11478 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:41.580813  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.584308  8286 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:41.524399 11419 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.520720 11627 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:41.558650 11623 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:41.582166  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 47031us
I20260709 13:02:41.489893 11337 consensus_queue.cc:1059] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:02:41.584219  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.513633 11584 consensus_queue.cc:1059] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:02:41.533712 11366 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.572576 11383 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.530602 11589 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:41.524667 11510 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:41.533953 11433 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.586949  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 105923us
I20260709 13:02:41.588320  8361 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:41.522563 10841 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:41.589201  8258 connection.cc:256] RPC call timeout handler was delayed by -1.7298590369999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:02:41.605427  8258 connection.cc:256] RPC call timeout handler was delayed by -1.3938123009999686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:02:41.589920  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.489365 11639 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 13:02:41.607232  8183 connection.cc:256] RPC call timeout handler was delayed by -1.107444036000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260709 13:02:41.593217  8285 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 4.
I20260709 13:02:41.535991 11420 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.593971  8257 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:41.572173  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 132240us
I20260709 13:02:41.584951 11524 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:41.595153  8896 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:41.595527 11232 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:41.483798 11281 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.565574 11388 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:41.587447  8290 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:41.487612 11404 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.637389 11600 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.615061 11232 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:41.638365 11646 log.cc:927] Time spent T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:02:41.638465 11232 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:41.638270  8365 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:41.640493  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:41.603879  8892 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:41.457950 11137 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.608460 10841 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:41.533574 11626 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:41.608376  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:41.594696  8895 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:41.609970 11623 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.592350 11314 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.658186  8892 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:41.659262  8863 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:41.592346 11627 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.510591 11638 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.512755 11622 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.600088  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:41.605839  8258 connection.cc:256] RPC call timeout handler was delayed by -1.2474218899999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
I20260709 13:02:41.648653  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.597610 11506 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:41.592630 11478 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.659768  8896 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:41.662377 11398 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.607765 11433 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.647537 11337 raft_consensus.cc:3055] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:41.663007 11626 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.663414 11137 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.740999  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:41.664335 11636 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.664492 11550 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:41.606701 11510 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.608081 11366 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.653848 11405 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:41.667254 11314 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.657451 11620 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.668313 11652 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:41.668699  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 60440us
I20260709 13:02:41.659209 11623 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:41.670203 11653 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:41.670711  8892 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:41.616276 11420 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:41.674893 11647 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:02:41.678692  8293 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
W20260709 13:02:41.678972 11645 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:02:41.646292 11588 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:41.679473 11581 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.679795 11347 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
I20260709 13:02:41.667387 11371 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:41.854182 11371 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:41.653767 11536 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.683266  8360 raft_consensus.cc:2410] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:41.677508 11232 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.855278 11626 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:41.855909 11484 consensus_meta.cc:287] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.000s
I20260709 13:02:41.840199 11509 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.857740 11478 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.858165 11314 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.741468 11524 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:41.595602 11419 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.684322  8897 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:41.609313 11589 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:41.684274  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 73498.9us
I20260709 13:02:41.856945 11232 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:41.705824  8258 connection.cc:256] RPC call timeout handler was delayed by -1.2168832219999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 13:02:41.883111 11589 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:41.704118  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.706007  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 144472us
I20260709 13:02:41.883625 11667 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.884196 11667 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.884138  8331 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:41.884125  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.708949  8895 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:41.642565 11474 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.730121  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.732786  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:41.734895  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 141067us
I20260709 13:02:41.736192  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:41.736442  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.739055 11383 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.730919 11582 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:41.827319 11651 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:41.838326 11593 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:41.840768  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.923322  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.923494  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:41.924008  8290 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:41.837044 11640 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.839357 11635 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:41.822830  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:41.836197  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.933087  8358 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.839175 10841 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.836769  8284 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:41.704000 11627 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.932971 11381 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:41.940622 11381 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.940943 11381 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.942130 11536 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:02:41.942440 11582 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.854341 11638 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.943786  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.932685 11484 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:02:41.944391  8293 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
W20260709 13:02:41.757474  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 272155us
I20260709 13:02:41.775888  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:41.846995  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 187886us
I20260709 13:02:41.946878  8898 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:02:41.949343  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.939117 11584 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:41.950876 11584 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.951277 11584 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:41.953950 11667 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.847391  8183 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:41.827077 11644 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:02:41.955086  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 107819us
I20260709 13:02:41.955971 11404 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:41.956040  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:41.726243 11506 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.740446 11619 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:41.655045 11388 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.862710  8285 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:41.957438 11640 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:41.957815 11640 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.958159 11640 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:41.958768 11388 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.866266  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.867398 11366 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.844398 11405 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.962952 11619 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.964946 11405 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.966512 11625 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.967428 11596 raft_consensus.cc:3055] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:41.967828 11596 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:41.968632 11596 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.738051 11512 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.851401 11653 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.934126  8891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:41.970466 11653 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.970623  8891 raft_consensus.cc:606] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:41.971062  8891 raft_consensus.cc:614] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:41.873486 11419 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.875995  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.972239  8291 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:41.876760 11350 raft_consensus.cc:3055] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:41.702912  8894 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:41.972949  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:41.960897 11383 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.974792  8114 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.975688  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.976321 10841 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.976886 11420 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.876791  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.851120 11620 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.979591 11620 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.881279 11371 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:41.856972 11433 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.856892 11510 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:41.972972 11350 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:41.987116 11663 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:41.987491 11371 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:41.988632 11591 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:41.989797  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.990466  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.991571  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.992293  8367 raft_consensus.cc:2410] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:41.992962  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.993480  8367 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:41.994678  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:41.994766  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.995321  8361 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:41.995718  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.878279  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:41.996951 11405 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.912322  8365 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:41.912256  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:41.924854  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:41.925410  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.998143  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 86017.5us
I20260709 13:02:41.987591 11663 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.998725 11663 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:41.999025 11433 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:41.999500 11433 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.999852 11433 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.000336  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.000921  8214 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
W20260709 13:02:41.930591  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 51505.5us
I20260709 13:02:42.002230  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.003034  8211 raft_consensus.cc:2410] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:42.002348  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:42.003482  8210 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:42.003860  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.004462  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.005196  8213 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:42.005259  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.005856  8215 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:42.004417  8209 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:42.002480  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.006981  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:41.987735 11350 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.007558  8114 catalog_manager.cc:5697] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 8, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 8 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.008623 11350 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:41.931689  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:41.881098 11622 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:42.018370  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:41.870374 11524 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.933663  8362 raft_consensus.cc:2410] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:02:41.934927  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 50900.3us
I20260709 13:02:41.842866 11618 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.936753  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:41.938046 11281 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:41.953591 11623 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:41.956971  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:41.847378  8366 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:41.964236 11506 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.034193  8257 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:42.035120 11137 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:42.035507 11137 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.035853 11137 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.965025 11619 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.969889 11596 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:42.043854 11137 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:41.979826  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.973378  8112 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35686 (request call id 348) took 17194 ms (client timeout 15000 ms). Trace:
I20260709 13:02:41.737937 11337 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:42.047220  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:41.997527  8364 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:02:42.012633  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.046562  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:42.048743  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 91876.7us
I20260709 13:02:42.049382  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:42.049433  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.032261  8366 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:42.047900  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.048763  8293 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:42.052171  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.053150  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.009204  8114 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 6, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 6 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:42.013365  8210 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:42.013900  8358 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
W20260709 13:02:42.014513  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.024405  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.025607  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:42.027817  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 91166.6us
I20260709 13:02:42.029680  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:42.027964 11524 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.061923  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:42.062227  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 59871.7us
I20260709 13:02:42.062885  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.064533  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.065843  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.067739  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:42.068326  8894 raft_consensus.cc:2376] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7. Re-sending same reply.
I20260709 13:02:42.070231  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.070909  8897 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:42.059738  8331 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.055903  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.061276  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.072471  8259 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.074728  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.075908  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.076297  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.076458  8210 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:42.076884  8211 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:42.077385  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.078090  8217 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:42.078564  8257 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:42.061110 11576 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:42.079492  8217 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:42.065418  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.080859  8218 raft_consensus.cc:2393] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:42.082487  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.082382  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:42.085355  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.086544  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:42.087109  8218 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.088629  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.089370 11662 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:42.089744  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.089869 11662 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:42.090847  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.091810  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.091904  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.092677  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.093307  8287 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 4.
I20260709 13:02:42.093940 11505 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:42.094367 11505 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.094720 11505 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:42.095002  8184 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.069569  8864 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.124150  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.125161  8358 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:42.097524  8288 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:42.128054  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 46799.9us
I20260709 13:02:42.089779  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.123492  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.056337 11591 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:42.119539  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.135797  8362 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.095739  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.136107  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.135004  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.119709  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.016269 11640 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.083622  8114 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 7, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 7 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:02:42.145191  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 50280.6us
I20260709 13:02:42.145872  8184 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.146912  8212 raft_consensus.cc:2368] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:42.143380  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.147653  8893 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:42.131683  8863 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.146138  8114 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 5, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 5 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:42.137014  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 75202.3us
I20260709 13:02:42.137265  8366 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:42.149940  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.149065  8114 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 6, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 6 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:02:42.136626  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 209057us
I20260709 13:02:42.129797  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.135511  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.083756 11622 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:42.144066  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.127900 11305 consensus_queue.cc:1059] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:02:42.061452 11383 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:42.138053  8898 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:02:42.095640 11589 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:42.046588  8112 rpcz_store.cc:269] 0709 13:02:24.778618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.784143 (+  5525us) service_pool.cc:224] Handling call
0709 13:02:41.973311 (+17189168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:38.733094 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:38.733860 (+   766us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:38.733907 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:02:38.733922 (+    15us) tablet.cc:662] Decoding operations
0709 13:02:38.734872 (+   950us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:38.734940 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:38.734956 (+    16us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:02:38.735930 (+   974us) tablet.cc:701] Row locks acquired
0709 13:02:38.735979 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:02:38.736166 (+   187us) write_op.cc:270] Start()
0709 13:02:38.736304 (+   138us) write_op.cc:276] Timestamp: P: 1783602158736105 usec, L: 0
0709 13:02:38.736323 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:38.737118 (+   795us) log.cc:844] Serialized 4312 byte log entry
0709 13:02:40.603848 (+1866730us) op_driver.cc:464] REPLICATION: finished
0709 13:02:40.615793 (+ 11945us) write_op.cc:301] APPLY: starting
0709 13:02:40.615888 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:40.616133 (+   245us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:40.616276 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:40.617731 (+  1455us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:40.618117 (+   386us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:02:40.618172 (+    55us) write_op.cc:312] APPLY: finished
0709 13:02:40.618850 (+   678us) log.cc:844] Serialized 83 byte log entry
0709 13:02:40.619011 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:40.619144 (+   133us) write_op.cc:454] Released schema lock
0709 13:02:40.619219 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:40.622561 (+  3342us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:40.622604 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":342529,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":11659,"apply.run_cpu_time_us":3589,"apply.run_wall_time_us":6717,"num_ops":11,"prepare.queue_time_us":241486,"prepare.run_cpu_time_us":8031,"prepare.run_wall_time_us":8064,"raft.queue_time_us":1858549,"raft.run_cpu_time_us":1479,"raft.run_wall_time_us":12081,"replication_time_us":1867348,"thread_start_us":2712555,"threads_started":4,"wal-append.queue_time_us":3903}]]}
I20260709 13:02:42.095844 11593 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:42.151724  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.095980 11232 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:42.126204 11388 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.269841  8896 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:42.211105  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.084069 11509 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.211737  8894 raft_consensus.cc:1240] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:42.208896 11625 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:02:42.123265 11398 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.216045  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.288825  8893 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:42.216756  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.143921 11484 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:42.153141  8258 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.787s (SENT)
I20260709 13:02:42.228323  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.157025  8895 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 4: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:42.152585  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.154058  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.144595 11450 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:42.135602 11591 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:42.222280  8114 catalog_manager.cc:5697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 5, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:02:42.230641  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 161256us
I20260709 13:02:42.147470 11510 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:42.210467  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.240511  8331 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.298197  8864 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.084259 11576 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.208792 11634 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:42.137079  8889 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:42.208350 11512 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.151639 11137 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:42.232095 11644 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.007s
I20260709 13:02:42.215258 11581 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:42.055580 11337 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.248677  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.377672  8891 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:42.378170 11649 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.295600 11484 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.378767  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.380030  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:42.380298 11671 log.cc:927] Time spent T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:02:42.380627  8891 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
W20260709 13:02:42.380767 11660 consensus_queue.cc:1175] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:42.381841  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.383368  8891 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:42.384205  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.384909 11433 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.096166 11653 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.431257  8361 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:42.212460  8863 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.283030  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:42.432881  8896 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:42.248759  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.243073 11622 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.248620 11589 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.291363  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:42.293251  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:42.294497  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 142055us
I20260709 13:02:42.249573 11640 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:42.294775  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 140859us
I20260709 13:02:42.294710  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:42.417325 11619 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.409788 11524 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.271572 11593 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:42.296317  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.254983 11383 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.090870 11662 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.302829  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:42.303792  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 63382.3us
I20260709 13:02:42.321391  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.372359  8114 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 5, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 5 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.295670 11450 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.294162 11305 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:42.374215  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 76162.7us
I20260709 13:02:42.532660  8898 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:42.385203  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.533290  8331 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.384807  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:42.387514 11670 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:02:42.368250  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:42.302606 11620 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:42.303766 11591 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.402380  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:42.272011  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 53162.3us
W20260709 13:02:42.542974  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 140755us
W20260709 13:02:42.543488  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 390538us
W20260709 13:02:42.544030  8258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.841s (SENT) [suppressed 10 similar messages]
W20260709 13:02:42.544670  8258 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.856s (SENT)
I20260709 13:02:42.405674  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.403787 11584 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.322345 11404 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.303800 11629 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.546525  8184 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.407238 11506 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.380370 11484 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:42.321058 11655 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:42.372051  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.303447 11634 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:42.422569  8218 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:42.532843  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.559553  8217 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:42.540434 11137 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.542227 11620 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:42.533361  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:42.468596  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.520339  8362 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:42.534667  8259 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.550560 11553 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:42.578600  8210 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:02:42.552757 11649 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:42.532831  8894 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:42.533677  8895 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:42.303530 11510 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.533910  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.536896  8212 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.536407  8864 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.321408 11512 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:42.345412 11576 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.404058 11582 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.406282  8360 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:42.545042  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:42.547451  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 141936us
I20260709 13:02:42.548026 11381 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.549160  8285 raft_consensus.cc:2368] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:42.548777  8892 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:42.549388  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.322665 11398 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.550871  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.551661  8184 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.480831 11405 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:42.537971 11450 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:42.614986  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.616276  8367 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:42.620204  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:42.535852 11622 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.629748 11337 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.433234 11667 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:42.535987 11589 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.536561 11383 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.420399 11627 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.557399  8114 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 5, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 5 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:42.540832 11347 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:42.558818  8890 raft_consensus.cc:2393] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:42.541085 11653 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:42.532622  8893 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:42.563097  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.563345  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.533201  8366 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:42.566401 11419 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.643987  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.644567  8366 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
W20260709 13:02:42.644696  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.566784  8359 raft_consensus.cc:2368] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:02:42.567245  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.550848 11404 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.548777 11350 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:02:42.651652 11404 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.651551  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:42.652702  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:42.653395  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.654506  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.655055  8290 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
W20260709 13:02:42.572108 11675 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.194s	user 0.000s	sys 0.003s
I20260709 13:02:42.572821  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.573498  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:42.574175  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.472404 11505 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.554620 11088 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.483629 11663 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:42.432942  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 220643us
W20260709 13:02:42.660241  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.540563 11596 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:02:42.579615  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.580366  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.656683  8284 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.540345 11305 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:42.583431  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 47125.2us
I20260709 13:02:42.584262  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.584273  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.561668 11634 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:42.577967 11620 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:42.548749  8214 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 12: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:42.588603  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:42.685503  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 97013.3us
I20260709 13:02:42.687238  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.658874 11088 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:42.590488  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 45860.8us
I20260709 13:02:42.582433 11388 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:42.696447  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.697153  8889 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:42.586333 11510 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.594115 11582 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.584185 11512 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.579949 11553 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:42.560889 11484 consensus_queue.cc:1059] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:02:42.603686  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 52132.6us
I20260709 13:02:42.584352 11581 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:42.615391  8212 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:42.621598  8213 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:42.622720  8331 leader_election.cc:400] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:42.624313  8257 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:42.625422 11433 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:42.626559 11638 raft_consensus.cc:3055] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:42.627065  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.606434 11640 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:42.538285 11593 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.698835 11398 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:42.650454  8211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.026s
I20260709 13:02:42.655821  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:42.717054  8211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.007s	sys 0.027s
I20260709 13:02:42.651551  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.657203  8293 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:42.643076  8891 pending_rounds.cc:85] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 6
I20260709 13:02:42.661327  8286 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:42.640962 11347 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.680956  8864 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.718624  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.682677  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.644290 11419 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.721020 11419 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.655725 11524 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:42.589701 11137 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:42.688841  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 109366us
W20260709 13:02:42.724316  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.724997  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.725833  8362 raft_consensus.cc:2410] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:42.701208 11350 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:42.691183  8114 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 6, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 6 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.726714 11506 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:42.714725 11629 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:42.706689 11584 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:42.728153 11629 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:42.726773 11350 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.729043 11629 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.706008 11553 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.713603 11640 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.731300 11640 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.734812 11373 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:42.736126 11663 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:42.716557 11509 consensus_queue.cc:1059] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:02:42.737766 11509 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:42.738104 11509 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:42.738946 11509 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.739499  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:42.740057  8892 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.741216 11627 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:42.742616 11582 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:42.744562  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.743840  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.744875  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:42.746395  8289 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:42.743840  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:42.694963  8258 leader_election.cc:336] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.874s (SENT)
I20260709 13:02:42.748953  8258 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.696221  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:42.749717  8293 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:42.750725  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.700389  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.677253 11653 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:42.709645  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 85458.3us
I20260709 13:02:42.753337  8284 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:42.755088  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:42.755121 11653 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.756233  8257 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:42.757336 11398 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.757721 11398 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.714169 11638 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:42.709374  8331 leader_election.cc:403] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.758064 11398 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.760316  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:42.758934  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 136428us
I20260709 13:02:42.765314  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.707602  8184 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:42.768397  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 60905.6us
I20260709 13:02:42.684679 11381 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:42.711416  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:42.713711  8897 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:42.769431  8890 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:42.693542 11626 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.759083 11596 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.772601 11450 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.773759 11366 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:42.645889  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:42.699060 11088 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.718990  8891 pending_rounds.cc:107] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:42.718104  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.774634  8218 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:42.696846 11388 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:42.737761 11623 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:42.713215 11619 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:42.718436 11484 raft_consensus.cc:3055] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:42.718848 11347 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:42.734714  8114 catalog_manager.cc:5697] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 3, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.593868  8895 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:42.765781  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:42.821101  8293 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:42.756163 11673 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.481s	user 0.000s	sys 0.003s
I20260709 13:02:42.715646  8213 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:42.778004  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:42.778641  8889 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:42.766013  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.708850  8209 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:42.720001  8898 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:42.776046  8891 raft_consensus.cc:2889] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:42.810638  8284 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:42.803790  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:42.689043  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 120277us
I20260709 13:02:42.766942 11582 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:42.748013 11649 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:42.849833 11649 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:42.851292 11649 consensus_queue.cc:1059] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:42.853401  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.815902  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:42.768487 11371 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:42.692207  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 144351us
I20260709 13:02:42.816848  8892 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:42.758104 11653 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:42.803582 11388 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.774634 11663 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:42.861680 11663 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:42.862591 11663 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.861693 11505 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:42.866443 11619 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.823671  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.758808 11638 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.868306 11638 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.813846  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:42.871171  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 57426.4us
I20260709 13:02:42.806007 11622 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.820040 11484 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:42.827994 11667 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.871922  8259 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:42.829959  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 135085us
I20260709 13:02:42.823498 11366 raft_consensus.cc:697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:42.832342  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.833786 11635 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:42.809247 11450 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:42.834502  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.834769  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:42.880497  8209 raft_consensus.cc:2410] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:42.835357  8214 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:42.838147  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.880338  8212 raft_consensus.cc:2368] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
I20260709 13:02:42.878679  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.837020  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.841274 11640 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.841830  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 637) took 1036 ms. Trace:
I20260709 13:02:42.841068 11305 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:42.873580  8332 leader_election.cc:400] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:42.873580  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:42.828650  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 62734.3us
I20260709 13:02:42.865319 11576 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:42.876204  8258 leader_election.cc:336] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 2.049s (SENT)
I20260709 13:02:42.830737  8114 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:42.876747  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.845440 11509 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.881661  8360 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.882576  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.897603  8361 rpcz_store.cc:276] 0709 13:02:41.805710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.995903 (+190193us) service_pool.cc:224] Handling call
0709 13:02:41.996161 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.431710 (+435549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.841595 (+409885us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54001ce8d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:42.841765 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000556288}
I20260709 13:02:42.899292  8259 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.899434  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.901599  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:42.858881  8293 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:42.903321  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.904721  8259 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.913661  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.918233  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:42.914671  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:42.825704 11593 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.877632 11371 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.920478  8367 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:42.923815  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:42.900625 11137 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.910915 11505 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:42.866250 11685 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:42.896154 11626 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.924124  8259 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.946063  8366 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:42.963778  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:42.876430 11510 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:42.969204  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 45177.1us
I20260709 13:02:42.970057  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.970932  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.896777 11667 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.944235 11635 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.905603 11433 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:42.905292 11582 raft_consensus.cc:3055] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:42.910529 11619 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.871018 11398 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.910693 11450 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.955590  8284 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:42.960364  8360 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:42.961745  8364 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:42.946661  8114 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 4, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:42.996763  8114 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 1 to 4, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 4 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:42.945979 11371 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:42.988003  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 143582us
I20260709 13:02:42.920500 11281 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:42.923110 11305 consensus_queue.cc:1059] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:02:42.992138 11660 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.962914 11626 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:42.993686  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 92776.9us
I20260709 13:02:43.015844  8863 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:42.923151 11512 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:42.973201 11627 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.983822 11405 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.997396  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:42.987788 11505 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.987118 11662 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.993115  8210 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:43.005225 11371 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.990211 11620 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:42.990582 11582 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:43.013638  8258 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:42.951112 11484 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:43.013224  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 98680.1us
I20260709 13:02:42.987335 11692 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:02:42.989007 11635 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.032121  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:43.034611  8209 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.032475  8216 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:43.018431 11626 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.034806  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:43.057448  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:43.023324 11405 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.022724 11505 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:43.067401  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 653) took 1079 ms. Trace:
I20260709 13:02:43.064817  8213 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:43.027340 11450 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:43.068181  8364 rpcz_store.cc:276] 0709 13:02:41.988319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.061509 (+ 73190us) service_pool.cc:224] Handling call
0709 13:02:42.128758 (+ 67249us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:42.128933 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.996331 (+867398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.061531 (+ 65200us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54001f7054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:43.067340 (+  5809us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968085632}
I20260709 13:02:43.015144 11404 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.033987 11629 raft_consensus.cc:2764] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:43.017685 11433 consensus_queue.cc:1059] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:02:43.058764 11679 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.682s	user 0.003s	sys 0.000s
I20260709 13:02:43.002831 11366 consensus_queue.cc:237] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:43.082056  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.050570 11581 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:43.065622 11405 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.086354  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:43.071586 11584 raft_consensus.cc:3055] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:43.069199 11505 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.032788 11591 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.035331 11347 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.080917 11484 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:43.100831  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.101253  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.108322  8892 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.082267 11450 raft_consensus.cc:697] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:43.083684 11281 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:43.102826  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.103682  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.104290  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.104728  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:43.104919  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:43.116113  8895 raft_consensus.cc:2376] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6. Re-sending same reply.
I20260709 13:02:43.082531 11524 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:43.086212 11640 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:43.080564 11627 consensus_queue.cc:1059] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:02:43.117596  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.095280 11698 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:43.133572 11088 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.135360 11347 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:43.135964  8361 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:43.114768 11582 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.137827 11582 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:43.097033 11584 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:43.141283 11697 log.cc:927] Time spent T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:43.141029 11584 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.112546 11383 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.143589 11591 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:43.144402 11383 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:43.145624  8288 raft_consensus.cc:2393] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:43.118489 11593 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.076360 11694 consensus_queue.cc:1059] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:02:43.116266  8890 raft_consensus.cc:2376] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8. Re-sending same reply.
I20260709 13:02:43.122398 11281 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:43.085750 11576 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:43.097728 11687 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.102312 11663 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:43.095201 11581 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:43.114262  8364 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:43.096769 11685 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:43.127573 11404 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:43.128865 11696 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:02:43.129410  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:43.271109  8217 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.130447 11512 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.152827  8209 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:43.286382  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.287324  8897 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.153517  8892 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:02:43.288301  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.289021  8892 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:43.158337  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2201) took 1106 ms. Trace:
I20260709 13:02:43.223816  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:43.231457  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 656) took 1162 ms. Trace:
I20260709 13:02:43.290932  8364 rpcz_store.cc:276] 0709 13:02:42.069097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.088243 (+1019146us) service_pool.cc:224] Handling call
0709 13:02:43.106631 (+ 18388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.231190 (+124559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.231396 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:43.291911  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:43.269604  8362 raft_consensus.cc:2410] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:43.204324 11589 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.230063 11625 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:43.278465 11337 consensus_meta.cc:287] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.005s
I20260709 13:02:43.175380 11088 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:43.230609 11687 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.298547  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:43.270749 11619 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:43.231081 11510 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:43.242300 11581 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:43.359817  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 136136us
I20260709 13:02:43.330828  8897 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:43.290274  8360 rpcz_store.cc:276] 0709 13:02:42.051883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.002874 (+950991us) service_pool.cc:224] Handling call
0709 13:02:43.015378 (+ 12504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.015573 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:43.037790 (+ 22217us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.039686 (+  1896us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.157972 (+118286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.158025 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:43.158094 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.158157 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.158275 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10293,"prepare.queue_time_us":160340,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":29703,"raft.queue_time_us":84981,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":13090,"thread_start_us":125343,"threads_started":3}
I20260709 13:02:43.332646  8358 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:43.335619 11337 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:43.355378  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.359054  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.329039  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 411073us
I20260709 13:02:43.231897 11388 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.295493 11663 raft_consensus.cc:697] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:43.385550  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:43.394685  8209 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:43.389685  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:43.396386  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:43.397624  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:43.390166  8363 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:43.321985 11450 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.398342  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:43.314682 11625 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.318585 11398 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:43.322422 11512 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:43.343426 11687 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.358855 11694 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:43.413546  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:43.438874  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:43.400027 11679 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:43.406925  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:43.416633  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.409327  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:43.450031  8864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.013s	sys 0.029s
W20260709 13:02:43.450354  8864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.029s
I20260709 13:02:43.450379  8293 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:43.450961  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 549688us
I20260709 13:02:43.452679  8331 leader_election.cc:400] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
I20260709 13:02:43.453045  8331 leader_election.cc:403] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:43.440532  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.453733  8288 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 12: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:43.418910  8359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 630) took 1662 ms (client timeout 1823 ms). Trace:
I20260709 13:02:43.427392 11388 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.427541 11625 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.428100  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:43.462983  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 56197.6us
W20260709 13:02:43.428695 11695 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
I20260709 13:02:43.419497 11638 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:43.420087 11705 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:02:43.430330  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.420331 11653 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.431147  8285 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:43.332849 11698 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:43.485069  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 446387us
I20260709 13:02:43.438532 11694 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:43.271376 11685 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.444115  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:43.447659 11371 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.331503 11281 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.473109 11576 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:43.454501  8359 rpcz_store.cc:269] 0709 13:02:41.728769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.728959 (+   190us) service_pool.cc:224] Handling call
0709 13:02:43.389846 (+1660887us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54003179d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:43.390771 (+   925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416665344}
I20260709 13:02:43.453918  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:43.457603  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 44166.4us
I20260709 13:02:43.468955  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:43.514932  8360 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.470623  8332 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:43.515465  8183 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:43.227443 11634 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.471302  8287 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.462354  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:43.295841 11699 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:02:43.520964  8361 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:43.440141 11419 consensus_meta.cc:287] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.013s
I20260709 13:02:43.436797 11619 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:43.404804 11337 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.481365  8286 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:43.413584 11710 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:43.547873  8289 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.480695  8293 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:43.450994 11512 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.439858  8364 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:43.457404 11620 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:43.462271 11088 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:43.492162  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.491926  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 777) took 1422 ms. Trace:
I20260709 13:02:43.491905  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.558748  8288 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.494475  8209 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.463881 11704 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:43.453413  8864 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:43.470854  8212 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:43.517691  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:43.568032  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 50431.8us
I20260709 13:02:43.569842  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:43.519609  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 65772.7us
W20260709 13:02:43.519485  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 49000.3us
I20260709 13:02:43.483991 11653 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:43.525087 11510 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:43.530401 11706 log.cc:927] Time spent T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:02:43.531618  8286 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:43.531834 11589 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.517063 11663 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.579708 11373 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:43.590512 11373 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:43.591001  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.591718  8284 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:43.593021 11553 consensus_meta.cc:287] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.863s	user 0.007s	sys 0.004s
I20260709 13:02:43.593418 11553 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.593801 11350 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:43.594305 11698 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.595404  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 644) took 1681 ms. Trace:
W20260709 13:02:43.541137 11596 consensus_meta.cc:287] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.739s	user 0.005s	sys 0.003s
I20260709 13:02:43.595777  8363 rpcz_store.cc:276] 0709 13:02:41.914247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.010666 (+ 96419us) service_pool.cc:224] Handling call
0709 13:02:43.389967 (+1379301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.405725 (+ 15758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.595187 (+189462us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54003179d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:43.595323 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173079424}
I20260709 13:02:43.596256 11596 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:43.597023  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:43.579185 11653 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.604679  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:43.605376  8890 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:43.607767 11635 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:43.548494 11713 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:43.609541 11713 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:43.609951 11713 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.553462 11419 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.611196  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:43.611927  8210 raft_consensus.cc:2368] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9.
I20260709 13:02:43.612701 11419 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.613095  8210 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:43.562002  8184 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:43.572297  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:43.573472  8288 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:43.575503  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:43.562768 11701 log.cc:927] Time spent T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:02:43.524209 11619 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:43.491704 11388 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:02:43.560145 11509 consensus_meta.cc:287] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.001s
I20260709 13:02:43.548228 11484 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:43.637872  8209 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:43.582404  8360 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:43.583945  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.587592 11685 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.588748 11721 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:43.589352  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.643759  8286 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:43.497428 11366 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:02:43.557399 11137 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:02:43.614727  8218 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.576447  8894 raft_consensus.cc:2410] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:02:43.614331  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.563567 11699 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:43.558559  8215 rpcz_store.cc:276] 0709 13:02:42.064725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.066120 (+  1395us) service_pool.cc:224] Handling call
0709 13:02:42.095342 (+ 29222us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:42.146773 (+ 51431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.146806 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:42.220789 (+ 73983us) log.cc:844] Serialized 78 byte log entry
0709 13:02:42.293508 (+ 72719us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:42.321076 (+ 27568us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.321284 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.321353 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.697680 (+376327us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b180041e9c0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:42.922767 (+225087us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:43.486890 (+564123us) raft_consensus.cc:1685] finished
0709 13:02:43.486910 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.487066 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71781,"prepare.queue_time_us":32542,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":3762,"raft.queue_time_us":48628,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":103626,"spinlock_wait_cycles":139753216,"thread_start_us":12208,"threads_started":1,"wal-append.queue_time_us":139327}
I20260709 13:02:43.617749  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:43.634662 11589 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:43.621384  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.622275  8365 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:43.622390  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:43.578670  8291 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:43.623327  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 51148.6us
W20260709 13:02:43.623941  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 62076.1us
W20260709 13:02:43.622723  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 54104.2us
I20260709 13:02:43.660226  8332 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:43.624070  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 170807us
I20260709 13:02:43.629722  8257 leader_election.cc:400] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9.
I20260709 13:02:43.660971  8257 leader_election.cc:403] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:02:43.595722 11626 consensus_meta.cc:287] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.001s
I20260709 13:02:43.665066  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2200) took 1613 ms. Trace:
I20260709 13:02:43.580024 11620 raft_consensus.cc:2764] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:43.644419  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:43.669646  8360 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.594376 11350 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:43.652444  8893 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:43.634717 11419 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:43.564972 11512 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.635035 11619 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.655529  8210 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:43.619302  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:43.628106 11371 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:43.662233  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:43.661729  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:43.626900 11717 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:43.633925  8217 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:43.667871  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:43.579116 11405 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.681249  8218 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:43.665428  8366 rpcz_store.cc:276] 0709 13:02:42.051623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.965787 (+914164us) service_pool.cc:224] Handling call
0709 13:02:42.974381 (+  8594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.990674 (+ 16293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.990703 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.996468 (+  5765us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.084234 (+ 87766us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:43.084274 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.084339 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.664878 (+580539us) raft_consensus.cc:1685] finished
0709 13:02:43.664899 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.665010 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15726,"raft.queue_time_us":59807,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":8339,"thread_start_us":62269,"threads_started":1,"wal-append.queue_time_us":300548}
I20260709 13:02:43.649199 11484 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:43.664672 11707 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:02:43.655172 11699 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:43.687950  8862 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:43.656786 11721 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:43.636626 11635 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:43.692498  8332 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:43.777338  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 84960.1us
I20260709 13:02:43.739358  8360 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:43.779443  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:43.780018  8360 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.785307  8288 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:43.668998 11685 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:43.629664 11722 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:02:43.725261  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:43.717769  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 98554.4us
I20260709 13:02:43.792528  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:43.795297  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:43.810221  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 141530us
I20260709 13:02:43.624464 11694 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:43.820199  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.814704  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2207) took 1106 ms. Trace:
I20260709 13:02:43.809819 11685 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:43.718500 11510 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:43.718286 11596 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.686966 11366 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
W20260709 13:02:43.822894  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 135107us
I20260709 13:02:43.686290 11350 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.822257  8367 rpcz_store.cc:276] 0709 13:02:42.707919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.776336 (+ 68417us) service_pool.cc:224] Handling call
0709 13:02:43.814478 (+1038142us) spinlock_profiling.cc:243] Waited 94.2 ms on lock 0x7b54004619d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:43.814638 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216573696}
I20260709 13:02:43.697760 11419 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:43.775875 11589 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:43.674795 11626 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:43.829744  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 104616us
I20260709 13:02:43.842468  8367 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:43.829919  8360 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:43.830377  8366 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:43.844848  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1766) took 1694 ms. Trace:
I20260709 13:02:43.775281 11634 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.830861  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.723107 11698 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:43.787397 11305 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:43.845285  8367 rpcz_store.cc:276] 0709 13:02:42.150461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.841908 (+1691447us) service_pool.cc:224] Handling call
0709 13:02:43.842284 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.844567 (+  2283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.844781 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:43.837003 11660 consensus_meta.cc:287] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.000s
I20260709 13:02:43.848847  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 909) took 1611 ms. Trace:
I20260709 13:02:43.822657  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:43.816913 11591 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:43.824725  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:43.838884  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.722267 11524 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:02:43.829339 11685 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.830399 11088 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:43.846297  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1765) took 1696 ms. Trace:
I20260709 13:02:43.871194  8366 rpcz_store.cc:276] 0709 13:02:42.150191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.794149 (+1643958us) service_pool.cc:224] Handling call
0709 13:02:43.830223 (+ 36074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.846033 (+ 15810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.846240 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:43.826347 11635 consensus_queue.cc:1243] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:43.845952  8286 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:43.850505  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:43.875630  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:43.851001 11634 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:43.849236  8898 rpcz_store.cc:276] 0709 13:02:42.237615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.602407 (+364792us) service_pool.cc:224] Handling call
0709 13:02:42.602806 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.842817 (+240011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.848565 (+1005748us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540075dd54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:43.848790 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259710848}
I20260709 13:02:43.851269 11722 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.851914 11629 raft_consensus.cc:3055] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:43.776180 11450 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:02:43.852737  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.836833 11717 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:43.854861  8287 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:43.869778  8363 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.883177 11620 raft_consensus.cc:2764] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:43.883680 10841 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:43.842656 11589 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:43.838318 11510 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:43.837080 11719 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:43.888451  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.885202  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2371) took 1302 ms. Trace:
W20260709 13:02:43.978592 11723 log.cc:927] Time spent T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:02:43.977454  8290 rpcz_store.cc:276] 0709 13:02:42.565923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.744335 (+178412us) service_pool.cc:224] Handling call
0709 13:02:42.762488 (+ 18153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.801891 (+ 39403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.801921 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.820934 (+ 19013us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.114103 (+293169us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:43.661231 (+547128us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.836807 (+175576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.836877 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.868293 (+ 31416us) raft_consensus.cc:1685] finished
0709 13:02:43.868317 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.868462 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12233,"prepare.queue_time_us":707615,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1751,"raft.queue_time_us":151837,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":41183,"thread_start_us":895989,"threads_started":3,"wal-append.queue_time_us":534729}
I20260709 13:02:43.954053 10841 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:43.979808  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:43.980566  8290 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:43.981153 11512 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.981431  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:43.877067  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:43.884913 11591 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:43.982443  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 105490us
I20260709 13:02:43.982635 11404 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.983155 11404 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.983862 11591 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.985076 11404 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.985253 11620 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:43.855767 11593 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:43.986233 11700 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:43.981941 11667 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:43.986259 11685 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.987633  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.988330  8287 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:43.898413 11717 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:43.989059  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:43.989246 11717 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.897914  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 804) took 1766 ms. Trace:
I20260709 13:02:43.986809 11700 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.980278 10841 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.992676 11700 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:43.995033 11726 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:02:43.891003 11088 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:43.996773 11088 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.997500 11685 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.998725  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:44.002096  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:44.003264  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:43.839408 11596 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.869946 11710 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:43.872236 11660 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:43.862569 11663 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:43.954638  8363 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
W20260709 13:02:43.884451 11709 log.cc:927] Time spent T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:02:43.870858 11484 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.956265  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:43.958446  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.960323  8359 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:43.961053  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:44.032652  8894 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.963531  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:43.990558 11718 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:43.847198 11731 consensus_queue.cc:1059] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:02:43.889446 11629 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:43.976330  8289 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:43.985847 11350 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:43.854815 11337 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:43.933003 11589 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.980387  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:43.962873 11727 log.cc:927] Time spent T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:02:44.025029 11593 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:43.990322  8291 rpcz_store.cc:276] 0709 13:02:42.131843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.143352 (+ 11509us) service_pool.cc:224] Handling call
0709 13:02:42.216091 (+ 72739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.658948 (+1442857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.897683 (+238735us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400446bd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:43.897852 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3134772096}
I20260709 13:02:43.892441 11722 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.014253  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:44.021790  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 392375us
W20260709 13:02:43.966267  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 123095us
I20260709 13:02:44.033666  8288 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.065933 11398 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.066483 11398 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.067659 11722 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.068711 11398 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:44.069540  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1775) took 1916 ms. Trace:
I20260709 13:02:43.899287 11721 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:44.043990 11728 log.cc:927] Time spent T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:44.072525 11627 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:44.072917 11622 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.041281  8367 raft_consensus.cc:1240] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:44.043710 11690 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:44.043941  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1211) took 1896 ms. Trace:
I20260709 13:02:44.045051  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:44.074712 11690 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:44.075178  8361 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:44.075747 11690 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:43.952826 11687 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:43.868892 11581 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.076841 11690 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.064836  8864 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:44.039081 11371 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9.
I20260709 13:02:44.077436  8896 rpcz_store.cc:276] 0709 13:02:42.147368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.584907 (+437539us) service_pool.cc:224] Handling call
0709 13:02:42.585232 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:42.609450 (+ 24218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.609482 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:42.618543 (+  9061us) log.cc:844] Serialized 52 byte log entry
0709 13:02:42.709284 (+ 90741us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:42.879080 (+169796us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.017724 (+138644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.043561 (+1025837us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54005fee54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:44.043612 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.043656 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:44.043745 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.043886 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23162,"prepare.queue_time_us":234403,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3367,"raft.queue_time_us":158955,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":5928,"spinlock_wait_cycles":54588672,"thread_start_us":348227,"threads_started":3,"wal-append.queue_time_us":127215,"wal-append.run_cpu_time_us":2616,"wal-append.run_wall_time_us":1185989}
I20260709 13:02:44.079782 11405 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.080152  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:44.080808 11687 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.081305 11596 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.015431 11685 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:44.085227 11524 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:44.086373  8293 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:44.086807 11635 consensus_queue.cc:1059] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:44.067579 11681 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 1.212s	user 0.008s	sys 0.005s
I20260709 13:02:44.050802  8894 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:44.054744  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:44.087803 11667 raft_consensus.cc:3055] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:44.056923  8365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2208) took 1348 ms (client timeout 1563 ms). Trace:
I20260709 13:02:44.057621 11704 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 5. Current term is 6.
I20260709 13:02:44.058524  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:44.026873 11713 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.059882  8890 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:44.105386  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:44.064608  8358 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2202) took 2012 ms (client timeout 2192 ms). Trace:
W20260709 13:02:44.106415  8358 rpcz_store.cc:269] 0709 13:02:42.052115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.148771 (+ 96656us) service_pool.cc:224] Handling call
0709 13:02:44.064450 (+1915679us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001f7554. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:44.064553 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2400415104}
W20260709 13:02:44.071110  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 56984us
I20260709 13:02:44.071812  8257 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:44.035389  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:44.074056 11593 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:44.078500 11581 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:44.048532  8184 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:44.076792  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1777) took 1837 ms. Trace:
I20260709 13:02:44.088865  8864 leader_election.cc:400] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:02:44.079707  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:43.977602 11719 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.134469  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:44.070019  8366 rpcz_store.cc:276] 0709 13:02:42.152948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.889132 (+1736184us) service_pool.cc:224] Handling call
0709 13:02:43.954934 (+ 65802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.986726 (+ 31792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.986756 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.986814 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:43.986852 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.069314 (+ 82462us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b54003188d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:44.069360 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.069482 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72703872}
I20260709 13:02:44.092115  8288 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:44.036738 11718 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:44.098608  8897 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.136315  8896 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:44.056143  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 927) took 1357 ms. Trace:
I20260709 13:02:44.099831  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1779) took 1283 ms. Trace:
W20260709 13:02:44.100630  8365 rpcz_store.cc:269] 0709 13:02:42.708204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.712399 (+  4195us) service_pool.cc:224] Handling call
0709 13:02:44.056773 (+1344374us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400180954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:44.056871 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887633152}
I20260709 13:02:44.102146  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2298) took 1246 ms. Trace:
I20260709 13:02:44.103415  8291 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:43.842490 11419 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:44.049827 11663 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:44.107745  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:44.105258  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 919) took 1728 ms. Trace:
I20260709 13:02:44.089607  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:44.139145  8893 rpcz_store.cc:276] 0709 13:02:42.699018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.749959 (+ 50941us) service_pool.cc:224] Handling call
0709 13:02:44.055931 (+1305972us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54003a34d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:44.056053 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035766656}
I20260709 13:02:44.137953  8213 rpcz_store.cc:276] 0709 13:02:42.855742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.868666 (+ 12924us) service_pool.cc:224] Handling call
0709 13:02:42.868890 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.069910 (+201020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.101857 (+1031947us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400401d54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:44.102061 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450424576}
I20260709 13:02:44.136934  8362 rpcz_store.cc:276] 0709 13:02:42.816372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.836819 (+ 20447us) service_pool.cc:224] Handling call
0709 13:02:44.099646 (+1262827us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400433d54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:44.099770 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856234880}
I20260709 13:02:44.134621  8361 rpcz_store.cc:276] 0709 13:02:42.239575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.076032 (+1836457us) service_pool.cc:224] Handling call
0709 13:02:44.076321 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.076475 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.076506 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:44.076541 (+    35us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:44.076568 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.076620 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.076741 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:44.042703 11653 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.086637 11524 raft_consensus.cc:2764] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:44.140374  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:44.141099  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 176489us
I20260709 13:02:44.153033  8215 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:44.153362  8361 raft_consensus.cc:1240] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:44.109341  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 60906.6us
I20260709 13:02:44.141920  8891 rpcz_store.cc:276] 0709 13:02:42.376981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.607062 (+230081us) service_pool.cc:224] Handling call
0709 13:02:42.642855 (+ 35793us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:42.876689 (+233834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.876722 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:42.902388 (+ 25666us) log.cc:844] Serialized 52 byte log entry
0709 13:02:43.079649 (+177261us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:43.079688 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.079765 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.779185 (+699420us) raft_consensus.cc:1685] finished
0709 13:02:43.779204 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.100871 (+321667us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b54002b34d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:44.105182 (+  4311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54039,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5898,"spinlock_wait_cycles":42644864,"thread_start_us":118207,"threads_started":1,"wal-append.queue_time_us":185865}
I20260709 13:02:44.144691  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:44.149384  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:44.136171  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:44.155052  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:44.154992  8217 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:44.156388  8293 raft_consensus.cc:2410] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:44.156657  8184 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:44.104548 11398 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.158296  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2213) took 1062 ms. Trace:
I20260709 13:02:44.158975  8361 rpcz_store.cc:276] 0709 13:02:43.095960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.152930 (+1056970us) service_pool.cc:224] Handling call
0709 13:02:44.153200 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.158033 (+  4833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.158236 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:44.161165  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 72467.4us
I20260709 13:02:44.135967 11640 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:44.135695 11450 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:44.161711  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:44.162655  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:44.165032  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:44.166878  8897 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:44.173317  8293 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:44.100448 11667 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:44.170290  8183 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:44.136518 11719 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:44.171813  8257 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:44.172473  8360 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:44.168597  8184 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:44.174093  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.174342  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.145159 11576 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:44.177045  8897 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:44.177122  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:44.177361  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.177974  8894 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:44.152408 11593 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.181988  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 784) took 2096 ms. Trace:
I20260709 13:02:44.182703  8184 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:44.135627 11509 consensus_queue.cc:1059] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:02:44.069756 11629 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.167635 11596 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:44.163798 11685 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:44.165602 11620 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:44.184842  8216 rpcz_store.cc:276] 0709 13:02:42.085078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.233626 (+148548us) service_pool.cc:224] Handling call
0709 13:02:42.249075 (+ 15449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.050739 (+801664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.181724 (+1130985us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b54001aefd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:44.181922 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1802151296}
I20260709 13:02:44.103291 11510 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.195288  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.192416  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.182128 11484 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:44.206089  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 43505.1us
I20260709 13:02:44.184669 10841 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:44.214773  8215 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:44.187588 11721 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:44.171327 11398 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.223240  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.227169  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.228864  8897 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
W20260709 13:02:44.229681  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 54242.6us
I20260709 13:02:44.210989 11629 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:44.229832  8215 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:44.233444  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2164) took 2170 ms. Trace:
I20260709 13:02:44.215757 11731 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:44.201918 11450 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:44.232636  8894 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:44.203194 11735 raft_consensus.cc:2764] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:02:44.233211 11512 raft_consensus.cc:2764] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:44.236755 11620 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:44.233906  8292 rpcz_store.cc:276] 0709 13:02:42.062630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.134668 (+ 72038us) service_pool.cc:224] Handling call
0709 13:02:42.213214 (+ 78546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.282371 (+ 69157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.282398 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.282839 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.476722 (+193883us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:42.528758 (+ 52036us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.528982 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.759424 (+230442us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b1800496b40. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:42.762732 (+  3308us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b540047d954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:42.762778 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.066920 (+1304142us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:44.233191 (+166271us) raft_consensus.cc:1685] finished
0709 13:02:44.233214 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.233378 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8407,"prepare.queue_time_us":59059,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4645,"raft.queue_time_us":761,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":4883,"spinlock_wait_cycles":172361216,"thread_start_us":157071,"threads_started":1,"wal-append.queue_time_us":424419}
W20260709 13:02:44.244297 11505 consensus_meta.cc:287] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 1.130s	user 0.003s	sys 0.008s
I20260709 13:02:44.228763 10841 raft_consensus.cc:697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:44.246332 11740 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:44.246347 11373 consensus_meta.cc:287] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.002s
I20260709 13:02:44.184145 11718 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.235010 11731 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.228137 11722 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:02:44.231199 11484 raft_consensus.cc:697] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:44.301563 11484 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.280632 11634 consensus_queue.cc:1059] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:02:44.303098 10841 consensus_queue.cc:237] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:44.304186 11713 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:44.269889  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.271413 11383 raft_consensus.cc:3055] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:44.196251 11734 consensus_queue.cc:1059] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:44.245481 11653 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.233374 11137 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.281965  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:44.297142 11740 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.279763 11524 consensus_queue.cc:1059] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:02:44.248263 11736 log.cc:927] Time spent T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Append to log took a long time: real 0.139s	user 0.000s	sys 0.002s
I20260709 13:02:44.289327 11373 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:44.289780 11741 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:44.290530 11718 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.293089 11553 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.191408 11593 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.281801 11505 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.280144 11640 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:44.245128 11699 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.298497 11731 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.207139 11663 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.231014 11667 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.307087 11383 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:44.310420 11734 consensus_queue.cc:1243] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:44.322996  8218 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:44.318706 11619 consensus_meta.cc:287] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.001s
I20260709 13:02:44.326390  8292 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:02:44.342926  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 151052us
I20260709 13:02:44.313162 11740 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:44.327529 11398 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:44.317281 11137 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.329337 11505 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.329792  8212 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:44.345749  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.323844 11450 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:44.365067  8896 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:44.366596 11640 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:44.359258 11398 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:44.372854 11398 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.357646 11699 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:44.356029 11619 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:44.414460  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.418499 11753 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:02:44.421098 11754 log.cc:927] Time spent T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:44.472334  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1696) took 1040 ms. Trace:
I20260709 13:02:44.470376  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:44.476611  8364 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:44.473910  8211 rpcz_store.cc:276] 0709 13:02:43.431976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.558789 (+126813us) service_pool.cc:224] Handling call
0709 13:02:43.559113 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.615413 (+ 56300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.615441 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.615480 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:43.615514 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.472085 (+856571us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b5400425254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:44.472132 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.472269 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129087744}
I20260709 13:02:44.481621  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:44.471148 11685 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.485412  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.485641  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:44.486181  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.487366  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:44.487782  8889 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 12: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:44.488976  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.475416 11553 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:44.504864  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.506582  8898 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:44.476289 11627 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:44.385684 11383 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.486423 11649 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.534549  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:44.535772  8894 raft_consensus.cc:2368] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:44.536957  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.537936  8889 raft_consensus.cc:2410] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:44.538923  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:44.547487  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:44.551332 11751 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:02:44.553043 11757 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:44.544420 11649 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:44.554673 11755 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:02:44.556042 11752 log.cc:927] Time spent T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:02:44.556193 11649 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:44.534754 11747 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:44.493675 11685 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:44.508157 11553 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:44.518282 11627 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:44.818492  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.115784  8366 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.558470  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:45.117383  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:44.803618  8896 raft_consensus.cc:2410] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:02:44.798436  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.621572  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:44.809800  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.119866  8893 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:44.650489  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 807) took 1806 ms. Trace:
W20260709 13:02:45.120669  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 561273us
I20260709 13:02:45.120949  8285 rpcz_store.cc:276] 0709 13:02:42.843764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.843893 (+   129us) service_pool.cc:224] Handling call
0709 13:02:42.844175 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.484087 (+639912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.650241 (+1166154us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5400172ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:44.650430 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350166272}
W20260709 13:02:45.122444  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.582522  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:44.559140  8898 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.124364  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2209) took 2415 ms. Trace:
I20260709 13:02:45.125813  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:45.123827  8361 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:45.119366  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.558117 11619 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.124836  8366 rpcz_store.cc:276] 0709 13:02:42.708448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.146246 (+1437798us) service_pool.cc:224] Handling call
0709 13:02:45.115407 (+969161us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:45.115613 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.124094 (+  8481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.124302 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5171968}
W20260709 13:02:45.128247  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.894009 11718 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.005s
W20260709 13:02:44.810144 11589 consensus_meta.cc:287] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.745s	user 0.013s	sys 0.015s
W20260709 13:02:45.052009 11740 consensus_meta.cc:287] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.000s
W20260709 13:02:44.851696 10841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.011s
W20260709 13:02:44.893287 11719 consensus_meta.cc:287] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.001s
I20260709 13:02:45.130272  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:44.542411 11593 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:44.549158 11383 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:44.800222 11629 consensus_meta.cc:287] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.526s	user 0.019s	sys 0.014s
I20260709 13:02:44.533131 11760 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.125358 11747 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.148444 11760 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.040737 11582 raft_consensus.cc:3055] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:44.588719 11690 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.133123  8364 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.155606 11582 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:45.175679 11582 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:45.142376 10841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.001s	sys 0.013s
I20260709 13:02:44.665620 11731 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.131891 11763 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.136544 11088 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:45.138113 11766 log.cc:927] Time spent T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:02:45.139793  8288 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:45.125505 11433 raft_consensus.cc:3055] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:45.140715  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:45.132625 11756 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.417s	user 0.000s	sys 0.001s
I20260709 13:02:45.146652 11719 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.150431  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:45.154327  8361 raft_consensus.cc:2393] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:45.181228  8364 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:45.135977  8285 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:45.140268 11584 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:45.211418  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:45.215237  8361 raft_consensus.cc:2393] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:45.142652 11589 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.219468  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 659) took 1054 ms. Trace:
I20260709 13:02:45.144061 11740 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.220336  8361 rpcz_store.cc:276] 0709 13:02:44.165495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.211172 (+1045677us) service_pool.cc:224] Handling call
0709 13:02:45.219390 (+  8218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:45.208091 11433 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:45.236270 11433 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.237361 11433 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:45.237546  8361 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:45.238482  8895 raft_consensus.cc:2368] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7.
I20260709 13:02:45.185367 11690 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.206135 11763 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:45.273839  8289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60538 (request call id 2379) took 1859 ms (client timeout 2363 ms). Trace:
I20260709 13:02:45.206970 11747 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:45.278908  8289 rpcz_store.cc:269] 0709 13:02:43.410749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.410856 (+   107us) service_pool.cc:224] Handling call
0709 13:02:45.262233 (+1851377us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400045454. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:45.269745 (+  7512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249216896}
I20260709 13:02:45.208863 11088 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.286888  8898 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:45.295779  8366 raft_consensus.cc:2410] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:02:45.279716 11715 log.cc:927] Time spent T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 1.557s	user 0.001s	sys 0.019s
I20260709 13:02:45.297056 11720 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.313187 11767 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:45.317489  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:45.320082  8896 raft_consensus.cc:2393] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:45.320958  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.321514  8896 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.334228 11627 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:45.340936 11742 log.cc:927] Time spent T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 1.105s	user 0.007s	sys 0.009s
I20260709 13:02:45.304081 11747 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:45.362327 11747 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.364166 11747 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.364725  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2221) took 1582 ms. Trace:
I20260709 13:02:45.365233 11589 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.365113  8361 rpcz_store.cc:276] 0709 13:02:43.782180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.236933 (+1454753us) service_pool.cc:224] Handling call
0709 13:02:45.237247 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.238471 (+  1224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.364665 (+126194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:45.365103  8215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.007s	sys 0.007s
W20260709 13:02:45.366277  8215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.007s	sys 0.007s
I20260709 13:02:45.367093  8361 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:45.364271  8896 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:02:45.368433  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 657) took 1204 ms. Trace:
I20260709 13:02:45.368748  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.368773  8361 rpcz_store.cc:276] 0709 13:02:44.163821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.366427 (+1202606us) service_pool.cc:224] Handling call
0709 13:02:45.366761 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.367488 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.367691 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:45.370110  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:45.370855  8896 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:45.383461  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 791) took 2378 ms. Trace:
I20260709 13:02:45.386842  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.388113  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.355489 11760 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.404202  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.408975  8896 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.390614  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.333813 11720 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.385149  8214 rpcz_store.cc:276] 0709 13:02:43.004858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.005017 (+   159us) service_pool.cc:224] Handling call
0709 13:02:43.017677 (+ 12660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.017997 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.018025 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.021674 (+  3649us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.314287 (+292613us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:43.314330 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.326313 (+ 11983us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.129383 (+1803070us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:45.378511 (+249128us) raft_consensus.cc:1685] finished
0709 13:02:45.378539 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.383399 (+  4860us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2805,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":9617,"spinlock_wait_cycles":3940224,"thread_start_us":255521,"threads_started":1,"wal-append.queue_time_us":611187}
W20260709 13:02:45.418419  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:45.421183  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:45.383277 11770 log.cc:927] Time spent T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:02:45.371325 11699 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.419107  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.424182  8896 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:45.390378 11692 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.388943 11620 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:45.404772 11700 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:45.433712 11775 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.434317 11775 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.436635 11775 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.437181 11775 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.425307 11685 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:45.426415 11759 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.915s	user 0.018s	sys 0.021s
I20260709 13:02:45.422547 11718 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.422400 10841 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:45.422772 11629 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:45.424724 11663 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.445065  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:45.426678 11731 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.437626 11775 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:45.431314 11722 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:45.556491  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.427003 11699 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:45.568943  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.570768  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.545742  8213 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:45.571630  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:45.566500  8362 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:02:45.514755  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:45.382627 11694 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.546581  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.566534  8359 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
W20260709 13:02:45.575968  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 131443us
I20260709 13:02:45.549147  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:45.577036  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:45.577150  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:45.440716 11589 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.577064  8288 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:45.578303  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 63710.6us
I20260709 13:02:45.578610  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:45.579020  8291 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:45.578102  8216 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.580070  8258 leader_election.cc:400] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:45.532562  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.580319  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:45.581003  8258 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:45.572721  8362 pending_rounds.cc:85] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 8
I20260709 13:02:45.582422  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:45.582365  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:45.582877  8362 pending_rounds.cc:107] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:02:45.583148  8362 raft_consensus.cc:2889] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.583179  8284 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:45.583654  8892 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 12: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:45.584250  8332 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:45.581682 11777 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:45.585379  8285 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:45.585765 11777 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:45.586238 11509 raft_consensus.cc:3055] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:45.586354 11773 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:45.586696 11777 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.587647 11584 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:45.588081 11584 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:45.588474 11584 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:45.586644  8286 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:45.592013  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 664) took 1422 ms. Trace:
I20260709 13:02:45.592332  8362 rpcz_store.cc:276] 0709 13:02:44.169268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.565791 (+1396523us) service_pool.cc:224] Handling call
0709 13:02:45.566135 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.591790 (+ 25655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.591966 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:45.442988 11371 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.440929 11484 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.594378  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:45.595090  8287 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.595448  8284 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:45.590512  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:45.598742  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:45.607666  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:45.608498  8284 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:45.609479  8288 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:45.591809  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:45.448899 11690 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:45.612663  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.448349 11740 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.535840 11763 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:45.553025 11373 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.441838 11620 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:45.529207 11088 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.581807 11774 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:45.587682 11685 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:45.531767 11784 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:45.638365 11784 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.619019  8286 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:45.640604 11784 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.595517 11660 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:45.641782 11660 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:45.642021  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.644865 11660 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.645764 11620 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.614521 11711 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:45.620826  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:45.621599  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.651288  8892 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:45.651149  8216 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:45.651531 11791 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:45.586643 11509 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:45.441620 11700 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:45.438544 11692 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.628844  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:45.628942 11783 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:02:45.634531 11699 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:45.614368 11433 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:45.646940  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.658380  8214 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:45.447057 11718 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:45.481938 10841 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.619491 11731 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:45.582499 11629 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:45.672554 11781 log.cc:927] Time spent T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:02:45.673291  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1698) took 2221 ms. Trace:
I20260709 13:02:45.673715  8212 rpcz_store.cc:276] 0709 13:02:43.451740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.566868 (+115128us) service_pool.cc:224] Handling call
0709 13:02:43.567116 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.356903 (+789787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.673057 (+1316154us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400128254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:45.673231 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754488704}
I20260709 13:02:45.652103 11791 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:45.583531 11722 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:45.653551  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 661) took 1486 ms. Trace:
I20260709 13:02:45.655119  8287 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:45.593616 11589 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.652166  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:45.629436 11763 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.655865  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 97899.3us
W20260709 13:02:45.656214  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 55205.5us
I20260709 13:02:45.591377 11782 consensus_queue.cc:1059] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:02:45.712072 11782 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:45.713388 11782 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.589749 11663 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.597815 11371 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:45.715749 11371 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.647647 11685 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.716391 11685 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:45.719269 11629 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.611867 11484 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.687299  8361 rpcz_store.cc:276] 0709 13:02:44.166960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.369888 (+1202928us) service_pool.cc:224] Handling call
0709 13:02:45.372588 (+  2700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.372989 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.373019 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.384116 (+ 11097us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.519380 (+135264us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:45.595914 (+ 76534us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.653232 (+ 57318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.653311 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.653356 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:45.653368 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.653495 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":148443,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":51,"raft.queue_time_us":35527,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":8217,"thread_start_us":206017,"threads_started":3,"wal-append.queue_time_us":98664}
I20260709 13:02:45.659181 11711 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:45.693885  8892 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:45.696373 11589 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.696871 11584 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:45.702945  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.709571 11626 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.714182 11775 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.711092  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:45.768007  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.768213  8891 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:45.719825  8211 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:45.720292 11763 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.722389  8289 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:45.660851  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:45.769851  8288 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:45.717326 11509 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:45.691833 11786 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:02:45.747421 11718 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.745962 11711 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.758464  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:45.802825  8363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2214) took 2671 ms (client timeout 2109 ms). Trace:
I20260709 13:02:45.690322 11720 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:45.710603 11383 consensus_meta.cc:287] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 13:02:45.762262  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:45.762444  8258 leader_election.cc:336] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.503s (SENT)
I20260709 13:02:45.812783  8258 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:45.812855  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:45.813745  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 51362.3us
I20260709 13:02:45.763000  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:45.757809  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2224) took 1559 ms. Trace:
I20260709 13:02:45.761147  8257 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:45.770324  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.713831 11782 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.772039  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:45.815475  8216 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:45.814702  8362 rpcz_store.cc:276] 0709 13:02:44.198024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.592880 (+1394856us) service_pool.cc:224] Handling call
0709 13:02:45.593133 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.658960 (+ 65827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.658995 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.659043 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:45.659081 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.659147 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.757739 (+ 98592us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14329,"raft.queue_time_us":52187,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3375,"thread_start_us":46676,"threads_started":1}
I20260709 13:02:45.816334  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:45.781340 11685 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.782641  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:45.783730  8892 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:45.784822 11589 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.785296  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.791317 11584 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.792982 11763 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.784978  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:45.797787  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 206142us
I20260709 13:02:45.796159  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:45.803357  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:45.803242  8363 rpcz_store.cc:269] 0709 13:02:43.131454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.596763 (+465309us) service_pool.cc:224] Handling call
0709 13:02:45.802654 (+2205891us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54000677d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:45.802766 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626198272}
I20260709 13:02:45.789793 11773 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:45.816334  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.829562  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.830180  8216 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:45.830972  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:45.815100  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 54084.5us
W20260709 13:02:45.815117  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.776928 11788 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.818305  8285 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:45.818764  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.818692  8286 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:45.766165 10841 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.766947 11700 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:45.823520  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:45.826341  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:45.824095  8332 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:45.825343  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:45.825977  8361 raft_consensus.cc:2376] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9. Re-sending same reply.
I20260709 13:02:45.794785 11734 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.813544 11484 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.795868 11620 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:02:45.843750  8216 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:45.969139  8892 raft_consensus.cc:2393] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:02:45.969767  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 144582us
I20260709 13:02:45.970647  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:45.964533  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.971925  8361 raft_consensus.cc:2368] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9.
I20260709 13:02:45.972293  8212 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:45.972990  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1768) took 3822 ms. Trace:
I20260709 13:02:45.942188  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:45.973624  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:45.973899  8367 rpcz_store.cc:276] 0709 13:02:42.150946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.847879 (+1696933us) service_pool.cc:224] Handling call
0709 13:02:43.852081 (+  4202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.073592 (+221511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.972781 (+1899189us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54001f6154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:45.972936 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434868480}
W20260709 13:02:45.974395  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 142540us
I20260709 13:02:45.975075  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:45.973656  8363 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:45.812547 11088 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 13:02:45.818670 11739 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.983059  8216 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:45.976475  8210 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:45.819958 11718 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:45.842628 11419 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:45.842027 11366 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:46.002652 11366 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:45.821770 11720 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:46.002962  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:46.003316 11720 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.977708  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.003568 11366 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.821933 11692 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:45.985931  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.021380  8361 raft_consensus.cc:2410] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:46.022356  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.023051  8361 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:45.983078  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 159144us
I20260709 13:02:46.023772  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.023933  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.025018  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.025776  8367 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:45.993700  8363 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:45.821277 11623 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:45.940546 11796 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:02:46.001930  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.024293  8361 raft_consensus.cc:2376] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8. Re-sending same reply.
I20260709 13:02:46.026921  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:45.908533  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 136181us
W20260709 13:02:46.027480  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.026937  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:45.978811  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:46.004484 11371 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.005600 11718 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.979599 11788 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.977011 11505 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:46.013610 11685 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.821530 11373 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 13:02:45.966841 11663 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:45.977792 11700 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:02:46.027071  8210 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:46.028039  8363 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:46.028786  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.030055  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.031724  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.032068  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:46.032828 11366 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:46.035269  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 221045us
I20260709 13:02:45.828159 11589 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.002148 11484 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:45.910846 11791 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.981603 11798 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:45.978765 11724 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:45.978595 11734 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:45.978950 11783 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:02:46.000989 11739 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.038296  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:46.107002  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.116282  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:46.037739  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:46.095562  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:46.160231  8258 leader_election.cc:336] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.874s (SENT)
W20260709 13:02:46.113862  8898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 811) took 1603 ms (client timeout 1572 ms). Trace:
W20260709 13:02:46.160987  8898 rpcz_store.cc:269] 0709 13:02:44.510255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.510437 (+   182us) service_pool.cc:224] Handling call
0709 13:02:46.113685 (+1603248us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b540031f454. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.113792 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35086592}
I20260709 13:02:46.118445  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 662) took 1951 ms. Trace:
I20260709 13:02:46.160441  8216 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:46.158576  8365 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:46.111797  8364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 665) took 1942 ms (client timeout 2130 ms). Trace:
W20260709 13:02:46.163262  8364 rpcz_store.cc:269] 0709 13:02:44.169800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.481280 (+311480us) service_pool.cc:224] Handling call
0709 13:02:46.111617 (+1630337us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b540043c454. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.111735 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497703296}
I20260709 13:02:46.164456  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.165092  8364 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:46.051710  8359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2223) took 2057 ms (client timeout 1530 ms). Trace:
I20260709 13:02:46.119446 11773 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.144675 11553 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.167795 11773 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.143249 11719 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:46.170321  8891 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.171223  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:46.114483  8895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 808) took 1625 ms (client timeout 1503 ms). Trace:
W20260709 13:02:46.172539  8895 rpcz_store.cc:269] 0709 13:02:44.488673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.488764 (+    91us) service_pool.cc:224] Handling call
0709 13:02:46.114312 (+1625548us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54007454d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.114425 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723018112}
I20260709 13:02:46.052227  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1774) took 3899 ms. Trace:
I20260709 13:02:46.155177  8361 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:46.038585  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.174963  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.162365  8366 rpcz_store.cc:276] 0709 13:02:44.167514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.129249 (+961735us) service_pool.cc:224] Handling call
0709 13:02:46.118246 (+988997us) spinlock_profiling.cc:243] Waited 87.2 ms on lock 0x7b5400050d54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.118384 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200646912}
I20260709 13:02:46.175886  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:46.177855  8331 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:46.178049  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.179903  8898 raft_consensus.cc:2368] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:46.180335  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 816) took 1523 ms. Trace:
I20260709 13:02:46.180677  8898 rpcz_store.cc:276] 0709 13:02:44.673177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.177712 (+1504535us) service_pool.cc:224] Handling call
0709 13:02:46.180282 (+  2570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.141050 11582 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.182523  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:46.183738  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.154098 11484 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:46.184305  8892 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.186734  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 794) took 2125 ms. Trace:
I20260709 13:02:46.187112  8218 rpcz_store.cc:276] 0709 13:02:44.060932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.061099 (+   167us) service_pool.cc:224] Handling call
0709 13:02:44.061410 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.338171 (+276761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.186504 (+1848333us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400057dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:46.186673 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601501440}
I20260709 13:02:46.187983 11722 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.145107 11137 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.107021 11660 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.190708 11660 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.192709 11660 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:46.166939  8359 rpcz_store.cc:269] 0709 13:02:43.994056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.035097 (+ 41041us) service_pool.cc:224] Handling call
0709 13:02:46.051524 (+2016427us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003174d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.051639 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3356533120}
I20260709 13:02:46.194350 11627 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:46.194772 11627 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:46.195086 11627 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:46.195621 11794 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:02:46.119241 11792 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.197340 11792 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.036747 11718 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.199433 11792 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:46.199807  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 941) took 2614 ms. Trace:
I20260709 13:02:46.200722 11782 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.171188 11798 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.169957 11773 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:46.202096  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.036146 11623 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:46.202729  8893 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:46.203236 11798 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.204282 11137 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.204767 11137 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.200209 11718 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.200186  8890 rpcz_store.cc:276] 0709 13:02:43.585278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.618177 (+ 32899us) service_pool.cc:224] Handling call
0709 13:02:44.059524 (+441347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.105844 (+ 46320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.199613 (+2093769us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54003a34d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.199736 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967641472}
I20260709 13:02:46.207412 11484 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.207801  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.207891 11137 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.208366  8890 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.186023  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.209715  8361 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:46.203251 11623 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.210808 11635 raft_consensus.cc:3055] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:46.212363 11739 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.213694 11734 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:46.217185  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.219906  8331 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.173557  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.221127  8895 raft_consensus.cc:2376] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9. Re-sending same reply.
I20260709 13:02:46.219980  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.222508  8331 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.222985  8366 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 4.
I20260709 13:02:46.223739  8331 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.181596  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.224680  8285 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:46.220443  8359 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:46.225476  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.230760  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2225) took 2032 ms. Trace:
I20260709 13:02:46.231168  8359 rpcz_store.cc:276] 0709 13:02:44.198747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.193750 (+1995003us) service_pool.cc:224] Handling call
0709 13:02:46.220276 (+ 26526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.230537 (+ 10261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.230705 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.210979  8361 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:46.173533  8360 rpcz_store.cc:276] 0709 13:02:42.152715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.849003 (+1696288us) service_pool.cc:224] Handling call
0709 13:02:43.849287 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.176050 (+326763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.052004 (+1875954us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540043ba54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:46.052172 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743242624}
I20260709 13:02:46.243507  8363 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:46.247752  8893 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:46.248768  8891 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:46.249141  8362 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:46.250744  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.250813  8331 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.251453  8285 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:46.250005  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2226) took 2028 ms. Trace:
I20260709 13:02:46.252799  8361 rpcz_store.cc:276] 0709 13:02:44.221298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.210382 (+1989084us) service_pool.cc:224] Handling call
0709 13:02:46.210672 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.249769 (+ 39097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.249952 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.123476 11788 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:02:46.256201  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:46.259162  8365 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:46.255928  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.259977  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 666) took 1279 ms. Trace:
I20260709 13:02:46.260947  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.261502  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.261634  8285 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
W20260709 13:02:46.258018  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 97866.6us
I20260709 13:02:46.262494 11660 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.034970 11371 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.260530  8365 rpcz_store.cc:276] 0709 13:02:44.981074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.231072 (+1249998us) service_pool.cc:224] Handling call
0709 13:02:46.259006 (+ 27934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.259780 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.259931 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4864}
W20260709 13:02:46.262737  8258 leader_election.cc:336] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.878s (SENT)
I20260709 13:02:46.258131 11724 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:02:46.263345  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.263427  8290 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:46.264297  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.264576 11371 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.258390  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.206992 11398 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:46.266400  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.255928  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.258307  8358 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:46.268679  8286 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:46.270179  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.270211  8896 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:46.256790  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.262894  8361 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:46.269791  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1778) took 3453 ms. Trace:
W20260709 13:02:46.272342  8258 leader_election.cc:336] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.500s (SENT)
I20260709 13:02:46.271926  8358 rpcz_store.cc:276] 0709 13:02:42.816141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.145047 (+1328906us) service_pool.cc:224] Handling call
0709 13:02:46.257960 (+2112913us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:02:46.258143 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.269545 (+ 11402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.269739 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14163840}
I20260709 13:02:46.033303 11793 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:46.267552  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.273770  8285 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:46.273931  8893 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:46.277575  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.279630  8258 leader_election.cc:400] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:46.282922  8893 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:46.275360  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.277961  8183 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:46.248481 11553 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:46.288293  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.286805  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.292143  8896 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:46.292356  8893 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:46.292654  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 817) took 1417 ms. Trace:
I20260709 13:02:46.254279 11792 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.254477 11593 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.285233  8895 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:46.221946 11773 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.036477 11505 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:46.214505 11635 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:46.290417  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:46.293097  8896 rpcz_store.cc:276] 0709 13:02:44.875388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.288062 (+1412674us) service_pool.cc:224] Handling call
0709 13:02:46.292600 (+  4538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.289074  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:46.287917  8359 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:46.288478  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.268754 11783 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.285432  8892 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:46.298561  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 830) took 1385 ms. Trace:
I20260709 13:02:46.324414  8895 rpcz_store.cc:276] 0709 13:02:44.913430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.256594 (+1343164us) service_pool.cc:224] Handling call
0709 13:02:46.298507 (+ 41913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.287158  8364 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:46.324872  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.301134  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.325555  8366 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:46.302204  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:46.326684  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 187825us
I20260709 13:02:46.326848  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.307826 11663 consensus_queue.cc:1059] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:46.308928 11635 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.293789 11088 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:46.311352  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.310243 11687 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:46.285176 11734 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:46.322558  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.323413  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.300705  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.307570 11774 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:02:46.327711  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:46.335701  8893 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 6: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:46.331496  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.336251  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.335376  8216 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:46.321954  8184 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.293629 11398 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.339843  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.292750 11660 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:02:46.288985 11722 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:46.298048 11405 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.322011  8863 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.333284  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.350654  8364 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:46.321046 11792 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.351526  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.345767  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:46.352327  8364 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:02:46.331590 11694 consensus_meta.cc:287] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 13:02:46.346050 11371 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.343799  8365 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:46.340826  8293 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:46.328661 11383 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:46.328915 10841 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:46.328693  8892 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:46.346848  8216 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:46.356338 11419 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:46.332429 11373 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:46.348100  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.353966  8863 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:46.332623 11798 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.332500 11088 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.374037  8863 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:46.375293  8863 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:46.337001  8864 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.355765  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.305650 11505 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.358367  8897 raft_consensus.cc:2368] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8.
I20260709 13:02:46.356215  8259 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.362118  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.379180  8863 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:46.362288  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.380208  8293 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:46.362216  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:46.382418  8184 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:46.383652  8184 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:46.386168  8184 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.364495  8892 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:46.343762 11719 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:46.365924 11774 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.395681 11589 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:46.396306 11812 log.cc:927] Time spent T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:46.398481  8291 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:46.399209 11720 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.379266 11088 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.401175  8291 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:46.345384 11734 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.352478 11635 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.335228 11782 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:02:46.354550 11405 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.367800  8898 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:46.356832 11792 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.347525  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.377514  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.335500 11788 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:02:46.379134  8367 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:46.409363  8364 raft_consensus.cc:2393] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:46.409703  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.410387  8367 raft_consensus.cc:2368] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9.
I20260709 13:02:46.410328  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.354842 11581 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.388898  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 820) took 1481 ms. Trace:
I20260709 13:02:46.411118  8364 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
W20260709 13:02:46.389505  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.389786  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 52885.2us
I20260709 13:02:46.379832  8292 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:46.394151 11620 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:46.331876 11783 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.360023 11807 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:46.420969  8890 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:46.390733 11398 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:46.366353 10841 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.361990 11687 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.412021  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.426151  8364 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
W20260709 13:02:46.411890  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 64480.9us
I20260709 13:02:46.427187  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.409256 11793 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:46.428234  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.411374  8892 rpcz_store.cc:276] 0709 13:02:44.907031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.364013 (+1456982us) service_pool.cc:224] Handling call
0709 13:02:46.364325 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.388626 (+ 24301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.388835 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.360575 11383 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:46.428921 10841 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.402992  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.387916 11582 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:46.435751 11582 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.436153 11582 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:46.416108 11791 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:46.438540 11791 raft_consensus.cc:697] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:46.439721  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.439473 11791 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.440344  8358 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 4.
I20260709 13:02:46.441221  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.441717  8358 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:46.442170 11760 consensus_queue.cc:1059] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:46.443053 11484 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.443709  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.444710  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.423377  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.469246 11405 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.364537 11419 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.469822  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.470647  8367 raft_consensus.cc:2410] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:46.471410  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.472225  8367 raft_consensus.cc:2410] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:46.472891  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.402709 11700 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.424031  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.474874  8292 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:46.402648 11623 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:46.475777 11623 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.422633  8893 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:46.420795 11807 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:46.449383 11687 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:46.477032 11807 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.478317 11807 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.462699  8890 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:02:46.479221  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 823) took 1567 ms. Trace:
I20260709 13:02:46.479564  8890 rpcz_store.cc:276] 0709 13:02:44.911808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.422341 (+1510533us) service_pool.cc:224] Handling call
0709 13:02:46.462438 (+ 40097us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:46.478972 (+ 16534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.479167 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.416373 11719 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:46.414218 11724 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:46.430296  8892 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:46.425895 11740 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:02:46.431469 11809 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:46.482302  8289 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
W20260709 13:02:46.500857  8897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 812) took 1971 ms (client timeout 1874 ms). Trace:
I20260709 13:02:46.432267  8889 raft_consensus.cc:1240] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 8. Ops: []
I20260709 13:02:46.416929  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:46.503192  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 86366.2us
I20260709 13:02:46.476150 11623 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:46.507923  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.508666  8363 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:46.510277  8360 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:46.447944  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 948) took 1329 ms. Trace:
I20260709 13:02:46.511868  8891 rpcz_store.cc:276] 0709 13:02:45.118890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.768975 (+650085us) service_pool.cc:224] Handling call
0709 13:02:46.447791 (+678816us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400719654. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.447892 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820775168}
I20260709 13:02:46.449127  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.513329  8362 raft_consensus.cc:2410] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:46.449455 11792 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.452924 10841 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.428601 11524 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:02:46.455616  8287 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:46.460486 11509 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:46.424917 11663 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:02:46.462750 11802 raft_consensus.cc:3055] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:46.463678 11088 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.468281 11383 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.395704 11694 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:46.408778 11692 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.472790  8862 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:46.483667  8358 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:46.567234  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 94587.3us
W20260709 13:02:46.484257  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 56114.6us
I20260709 13:02:46.568491  8332 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.568594  8358 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:46.569172  8862 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:46.482833  8364 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:46.406569 11711 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:46.461092 11371 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.490720  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 824) took 1578 ms. Trace:
I20260709 13:02:46.570398  8862 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.475518 11783 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.504938  8864 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.445024 11484 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.503187  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 825) took 1590 ms. Trace:
W20260709 13:02:46.501368  8897 rpcz_store.cc:269] 0709 13:02:44.529140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.529273 (+   133us) service_pool.cc:224] Handling call
0709 13:02:46.500624 (+1971351us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400678c54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.500774 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4164860800}
I20260709 13:02:46.457540 11627 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.516810  8363 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:02:46.518801  8360 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:46.520846 11724 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:02:46.531443  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.525867  8259 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.583168  8362 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:46.462489  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:46.498106 11584 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:46.586699 11584 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:46.504113 11809 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.587303 11809 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.587568 11584 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.577041 11581 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.589396 11582 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.517221 11398 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:46.535442 11774 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:02:46.590255 11398 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.590651 11398 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.591248 10841 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.548839 11620 raft_consensus.cc:697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:46.592512 11620 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.547180  8891 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 13:02:46.594255 11783 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:46.594601  8891 pending_rounds.cc:85] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 8
W20260709 13:02:46.553915  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.594724 11783 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.595152 11783 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.596179 11088 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:46.484169  8367 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:46.567541  8214 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:46.598778 11711 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:46.599768 11711 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.602311 11692 consensus_queue.cc:1059] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:46.602792 11774 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:46.603246 11774 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:46.565618  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 138877us
I20260709 13:02:46.425105 11784 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:46.570930  8293 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:46.532333 11687 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:46.604305 11687 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:46.604044 11774 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.605397 11774 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.605160 11687 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.504771 11739 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:02:46.606389 11687 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.569904 11768 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:46.575383  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 70547us
I20260709 13:02:46.608352  8864 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.608671  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:46.609485  8864 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.570087  8358 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:46.610227 11581 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:46.529863  8366 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:46.570763  8892 rpcz_store.cc:276] 0709 13:02:44.912064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.429747 (+1517683us) service_pool.cc:224] Handling call
0709 13:02:46.430065 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.490438 (+ 60373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.490666 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.578480  8363 pending_rounds.cc:85] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 4
I20260709 13:02:46.577562  8889 rpcz_store.cc:276] 0709 13:02:44.912291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.431644 (+1519353us) service_pool.cc:224] Handling call
0709 13:02:46.432080 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.502892 (+ 70812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.503127 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:46.580222  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.583622  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 57870.9us
I20260709 13:02:46.611332  8363 pending_rounds.cc:107] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:02:46.611680  8363 raft_consensus.cc:2889] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:46.611682  8892 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:46.612334  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 834) took 1632 ms. Trace:
I20260709 13:02:46.577857  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.613077  8259 leader_election.cc:400] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9.
I20260709 13:02:46.548331 11802 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:46.604053 11784 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.614569 11802 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.615193 11784 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.502548 11700 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:46.615626  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.615840 11802 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.616133 11700 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.617220  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:46.617815  8292 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:46.591313 11627 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.618513 11627 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.618979 11627 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:46.620548  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.621019 11627 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.481894 11719 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.621410  8287 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:46.586155  8897 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:46.564596 11694 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:46.622340 11694 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.622479  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 831) took 1643 ms. Trace:
I20260709 13:02:46.522686 11793 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.622853  8897 rpcz_store.cc:276] 0709 13:02:44.979086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.578398 (+1599312us) service_pool.cc:224] Handling call
0709 13:02:46.585900 (+  7502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.622214 (+ 36314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.622427 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.616632  8290 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:46.610421 11768 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:46.624897 11768 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.625299 11768 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.625964  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.612637  8892 rpcz_store.cc:276] 0709 13:02:44.980033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.611071 (+1631038us) service_pool.cc:224] Handling call
0709 13:02:46.611351 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.612124 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.612285 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.626262  8184 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.620113  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.596199  8891 pending_rounds.cc:107] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:02:46.627303  8892 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:46.604012 11692 raft_consensus.cc:3055] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:46.628031  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 947) took 1509 ms. Trace:
I20260709 13:02:46.628433  8259 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.626590  8363 raft_consensus.cc:2376] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6. Re-sending same reply.
W20260709 13:02:46.631263  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 168940us
I20260709 13:02:46.632023  8892 rpcz_store.cc:276] 0709 13:02:45.118666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.626746 (+1508080us) service_pool.cc:224] Handling call
0709 13:02:46.627008 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.627799 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.627978 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.627435  8891 raft_consensus.cc:2889] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:46.633225  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:46.633504  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 829) took 1720 ms. Trace:
I20260709 13:02:46.633864  8891 rpcz_store.cc:276] 0709 13:02:44.913198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.522269 (+1609071us) service_pool.cc:224] Handling call
0709 13:02:46.543068 (+ 20799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.633294 (+ 90226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.633453 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.634850  8891 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:46.635443  8332 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:46.632061  8183 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.628868  8864 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.629142  8862 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.629753  8360 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:46.649441  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 951) took 1515 ms. Trace:
I20260709 13:02:46.650461  8891 rpcz_store.cc:276] 0709 13:02:45.128755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.634405 (+1505650us) service_pool.cc:224] Handling call
0709 13:02:46.634611 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.635054 (+   443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.642896 (+  7842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.644129  8259 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.645718  8258 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:46.643764  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.626284 11383 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.646785  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.654229  8367 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:46.583707 11798 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:46.618683 11734 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.644893 11660 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.656139  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.668483  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:46.668756  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:46.631198 11692 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:46.656605 11581 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.652321  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:46.657629  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 47747.1us
I20260709 13:02:46.663635 11758 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.665344  8367 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:46.625870 11814 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:46.645394 11792 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:46.659884 11775 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:46.649693 11371 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.645120 11663 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:46.649428 11699 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:46.641580 11589 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:46.674396  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:46.682648  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.681447  8367 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:02:46.685348  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.654531 11627 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:46.657300 11798 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.666983 11718 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:46.664435 11690 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:46.730265 11635 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.657445 11819 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:46.709846  8259 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.671694 11582 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:46.677239 11685 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:46.677237 11698 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.739512  8213 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:46.651701 11398 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.657516 10841 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 13:02:46.733249  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 95733.6us
I20260709 13:02:46.737286 11371 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.738763 11699 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.684405 11510 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:02:46.681367 11581 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:46.747015  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 64479.1us
I20260709 13:02:46.737282 11660 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:02:46.733130 11593 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.748338 11819 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:46.752276 11685 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.754477  8862 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:46.732856 11775 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:46.679505 11824 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:46.739022 11720 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.682271 11739 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:02:46.682066 11777 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:02:46.692962 11405 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:02:46.685815 11137 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.743180 11798 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.746565  8259 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.745488 11690 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.734906 11450 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:46.801766  8889 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:46.730261 11735 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:02:46.743330 11718 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:46.744856 11792 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:46.752741 11553 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.751880 11731 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:46.792871  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:46.776618 11371 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.788897 11699 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.828615  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 826) took 1916 ms. Trace:
I20260709 13:02:46.801776 11687 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:02:46.830989  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 149487us
W20260709 13:02:46.831916  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.885833  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.837122  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.824266 11824 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:46.810983 11825 log.cc:927] Time spent T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:02:46.856535  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 110119us
W20260709 13:02:46.840631  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 86288us
I20260709 13:02:46.809633 11593 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.752321 11635 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:46.863865  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 71137.8us
I20260709 13:02:46.744340 11589 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:46.864647  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.839972 11373 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:02:46.871685  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 194241us
I20260709 13:02:46.813607 11819 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.873939 11484 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.838819 11720 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.830706  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 961) took 1069 ms. Trace:
I20260709 13:02:46.931649  8898 rpcz_store.cc:276] 0709 13:02:45.761533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.181351 (+419818us) service_pool.cc:224] Handling call
0709 13:02:46.830496 (+649145us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400501ed4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:46.830626 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329097600}
I20260709 13:02:46.871562  8331 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:46.872941  8890 rpcz_store.cc:276] 0709 13:02:44.912535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.480353 (+1567818us) service_pool.cc:224] Handling call
0709 13:02:46.480741 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.481082 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.481107 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.481585 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.641848 (+160263us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:46.802016 (+160168us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.828290 (+ 26274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.828371 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.828419 (+    48us) raft_consensus.cc:1685] finished
0709 13:02:46.828430 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.828551 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27149,"prepare.queue_time_us":223477,"raft.queue_time_us":64661,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":10881,"thread_start_us":294509,"threads_started":2,"wal-append.queue_time_us":177179}
W20260709 13:02:46.880664  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.681945 11722 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:46.681703 11814 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.839574 11788 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.827354 11685 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:46.887488  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.951339  8895 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.871948 11791 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:02:46.859011 11626 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.859105 11690 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.861321 11718 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.863299 11553 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.782034 11505 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.863482 11731 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.783910 11698 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:46.932863  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 61408us
I20260709 13:02:46.858124 11137 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.808853 11692 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.897522 11824 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.924631 11593 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.987669  8212 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:46.948630  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:46.988390  8890 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:46.886365  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.955888  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.933315 11484 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.939157 11722 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.958796 11626 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.980809  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:46.976239  8895 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:46.948253 11814 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.986603  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:46.923455 11775 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:46.962132 11833 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.003801  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:47.004390  8288 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.998795  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:47.005947  8895 raft_consensus.cc:2376] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9. Re-sending same reply.
I20260709 13:02:46.964788 11553 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.980222 11731 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:46.998032 11820 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:02:46.992045 11660 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:46.996217 11620 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.999666 11722 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.994731 11484 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:46.996189  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.022509 11589 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:47.023167 11589 consensus_queue.cc:1059] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:47.024556  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:47.025317 11828 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:02:46.976042 11845 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:02:47.030328 11829 log.cc:927] Time spent T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:02:47.029771 11814 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:47.031664 11827 log.cc:927] Time spent T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:47.012575 11833 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:47.033082 11814 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:47.033928 11814 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:47.034761 11833 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:47.036571 11620 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:47.001657 11626 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.049708 11814 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:47.058463 11581 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:47.047672 10841 consensus_queue.cc:1059] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:02:47.058254 11814 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:47.060562 11806 log.cc:927] Time spent T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
I20260709 13:02:47.061524 11814 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:47.063793  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:47.025328  8898 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:47.064208  8288 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:47.054446  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:47.048153  8364 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:02:47.088608  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.075282  8890 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:47.115182  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:47.116679  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:47.117576  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 186765us
W20260709 13:02:47.058208 11821 log.cc:927] Time spent T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.263s	user 0.000s	sys 0.002s
I20260709 13:02:47.123245  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:47.123955  8898 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:46.999572 11692 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:47.011792 11837 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.036979 11809 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:47.047927 11842 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:47.007462 11627 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:02:46.982304 11792 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:47.039104 11620 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:47.123610 11833 raft_consensus.cc:3055] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:47.127012  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:47.186049  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 949) took 2066 ms. Trace:
I20260709 13:02:47.070473 11791 raft_consensus.cc:3055] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:47.054311 11698 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:47.057340 11660 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:47.211113  8358 raft_consensus.cc:2368] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9.
I20260709 13:02:47.051257 11720 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:47.189107  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 269803us
W20260709 13:02:47.190639  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 62185.1us
I20260709 13:02:47.063036 11398 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:47.052718 11137 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:47.112572 11623 consensus_meta.cc:287] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.584s	user 0.004s	sys 0.005s
I20260709 13:02:47.217635  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:47.200941  8892 rpcz_store.cc:276] 0709 13:02:45.119124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.632933 (+1513809us) service_pool.cc:224] Handling call
0709 13:02:46.633192 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.633384 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:46.809225 (+175841us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.185481 (+376256us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.185690 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:47.185736 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:47.185784 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.185850 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.185993 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40296,"prepare.queue_time_us":222564,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":127787,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":9814,"thread_start_us":456218,"threads_started":3,"wal-append.queue_time_us":233488}
I20260709 13:02:47.206568  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:47.132244 11366 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:02:47.283525  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 66013.9us
I20260709 13:02:47.275857  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:47.285239  8892 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.128654 11699 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:47.199760 11833 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:47.126935 11694 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:47.300922  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:47.200431 11835 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.204231 11791 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:47.306303  8890 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:47.188061 11774 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:02:47.308682  8292 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:02:47.309876  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1801) took 1048 ms. Trace:
I20260709 13:02:47.312121  8365 rpcz_store.cc:276] 0709 13:02:46.261817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.264055 (+  2238us) service_pool.cc:224] Handling call
0709 13:02:47.309694 (+1045639us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b54000672d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:47.309819 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181506944}
W20260709 13:02:47.313656  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.313825  8892 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
W20260709 13:02:47.315066  8330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.023s	sys 0.052s
W20260709 13:02:47.315490  8330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.023s	sys 0.052s
I20260709 13:02:47.315889  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:47.203796 11793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.008s	sys 0.031s
I20260709 13:02:47.282979 11836 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.324780 11836 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:47.301412 11841 log.cc:927] Time spent T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:02:47.314879  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:47.291116 11137 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:47.325698  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:48.155222 11505 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.211534 10841 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.212625 10841 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.216421  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 821) took 3308 ms. Trace:
I20260709 13:02:48.220603 11694 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.221305  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:48.224332  8358 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1810) took 1604 ms (client timeout 2042 ms). Trace:
I20260709 13:02:48.227301 11699 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.228246  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:48.233193  8257 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.513s (SENT) [suppressed 26 similar messages]
I20260709 13:02:48.235401 11809 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.235882  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:48.237102  8216 raft_consensus.cc:2410] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:48.224388 11660 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:47.316547  8890 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.352342  8891 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:47.326673  8892 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:48.290871  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 847) took 1002 ms. Trace:
W20260709 13:02:48.291131 11371 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.396s	user 0.015s	sys 0.008s
I20260709 13:02:48.009917  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:48.291519  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.291711 11371 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:47.992745  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:48.294615  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 839) took 1003 ms. Trace:
I20260709 13:02:48.295024  8292 rpcz_store.cc:276] 0709 13:02:47.291610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.991848 (+700238us) service_pool.cc:224] Handling call
0709 13:02:48.294532 (+302684us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:48.018827  8333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.005s	sys 0.001s
W20260709 13:02:47.931174  8183 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.014s	sys 0.012s
W20260709 13:02:48.295910 11593 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 1.292s	user 0.014s	sys 0.000s
I20260709 13:02:48.030107  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:48.061667  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:48.291280  8892 rpcz_store.cc:276] 0709 13:02:47.288009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.314617 (+ 26608us) service_pool.cc:224] Handling call
0709 13:02:48.290614 (+975997us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:48.297082 11758 consensus_meta.cc:287] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.613s	user 0.018s	sys 0.008s
W20260709 13:02:48.297716  8333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.011s	sys 0.005s
I20260709 13:02:48.298028  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:48.298274  8293 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:48.298913  8892 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:48.299122 11856 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.299350  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 838) took 1363 ms. Trace:
I20260709 13:02:47.292387 11635 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:47.317183 11663 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.002s	sys 0.022s
I20260709 13:02:48.006966  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2407) took 1676 ms. Trace:
W20260709 13:02:47.950614  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.924654  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.015059  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.504601 11791 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:47.326501 11793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.008s	sys 0.032s
I20260709 13:02:47.499900 11833 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.332417 11774 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:48.333369 11833 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:48.333295 11849 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.334054  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2246) took 1639 ms. Trace:
I20260709 13:02:48.334378 11849 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.307731  8291 rpcz_store.cc:276] 0709 13:02:46.330476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.401925 (+ 71449us) service_pool.cc:224] Handling call
0709 13:02:46.406217 (+  4292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:46.413062 (+  6845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.413097 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:46.413820 (+   723us) log.cc:844] Serialized 52 byte log entry
0709 13:02:46.556435 (+142615us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:46.556559 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.556814 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.327299 (+770485us) raft_consensus.cc:1685] finished
0709 13:02:48.006288 (+678989us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.006718 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8718,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5149,"thread_start_us":86475,"threads_started":1,"wal-append.queue_time_us":244972}
I20260709 13:02:48.336421  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:48.337224 11849 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.337781 11849 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.339038 11849 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.341871 11849 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.343386  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:48.345090 11718 consensus_meta.cc:287] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.365s	user 0.008s	sys 0.017s
I20260709 13:02:47.192431 11837 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.348009 11837 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:47.198812 11842 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.351202 11842 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:47.468338 11853 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:48.352463 11853 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:48.332448 11826 log.cc:927] Time spent T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.400s	user 0.015s	sys 0.014s
I20260709 13:02:48.147060 11366 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:48.150276 11419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.008s	sys 0.002s
W20260709 13:02:48.155361 11846 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.719s	user 0.001s	sys 0.008s
W20260709 13:02:48.156220 11847 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.846s	user 0.000s	sys 0.010s
W20260709 13:02:48.157016 11843 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.884s	user 0.010s	sys 0.000s
I20260709 13:02:48.158769 11711 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:48.160082 11839 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.161837 11724 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:48.162722 11783 consensus_meta.cc:287] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.567s	user 0.010s	sys 0.020s
I20260709 13:02:48.189062 11866 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.239104  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:48.225028  8358 rpcz_store.cc:269] 0709 13:02:46.619724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.620340 (+   616us) service_pool.cc:224] Handling call
0709 13:02:48.223723 (+1603383us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400050d54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:48.224018 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357120256}
I20260709 13:02:48.221751 11694 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.210253 11836 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.228384 11699 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.252067 11814 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.408309 11484 consensus_meta.cc:287] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 1.294s	user 0.007s	sys 0.007s
I20260709 13:02:48.407909 11724 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.408461 11814 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:48.241009 11807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.342s	user 0.001s	sys 0.022s
W20260709 13:02:48.410336 11807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.001s	sys 0.022s
I20260709 13:02:48.229830 11667 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:48.276204 11690 consensus_meta.cc:287] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 1.296s	user 0.010s	sys 0.002s
I20260709 13:02:48.277470 11835 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:48.278220 11373 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:48.411847  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.412293 11373 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.282472  8216 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:48.413118 11694 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.414500  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:48.289659  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1233) took 3112 ms. Trace:
W20260709 13:02:48.002454  8330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.000s	sys 0.004s
I20260709 13:02:48.319422 11593 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.415794 11835 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.416239  8890 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:48.299804  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 833) took 1359 ms. Trace:
I20260709 13:02:48.299789  8892 rpcz_store.cc:276] 0709 13:02:46.935526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.297617 (+1362091us) service_pool.cc:224] Handling call
0709 13:02:48.299272 (+  1655us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:48.296306  8183 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.391s	user 0.018s	sys 0.022s
I20260709 13:02:48.306495 11870 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.301906  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:48.273804 11582 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.297610 11137 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:48.216930  8896 rpcz_store.cc:276] 0709 13:02:44.907293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.391580 (+1484287us) service_pool.cc:224] Handling call
0709 13:02:46.391944 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.490648 (+ 98704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.490676 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.497816 (+  7140us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.653142 (+155326us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:46.739391 (+ 86249us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.882988 (+143597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.215462 (+1332474us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b54005154d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:48.215580 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.215648 (+    68us) raft_consensus.cc:1685] finished
0709 13:02:48.215792 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.216133 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13810,"prepare.queue_time_us":270649,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":86810,"spinlock_wait_cycles":235799168,"thread_start_us":320227,"threads_started":3,"wal-append.queue_time_us":140322,"wal-append.run_cpu_time_us":3281,"wal-append.run_wall_time_us":1525942}
I20260709 13:02:48.304874 11805 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.328263  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.300307 11871 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.300865 11858 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.331832 11854 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.351531 11626 consensus_meta.cc:287] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.305s	user 0.045s	sys 0.025s
I20260709 13:02:48.297619 11758 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:48.354207 11663 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.581s	user 0.002s	sys 0.038s
I20260709 13:02:48.345557 11718 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.299844 11856 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.348240 10841 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.324856 11660 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.348181 11768 consensus_meta.cc:287] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.722s	user 0.014s	sys 0.011s
I20260709 13:02:48.406565  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:48.406348 11366 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:48.388264 11419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.008s	sys 0.003s
I20260709 13:02:48.407366 11635 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:47.287004 11623 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.333256 11774 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.416869  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 967) took 1514 ms. Trace:
I20260709 13:02:48.362485  8360 rpcz_store.cc:276] 0709 13:02:46.629147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.650169 (+ 21022us) service_pool.cc:224] Handling call
0709 13:02:46.650497 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.650836 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.650862 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.833108 (+182246us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b2c000a2a58. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efab46a11 00007f2efab56372 00007f2efc288a01 00007f2efc24d43a 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2
0709 13:02:46.833531 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.985838 (+152307us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:46.985875 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.985937 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.243085 (+1257148us) raft_consensus.cc:1685] finished
0709 13:02:48.245433 (+  2348us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.268188 (+ 22755us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":4729,"spinlock_wait_cycles":5154688,"thread_start_us":151987,"threads_started":1,"wal-append.queue_time_us":485340}
I20260709 13:02:48.489470  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:48.489197  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:48.415215  8891 rpcz_store.cc:276] 0709 13:02:45.177414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.651199 (+1473785us) service_pool.cc:224] Handling call
0709 13:02:46.651445 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.286773 (+1635328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.289144 (+  2371us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54005fee54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:48.289471 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605291264}
I20260709 13:02:48.456668  8284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2197) took 1042 ms. Trace:
I20260709 13:02:48.388790 11371 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.483484  8359 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:48.437179  8330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.006s	sys 0.014s
I20260709 13:02:48.415546 11694 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.586699  8293 rpcz_store.cc:276] 0709 13:02:46.940716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.940850 (+   134us) service_pool.cc:224] Handling call
0709 13:02:46.941180 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.298722 (+1357542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.299532 (+   810us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400400e54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:48.299744 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3121752320}
W20260709 13:02:48.485461 11722 consensus_meta.cc:287] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.411s	user 0.010s	sys 0.002s
W20260709 13:02:48.500267 11798 consensus_meta.cc:287] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.637s	user 0.012s	sys 0.008s
I20260709 13:02:48.497025  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:48.611959  8890 rpcz_store.cc:276] 0709 13:02:46.901930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.315633 (+413703us) service_pool.cc:224] Handling call
0709 13:02:48.416743 (+1101110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:48.485954  8863 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:48.562245 11807 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.621783 11524 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:48.622532 11524 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.623189 11793 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.624055 11793 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.624305 11835 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.624843 11524 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:48.613739  8258 leader_election.cc:336] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.919s (SENT)
I20260709 13:02:48.575712 11849 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:48.491775 11593 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.554026 11837 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.484591 11824 consensus_meta.cc:287] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 1.484s	user 0.004s	sys 0.011s
W20260709 13:02:48.596398  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 363582us
I20260709 13:02:48.411890 11690 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.620862  8288 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:48.621524 11700 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:48.485106  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:48.480908 11589 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.576333 11814 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:48.501024 11867 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.612749  8284 rpcz_store.cc:276] 0709 13:02:47.214999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.215388 (+   389us) service_pool.cc:224] Handling call
0709 13:02:47.215730 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:47.216102 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.216128 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:47.291881 (+ 75753us) log.cc:844] Serialized 52 byte log entry
0709 13:02:48.069084 (+777203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:48.171857 (+102773us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.242476 (+ 70619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.247921 (+  5445us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.248200 (+   279us) raft_consensus.cc:1685] finished
0709 13:02:48.248267 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.256877 (+  8610us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":257292,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":41275,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":15931,"thread_start_us":131307,"threads_started":2,"wal-append.queue_time_us":910975}
I20260709 13:02:48.636087  8894 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:48.610970 11724 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:48.621992 11784 consensus_meta.cc:287] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.773s	user 0.015s	sys 0.009s
W20260709 13:02:48.654134  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 76268.8us
I20260709 13:02:48.610872 11635 consensus_queue.cc:1243] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:02:48.631983  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 1.72813e+06us
I20260709 13:02:48.634686  8365 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:48.636983  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 60852.5us
I20260709 13:02:48.641775 11837 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.662184  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:48.662328  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:48.663110  8358 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:48.663870 11837 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.642184 11849 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.664294  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:48.642768 11853 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.638957 11798 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.644397  8286 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 5: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:48.641806 11824 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.665109  8358 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.666735 11798 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.666956 11824 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.667411  8184 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:48.668068  8214 raft_consensus.cc:2410] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:48.645009 11623 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.647528 11774 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.639861 11700 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:48.670712 11824 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:48.671228 11824 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.671890 11824 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.671415 11700 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.672804 11700 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.660002 11784 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.676384  8897 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 8. Ops: []
I20260709 13:02:48.677335 11784 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:48.679726 11824 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.681665  8216 raft_consensus.cc:2410] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:02:48.683195  8258 leader_election.cc:336] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.963s (SENT)
I20260709 13:02:48.683720  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:48.683920 11824 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.647980 11690 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:48.662863  8360 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:48.481030 11711 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.651229  8292 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.601629 11663 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:48.637271  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:48.607105 11768 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.564129 11699 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.660104 11747 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.649912 11758 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.654415 11807 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.642196 11721 raft_consensus.cc:3055] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:48.408857 11484 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.688045  8291 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:48.650696  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:48.500581 11783 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.702741  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:48.481276 11866 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.607354 11626 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.704689  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:48.634361 11137 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.706923 11774 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:48.736819  8892 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:02:48.737068 11774 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.738443  8892 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:48.739351  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 955) took 2984 ms. Trace:
I20260709 13:02:48.739501 11774 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.740070 11774 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:48.740572 11774 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.741031  8287 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:48.741355 11783 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.742087  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 840) took 1796 ms. Trace:
I20260709 13:02:48.742440  8890 rpcz_store.cc:276] 0709 13:02:46.935982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.653141 (+1717159us) service_pool.cc:224] Handling call
0709 13:02:48.731932 (+ 78791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:48.660468 11835 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.715767  8184 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:48.632413 11722 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:48.706753 11685 consensus_meta.cc:287] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 1.745s	user 0.002s	sys 0.023s
W20260709 13:02:48.723752  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.630942 11660 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.640157 11805 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.727895  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2411) took 1720 ms. Trace:
W20260709 13:02:48.728518 11819 consensus_meta.cc:287] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 1.777s	user 0.007s	sys 0.017s
I20260709 13:02:48.729086  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:48.705420 11856 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.631125 11870 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.734550  8895 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:48.729004 11366 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:48.708765  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 69590.3us
I20260709 13:02:48.634164 11582 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.489622 11839 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.706799 11663 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.717366 11867 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.640561 11858 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.655992 11871 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:48.703001 11854 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.134663  8892 rpcz_store.cc:276] 0709 13:02:45.754659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.737749 (+2983090us) service_pool.cc:224] Handling call
0709 13:02:48.738234 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.738935 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.739143 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:49.014727  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.795363  8358 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
W20260709 13:02:48.801384 11731 consensus_meta.cc:287] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.713s	user 0.011s	sys 0.004s
I20260709 13:02:48.810931  8890 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:02:49.133178  8894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 832) took 4153 ms (client timeout 1500 ms). Trace:
I20260709 13:02:48.936007  8363 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:49.087754  8365 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 5.
I20260709 13:02:48.942338  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.092669  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 818) took 4192 ms. Trace:
I20260709 13:02:49.140353  8292 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
W20260709 13:02:49.109549  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 47278.1us
W20260709 13:02:49.152961  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 667576us
W20260709 13:02:48.864367  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 190640us
W20260709 13:02:48.809091  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.861508  8360 raft_consensus.cc:2368] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11.
I20260709 13:02:48.721453 11721 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:48.732287 11784 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.149202  8894 rpcz_store.cc:269] 0709 13:02:44.979379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.132299 (+152920us) service_pool.cc:224] Handling call
0709 13:02:49.132906 (+4000607us) spinlock_profiling.cc:243] Waited 3.4 s on lock 0x7b5400391cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.133079 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7813402880}
W20260709 13:02:49.158512  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.155640  8890 pending_rounds.cc:85] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 7
I20260709 13:02:48.742901 11774 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.161998 11879 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.162329 11824 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:49.159237  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 445754us
W20260709 13:02:48.801571 11692 consensus_meta.cc:287] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.509s	user 0.005s	sys 0.010s
I20260709 13:02:48.860981 11690 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.151491  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:49.161924  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:49.152374  8893 rpcz_store.cc:276] 0709 13:02:44.900545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.336499 (+1435954us) service_pool.cc:224] Handling call
0709 13:02:46.422450 (+ 85951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.476366 (+ 53916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.092192 (+2615826us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b54004a15d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.092467 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196908416}
I20260709 13:02:48.804582 11718 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:49.094740 11869 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:48.734066 11837 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:48.734037 11371 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:48.907934 11553 consensus_meta.cc:287] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 1.615s	user 0.012s	sys 0.004s
I20260709 13:02:49.187166 11879 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.193578 11553 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.194269  8893 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:49.194733 11805 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.194983  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 963) took 2979 ms. Trace:
I20260709 13:02:49.151250 11685 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:48.888343 11699 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:49.195781 11553 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.726507 11747 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.198104 11685 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:49.128785 11838 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.856379 11383 consensus_meta.cc:287] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 1.951s	user 0.007s	sys 0.018s
I20260709 13:02:49.167521 11484 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:49.183059 11711 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.891687 11137 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:48.814970 11793 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.164443  8890 pending_rounds.cc:107] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:02:49.214323  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.187466  8358 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.807861 11866 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:48.803292 11740 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.190346  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:48.720677 11589 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.195370  8893 rpcz_store.cc:276] 0709 13:02:46.215391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.187647 (+2972256us) service_pool.cc:224] Handling call
0709 13:02:49.193859 (+  6212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.194694 (+   835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.194897 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.191743  8367 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:49.177671 11824 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:48.805687 11758 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.159315 11731 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.214262  8890 raft_consensus.cc:2889] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:49.155226  8290 rpcz_store.cc:276] 0709 13:02:46.990468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.991116 (+   648us) service_pool.cc:224] Handling call
0709 13:02:47.007956 (+ 16840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.008185 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.008209 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.294869 (+1286660us) spinlock_profiling.cc:243] Waited 990 us on lock 0x7b2c00084bd8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efab46a11 00007f2efab56372 00007f2efc288a01 00007f2efc24d43a 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2
0709 13:02:48.295515 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.564123 (+268608us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:48.564156 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.574570 (+ 10414us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.690678 (+116108us) raft_consensus.cc:1685] finished
0709 13:02:48.690698 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.710333 (+ 19635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2278144,"thread_start_us":268145,"threads_started":1,"wal-append.queue_time_us":357150}
I20260709 13:02:49.165637 11819 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.211123  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:49.198876 11836 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.219347  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:49.225833  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 77228.3us
I20260709 13:02:49.190996 11784 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.230182 11371 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:49.230703 11722 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.230400 11721 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.230958 11887 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:49.234149  8257 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.234905  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.237429  8892 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:49.220360 11775 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.236958  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.203850 11690 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.220495 11824 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:49.219089 11768 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:02:49.243009  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 960) took 3483 ms. Trace:
I20260709 13:02:49.225701 11836 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.242942  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.244000  8289 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:49.244370  8217 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:49.244735  8892 rpcz_store.cc:276] 0709 13:02:45.755913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.160919 (+3405006us) service_pool.cc:224] Handling call
0709 13:02:49.203114 (+ 42195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.239191 (+ 36077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.239350 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.231550 11721 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.253167 11783 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.246551 11740 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.253750 11783 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:49.254428  8259 leader_election.cc:336] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 2.042s (SENT)
I20260709 13:02:49.254880  8259 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.255236 11740 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.255853 11783 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.256407 11783 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:49.257302 11842 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:49.257954 11690 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:49.259197 11589 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.262945  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:49.265638 11881 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.643s	user 0.002s	sys 0.003s
I20260709 13:02:49.266656 11867 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.267460 11731 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.267858 11660 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.268522 11718 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:49.269229 11870 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:49.270318  8891 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:49.270951  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 954) took 3745 ms. Trace:
I20260709 13:02:49.236260 11849 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:49.272590  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.273600 11819 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.274207  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.259883 11854 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:49.271250  8891 rpcz_store.cc:276] 0709 13:02:45.525109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.269435 (+3744326us) service_pool.cc:224] Handling call
0709 13:02:49.269830 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.270690 (+   860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.270888 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.268000  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.229246 11582 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.276598  8358 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:49.275156  8890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 956) took 3491 ms. Trace:
I20260709 13:02:49.277207  8890 rpcz_store.cc:276] 0709 13:02:45.754956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.794636 (+3039680us) service_pool.cc:224] Handling call
0709 13:02:48.810492 (+ 15856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.246030 (+435538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.246775 (+   745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.277576  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.240605 11593 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.268224 11731 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.282879  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.283512  8211 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.283267  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2244) took 2643 ms. Trace:
I20260709 13:02:49.287225  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2327) took 1003 ms. Trace:
I20260709 13:02:49.287601  8216 rpcz_store.cc:276] 0709 13:02:48.284155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.414173 (+130018us) service_pool.cc:224] Handling call
0709 13:02:49.287042 (+872869us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400195854. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.287167 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612780288}
I20260709 13:02:49.288718  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.216240 11838 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.239059 11371 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:49.286830  8364 rpcz_store.cc:276] 0709 13:02:46.628637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.630006 (+  1369us) service_pool.cc:224] Handling call
0709 13:02:46.630292 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.066504 (+436212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.272023 (+2205519us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54000c5654. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.272273 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960947968}
I20260709 13:02:49.290017  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.245729 11692 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:49.304966  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.296949  8365 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:49.310272  8184 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:49.312856  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.314412  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1734) took 1089 ms. Trace:
I20260709 13:02:49.314133  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.314764  8217 rpcz_store.cc:276] 0709 13:02:48.220448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.220717 (+   269us) service_pool.cc:224] Handling call
0709 13:02:49.309131 (+1088414us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000ed8d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.309279 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345630080}
I20260709 13:02:49.231571 11887 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.316609  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1239) took 3281 ms. Trace:
I20260709 13:02:49.315233  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:49.318996  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.319428  8358 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:49.318053  8894 rpcz_store.cc:276] 0709 13:02:46.031350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.167975 (+3136625us) service_pool.cc:224] Handling call
0709 13:02:49.213288 (+ 45313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.293998 (+ 80710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.294029 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.294095 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:49.312178 (+ 18083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.312244 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.312339 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:49.323350  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 55496.1us
I20260709 13:02:49.331899 11839 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.311427 11731 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.328462  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:49.335342  8892 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.332799 11373 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:49.323172 11700 consensus_meta.cc:287] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 13:02:49.323522  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.333958  8210 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:49.320304 11819 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:49.337051  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.318596 11807 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.338712  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.337818 11722 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.320170 11593 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.349767  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.351351  8216 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:49.354965  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 172592us
I20260709 13:02:49.344286 11858 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:49.355870 11731 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:49.357138 11731 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.358035  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2196) took 2143 ms. Trace:
I20260709 13:02:49.358276 11836 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.360260  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.362169 11871 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.362284 11371 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.359542  8288 rpcz_store.cc:276] 0709 13:02:47.214659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.214780 (+   121us) service_pool.cc:224] Handling call
0709 13:02:47.298797 (+ 84017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.642639 (+1343842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.357759 (+715120us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400401854. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.357962 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3033421568}
I20260709 13:02:49.365162  8210 raft_consensus.cc:2410] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:49.339942 11747 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.366291  8211 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:49.350256  8183 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.351320 11819 raft_consensus.cc:697] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:49.370971  8212 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:49.371366  8358 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:49.362259 11839 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.368571  8217 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:49.371919  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.375048 11839 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.375228 11819 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.375936  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1249) took 1085 ms. Trace:
I20260709 13:02:49.376305  8895 rpcz_store.cc:276] 0709 13:02:48.307426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.342882 (+ 35456us) service_pool.cc:224] Handling call
0709 13:02:49.375754 (+1032872us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54003a34d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.375882 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888268544}
I20260709 13:02:49.373174  8359 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:49.380038  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.379776  8894 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:02:49.382568  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.387496  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.388046  8212 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.388520  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2250) took 1049 ms. Trace:
I20260709 13:02:49.390022  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.390695  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.392534  8895 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:49.389869  8358 rpcz_store.cc:276] 0709 13:02:48.338797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.374577 (+1035780us) service_pool.cc:224] Handling call
0709 13:02:49.388450 (+ 13873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.381322 11807 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:49.394356  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.390645 11758 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.381105 11777 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.379066 11838 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.395313  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:49.395439  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.396198  8863 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:49.401957  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.402609  8895 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:49.403522  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:49.403745 11887 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:49.404078 11758 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.396564 11807 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:49.399590  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 946) took 4281 ms. Trace:
I20260709 13:02:49.399693  8217 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:49.405961 11758 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:49.412377  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2328) took 1127 ms. Trace:
I20260709 13:02:49.412773  8217 rpcz_store.cc:276] 0709 13:02:48.284517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.399198 (+1114681us) service_pool.cc:224] Handling call
0709 13:02:49.399541 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.411793 (+ 12252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.412197 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.406196  8212 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:49.408207  8358 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:49.398382  8184 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:49.410565  8286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 832) took 2802 ms (client timeout 2087 ms). Trace:
I20260709 13:02:49.406147  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1732) took 1186 ms. Trace:
I20260709 13:02:49.411518  8889 rpcz_store.cc:276] 0709 13:02:45.118426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.624910 (+1506484us) service_pool.cc:224] Handling call
0709 13:02:46.625179 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.856245 (+231066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.399161 (+2542916us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400744ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.399443 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405872896}
I20260709 13:02:49.395679 11839 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:49.415887  8366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 679) took 2753 ms (client timeout 2948 ms). Trace:
I20260709 13:02:49.416014  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2326) took 1129 ms. Trace:
W20260709 13:02:49.414245  8286 rpcz_store.cc:269] 0709 13:02:46.608225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.608400 (+   175us) service_pool.cc:224] Handling call
0709 13:02:49.408147 (+2799747us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54000efe54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.410449 (+  2302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4681708416}
I20260709 13:02:49.414758  8218 rpcz_store.cc:276] 0709 13:02:48.219434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.250626 (+ 31192us) service_pool.cc:224] Handling call
0709 13:02:48.278839 (+ 28213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.389275 (+110436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.389310 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.400716 (+ 11406us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:48.400772 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.405810 (+1005038us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b5400472cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.405857 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.405963 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184315776}
W20260709 13:02:49.416092  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 82244.7us
I20260709 13:02:49.414593  8894 raft_consensus.cc:2376] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9. Re-sending same reply.
I20260709 13:02:49.414333  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:49.418100  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:49.419046  8895 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:02:49.417053  8366 rpcz_store.cc:269] 0709 13:02:46.640703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.649903 (+  9200us) service_pool.cc:224] Handling call
0709 13:02:49.389169 (+2739266us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54001f6b54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.394185 (+  5016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4521627520}
I20260709 13:02:49.423722  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:49.413277 11807 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.425086 11700 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:49.429595  8218 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:49.416326 11627 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:49.428571  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.417229  8213 rpcz_store.cc:276] 0709 13:02:48.283838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.645406 (+361568us) service_pool.cc:224] Handling call
0709 13:02:48.645788 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.646254 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:48.654130 (+  7876us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.939826 (+285696us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b18004c3720. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded23a 00007f2efc257a2a
0709 13:02:49.210042 (+270216us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.220069 (+ 10027us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.221560 (+  1491us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:49.221603 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.221671 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.409120 (+187449us) raft_consensus.cc:1685] finished
0709 13:02:49.412591 (+  3471us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.412711 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2343,"prepare.queue_time_us":10690,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":3844,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":4906,"spinlock_wait_cycles":18220928,"thread_start_us":267522,"threads_started":1,"wal-append.queue_time_us":648668}
I20260709 13:02:49.433820  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2412) took 2443 ms. Trace:
I20260709 13:02:49.421589 11838 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:49.423244 11731 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.434293  8889 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:02:49.438751  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 835) took 4458 ms. Trace:
I20260709 13:02:49.439416  8210 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:49.440086  8897 rpcz_store.cc:276] 0709 13:02:44.980274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.623586 (+1643312us) service_pool.cc:224] Handling call
0709 13:02:46.623867 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.676797 (+2052930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.430047 (+753250us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b540029d1d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.438698 (+  8651us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4721913728}
I20260709 13:02:49.410252 11721 consensus_queue.cc:1059] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:02:49.434885  8287 rpcz_store.cc:276] 0709 13:02:46.990742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.991188 (+   446us) service_pool.cc:224] Handling call
0709 13:02:46.991528 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.741408 (+1749880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.429761 (+688353us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400087fd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.433751 (+  3990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4024456064}
I20260709 13:02:49.430769 11834 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:49.438504  8183 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.448483  8184 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:49.429965 11700 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.446177  8894 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:49.416103 11777 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.466650  8211 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:49.467868 11777 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.468050  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:49.466670  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.471745  8358 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:49.471764  8218 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:49.473241  8892 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:49.447137  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2329) took 1159 ms. Trace:
I20260709 13:02:49.452386  8209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1731) took 1208 ms. Trace:
I20260709 13:02:49.438427 11627 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.463508  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1818) took 1158 ms. Trace:
I20260709 13:02:49.437211 11838 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:49.475965  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.473908  8209 rpcz_store.cc:276] 0709 13:02:48.218937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.227035 (+  8098us) service_pool.cc:224] Handling call
0709 13:02:48.227399 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.414872 (+187473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.414903 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.414959 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:48.415004 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.425580 (+1010576us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400002154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.425627 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.427506 (+  1879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430794112}
I20260709 13:02:49.475210  8367 rpcz_store.cc:276] 0709 13:02:48.305571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.333990 (+ 28419us) service_pool.cc:224] Handling call
0709 13:02:49.463305 (+1129315us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54001f6154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.463439 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966548352}
I20260709 13:02:49.477710  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 965) took 3208 ms. Trace:
I20260709 13:02:49.473845  8210 rpcz_store.cc:276] 0709 13:02:48.284874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.400822 (+1115948us) service_pool.cc:224] Handling call
0709 13:02:49.421910 (+ 21088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.444159 (+ 22249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.444366 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.478250  8894 rpcz_store.cc:276] 0709 13:02:46.264959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.418017 (+3153058us) service_pool.cc:224] Handling call
0709 13:02:49.442503 (+ 24486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.472779 (+ 30276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.472985 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:49.476890  8361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 674) took 3200 ms (client timeout 1609 ms). Trace:
I20260709 13:02:49.451637 11834 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.480273 11373 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.492533  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.480206 11593 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.494007  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.495847  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:49.495860  8897 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:49.497035  8891 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 9. Ops: [7.9-7.9]
I20260709 13:02:49.492374  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.494000  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.488255  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.496856  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:49.492930  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 65246.9us
I20260709 13:02:49.484548  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:49.501372  8889 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:49.501718  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 966) took 2600 ms. Trace:
I20260709 13:02:49.502442  8897 rpcz_store.cc:276] 0709 13:02:46.901637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.451219 (+2549582us) service_pool.cc:224] Handling call
0709 13:02:49.495484 (+ 44265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.497513 (+  2029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.501667 (+  4154us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:49.479905  8361 rpcz_store.cc:269] 0709 13:02:46.271104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.296189 (+ 25085us) service_pool.cc:224] Handling call
0709 13:02:49.471224 (+3175035us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54001810d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.471394 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4800225664}
I20260709 13:02:49.489493  8216 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:49.504036  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 839) took 2562 ms. Trace:
I20260709 13:02:49.477134 11842 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:49.505635  8891 rpcz_store.cc:276] 0709 13:02:46.935756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.480206 (+2544450us) service_pool.cc:224] Handling call
0709 13:02:49.496805 (+ 16599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.497809 (+  1004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.497987 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.472445 11700 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.515470 11747 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:49.516615 11747 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:49.516969 11747 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:49.491997 11834 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.492161 11839 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:49.523159 11747 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.477365 11731 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.524784 11747 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.524571 11731 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.480685 11777 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:49.526568 11777 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:49.526697  8894 raft_consensus.cc:1240] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:49.527034 11777 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.527443  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 968) took 2625 ms. Trace:
I20260709 13:02:49.527944  8894 rpcz_store.cc:276] 0709 13:02:46.902266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.483553 (+2581287us) service_pool.cc:224] Handling call
0709 13:02:49.507358 (+ 23805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.527160 (+ 19802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.527384 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.526865  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:49.527009  8864 leader_election.cc:336] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 1.609s (SENT)
I20260709 13:02:49.529371  8864 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.530208  8895 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:49.530768  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1244) took 3196 ms. Trace:
I20260709 13:02:49.504002 11858 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:49.539342  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:49.541076  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 106604us
I20260709 13:02:49.512913  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:49.545306  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.479605 11838 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.535884  8895 rpcz_store.cc:276] 0709 13:02:46.334004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.426232 (+3092228us) service_pool.cc:224] Handling call
0709 13:02:49.443368 (+ 17136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.530562 (+ 87194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.530724 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.536403  8892 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:49.506007 11373 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.555465 11373 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:49.556638  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 46721.1us
I20260709 13:02:49.557468  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:49.558419  8864 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:49.559015 11805 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:49.509990 11887 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:49.482342 11824 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.527087 11731 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.533739 11842 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:49.559597 11805 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:49.574275  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:49.578012  8292 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.582000  8897 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:49.569800  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.582921  8894 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:49.582727  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:49.582228  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.585440  8287 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:49.563949  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 83880.6us
I20260709 13:02:49.569046  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.586340  8286 raft_consensus.cc:2410] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:49.540830 11858 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:49.573385  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:49.574177  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.574259  8332 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:49.574645  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.574800 11809 consensus_queue.cc:1059] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:49.596797  8291 raft_consensus.cc:2410] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:49.575325  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.597527  8284 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:49.575562  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.587656  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.588660  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.588956  8288 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:02:49.588810 11802 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:02:49.575632 11699 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:49.589375 11758 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:49.589744 11837 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.591408 11582 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.569034 11740 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:02:49.583343 11593 consensus_queue.cc:1059] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:49.562674 11836 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.595453  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.584678  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1247) took 1295 ms. Trace:
I20260709 13:02:49.603144  8213 raft_consensus.cc:2393] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:49.581730 11887 raft_consensus.cc:697] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:49.569276 11711 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:02:49.616417  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.679000  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.679637  8210 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.683069 11711 raft_consensus.cc:3055] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:49.683768 11711 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:49.684631 11711 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.686288  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1814) took 1382 ms. Trace:
I20260709 13:02:49.686479 11777 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.686889  8367 rpcz_store.cc:276] 0709 13:02:48.303913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.478205 (+1174292us) service_pool.cc:224] Handling call
0709 13:02:49.501838 (+ 23633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.508492 (+  6654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.508519 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.509660 (+  1141us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.546965 (+ 37305us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:49.547003 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.547071 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.685965 (+138894us) raft_consensus.cc:1685] finished
0709 13:02:49.685984 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.686141 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":27800,"thread_start_us":20374,"threads_started":1,"wal-append.queue_time_us":121887}
I20260709 13:02:49.689407  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:49.690407 11842 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.692945 11660 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.694237  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 135967us
I20260709 13:02:49.669268  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.584867 11768 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.694900  8897 rpcz_store.cc:276] 0709 13:02:48.289367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.506926 (+1217559us) service_pool.cc:224] Handling call
0709 13:02:49.540361 (+ 33435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.584455 (+ 44094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.584627 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.695080  8361 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
W20260709 13:02:49.697170  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 123062us
W20260709 13:02:49.697912  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 136476us
I20260709 13:02:49.699221 11584 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:02:49.666677 11699 raft_consensus.cc:697] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:49.668393 11837 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.703256 11699 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.705055 11837 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.707403  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.690315 11871 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:49.708257  8365 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:49.709246 11824 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.711606  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1812) took 1408 ms. Trace:
I20260709 13:02:49.712025  8358 rpcz_store.cc:276] 0709 13:02:48.303136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.430945 (+1127809us) service_pool.cc:224] Handling call
0709 13:02:49.471575 (+ 40630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.472150 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.711284 (+239134us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b54001810d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.711515 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60047104}
I20260709 13:02:49.717204  8292 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:49.727710  8287 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:49.729605  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:49.733060 11809 consensus_queue.cc:1059] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:49.715533  8367 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:49.604936 11858 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:49.736537  8209 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:49.738493  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.738968  8863 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:49.739385  8210 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:02:49.740408 11807 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.741498  8864 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.646169 11758 raft_consensus.cc:697] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:49.748644  8259 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:49.693251 11834 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.762424 11879 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.762940 11834 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.765691 11887 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.751439  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:49.770444  8292 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:49.760924  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.753785  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.755182 11584 raft_consensus.cc:3055] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:49.755510 11734 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:49.755084 11692 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:49.755679 11871 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:49.756592  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:49.756840  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:49.757314  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:49.758613  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.758908  8896 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:49.759573  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.777822  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:49.760896  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.760264  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:49.761092 11775 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:49.736922 11711 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:49.784360  8287 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:49.780182 11824 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:49.726548 11660 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.781430 11692 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.786577 11692 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.782464  8863 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:49.788599  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.789274  8892 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:49.790118  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.790673  8892 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:49.774911  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1813) took 1471 ms. Trace:
I20260709 13:02:49.784183  8895 raft_consensus.cc:2393] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:49.782860  8889 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
W20260709 13:02:49.773218  8332 connection.cc:256] RPC call timeout handler was delayed by -1.0668379599999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:02:49.792696  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.795019  8361 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:49.758953 11777 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.802160 11838 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.804607 11838 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.778872 11584 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:49.783223 11747 consensus_queue.cc:1059] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:49.805809 11871 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.806973 11747 raft_consensus.cc:3055] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:49.806900 11584 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.807761  8212 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:49.808166 11584 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.776412 11856 raft_consensus.cc:3055] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:49.797788  8863 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:49.800006  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.807421 11747 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:49.776181 11809 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:49.816691 11809 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:49.817117 11809 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.818341 11758 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.822777  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.824113 11747 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.825522 11747 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.826120  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.826781  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:49.827310  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.827550  8287 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:49.827989  8217 raft_consensus.cc:2393] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:49.828485  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.828753  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.813328 11856 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:49.832594 11856 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.833804 11856 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:49.844180  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46506us
I20260709 13:02:49.844449  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.671047 11805 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.847895  8367 raft_consensus.cc:2410] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:49.778524 11383 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.814597 11867 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:49.810811  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.847266  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.855407  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:49.840683  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.829803  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.837256 11700 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.841759  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1728) took 1723 ms. Trace:
I20260709 13:02:49.785125 11775 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:49.728286 11836 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.754611 11582 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.843770  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.827003  8213 raft_consensus.cc:2410] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:49.848613  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.849825 11626 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.856917  8290 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.862339  8892 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:49.791764  8366 rpcz_store.cc:276] 0709 13:02:48.303532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.469446 (+1165914us) service_pool.cc:224] Handling call
0709 13:02:49.469833 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.470290 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.470318 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.470840 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.507582 (+ 36742us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:49.749338 (+241756us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.774568 (+ 25230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.774651 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.774694 (+    43us) raft_consensus.cc:1685] finished
0709 13:02:49.774707 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.774849 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50104,"prepare.queue_time_us":138452,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2533,"raft.queue_time_us":25167,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":6293,"thread_start_us":218712,"threads_started":2,"wal-append.queue_time_us":131660}
I20260709 13:02:49.875926  8361 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:49.844844 11837 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:49.894440  8216 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:49.868818  8215 rpcz_store.cc:276] 0709 13:02:48.058130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.059225 (+  1095us) service_pool.cc:224] Handling call
0709 13:02:48.059591 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.488429 (+428838us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:48.694943 (+206514us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.150878 (+455935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.150933 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:49.150979 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.780995 (+630016us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400079754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.781041 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.781154 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9936,"prepare.queue_time_us":147740,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":17959,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5608,"spinlock_wait_cycles":677843712,"thread_start_us":593063,"threads_started":2,"wal-append.queue_time_us":512400}
I20260709 13:02:49.895176  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.876967  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.899673  8287 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:49.856143 11484 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.869781 11734 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:49.876189  8259 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.855176 11807 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.899456  8217 raft_consensus.cc:2376] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11. Re-sending same reply.
I20260709 13:02:49.902633  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2260) took 1220 ms. Trace:
I20260709 13:02:49.904174  8360 rpcz_store.cc:276] 0709 13:02:48.681920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.704382 (+ 22462us) service_pool.cc:224] Handling call
0709 13:02:49.902407 (+1198025us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b54001cedd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.902547 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183138176}
I20260709 13:02:49.905169  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.909293  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.876865 11371 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.912115  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 683) took 1612 ms. Trace:
W20260709 13:02:49.917547  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 43498.7us
I20260709 13:02:49.869165 11775 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.914003  8331 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:49.915928  8363 rpcz_store.cc:276] 0709 13:02:48.300038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.302161 (+  2123us) service_pool.cc:224] Handling call
0709 13:02:48.302611 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.149644 (+847033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.907241 (+757597us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54001f7054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:49.912038 (+  4797us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171289344}
W20260709 13:02:49.933452  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 57354us
I20260709 13:02:49.875118 11867 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:49.935240  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:49.937669  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:49.940088  8360 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:49.938901  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:49.943071  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.910197 11484 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:49.947197  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:49.940747 11731 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:49.950472 11773 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:49.953914 11807 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.954439  8293 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.954496 11807 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.956228 11718 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:49.957098 11807 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:49.957531 11718 raft_consensus.cc:3055] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:49.957952  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2242) took 3312 ms. Trace:
I20260709 13:02:49.954809  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:49.958351  8362 rpcz_store.cc:276] 0709 13:02:46.628091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.630437 (+  2346us) service_pool.cc:224] Handling call
0709 13:02:47.310354 (+679917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.310585 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:48.256713 (+946128us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.714870 (+458157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.727593 (+ 12723us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:48.795048 (+ 67455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.853705 (+ 58657us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.264759 (+411054us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:49.930999 (+666240us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54000672d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.940651 (+  9652us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219,"prepare.queue_time_us":1007804,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":16480,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":11829,"spinlock_wait_cycles":1623333504,"thread_start_us":554702,"threads_started":3,"wal-append.queue_time_us":325214}
I20260709 13:02:49.960227 11731 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:49.960723 11731 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.961061 11731 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.964406 11692 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.967259  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.968129  8288 raft_consensus.cc:2410] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:49.968919  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.969434  8288 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 5.
I20260709 13:02:49.970050  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:49.971323  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.971463  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:49.972474 11858 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.973388  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.974223 11719 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.951122  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.959767  8258 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:49.979315  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.980289  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:49.980430  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.980969  8288 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:49.961161  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2330) took 1226 ms. Trace:
W20260709 13:02:49.975034  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.981894  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:49.972546  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:49.975854  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:49.960362  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.981698  8218 rpcz_store.cc:276] 0709 13:02:48.735168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.433420 (+698252us) service_pool.cc:224] Handling call
0709 13:02:49.471403 (+ 37983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.472587 (+  1184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.960968 (+488381us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b5400129150. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:49.961104 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60008320}
I20260709 13:02:49.914063 11837 raft_consensus.cc:697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:49.953408  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:49.975129  8293 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:49.981266  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:49.983326  8362 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:49.984324  8366 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:49.988500  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:49.983991  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.983985  8862 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:49.985059  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.989291  8259 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:49.989464  8360 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:49.990476  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.990695  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.991570  8288 raft_consensus.cc:2410] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:49.991771  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.992444  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:49.992866  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.993052  8288 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:49.951588 11878 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.983317 11907 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:49.915696 11371 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:49.994333 11878 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:49.996910  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.995995  8362 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.994040  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:49.995779  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:50.004101  8217 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:49.991080  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:50.005208  8365 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 5: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:49.999092  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.006789  8293 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.010367 11722 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.010797 11722 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:50.011289 11484 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:50.011394 11722 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.011027  8213 raft_consensus.cc:2410] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:02:50.010749  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.012707  8211 raft_consensus.cc:2393] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:49.957924 11718 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:50.039484  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 55604us
I20260709 13:02:50.040802  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:50.039695  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:50.047379  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 64890.8us
I20260709 13:02:50.048508  8366 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:49.996157 11692 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:49.986346 11839 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.002650 11626 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:50.060693  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 79175.5us
I20260709 13:02:50.061089  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:50.061650  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:50.004092 11876 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:50.058348  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1817) took 1745 ms. Trace:
W20260709 13:02:50.062187  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 206050us
I20260709 13:02:50.063608  8211 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:50.012998 11734 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:49.994513 11858 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:50.068933  8366 rpcz_store.cc:276] 0709 13:02:48.305161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.048068 (+1742907us) service_pool.cc:224] Handling call
0709 13:02:50.048340 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.050683 (+  2343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.050899 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.075333  8862 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:50.052736 11768 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.002233 11371 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:50.066424 11692 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:50.060446 11626 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:02:50.093999 11885 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.471s	user 0.000s	sys 0.006s
I20260709 13:02:50.095543  8331 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:50.094863 11718 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:50.101488  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 112304us
I20260709 13:02:50.010730 11878 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.104326  8293 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:50.105280  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:50.105257  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 43692.1us
I20260709 13:02:50.106112  8293 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:50.082991 11768 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.108604  8862 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:50.104115 11371 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:50.089633 11484 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.099687 11626 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.122187 11917 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.125177 11699 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:50.098505 11854 raft_consensus.cc:3055] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:50.099215 11784 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.114881  8863 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:50.131326  8293 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:50.132164  8862 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:50.140964 11907 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:50.141201 11876 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:50.141645 11876 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.142117  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.142812  8293 raft_consensus.cc:2368] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8.
I20260709 13:02:50.143541 11907 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.143966 11907 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.145017 11809 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:50.134476  8289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 834) took 3148 ms (client timeout 2786 ms). Trace:
W20260709 13:02:50.146684  8289 rpcz_store.cc:269] 0709 13:02:46.986195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.986337 (+   142us) service_pool.cc:224] Handling call
0709 13:02:50.134249 (+3147912us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54001d6ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:50.134398 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5150036736}
I20260709 13:02:50.147295 11383 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:50.147856 11809 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:50.079145 11867 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:50.149127  8359 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:50.141959 11876 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.150991 11758 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:50.149823  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 687) took 1812 ms. Trace:
I20260709 13:02:50.114653 11768 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.137928  8367 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:50.138306 11699 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:50.138425 11718 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.132207  8362 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:50.137674  8290 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:02:50.155283  8286 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:50.110699 11700 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.151839  8359 rpcz_store.cc:276] 0709 13:02:48.337406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.136229 (+1798823us) service_pool.cc:224] Handling call
0709 13:02:50.136567 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.149551 (+ 12984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.149741 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.160593  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2247) took 1822 ms. Trace:
W20260709 13:02:50.200270  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.202090  8367 rpcz_store.cc:276] 0709 13:02:48.337748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.137271 (+1799523us) service_pool.cc:224] Handling call
0709 13:02:50.137571 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.160276 (+ 22705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.160526 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:50.198868  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 67151.7us
I20260709 13:02:50.206648  8258 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:50.139132 11854 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:50.208688  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:50.213873  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:50.152269 11878 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.200387 11663 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:50.221401  8367 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:50.221552 11663 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:50.222345  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2252) took 1882 ms. Trace:
I20260709 13:02:50.162348 11836 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.222908  8367 rpcz_store.cc:276] 0709 13:02:48.339664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.206732 (+1867068us) service_pool.cc:224] Handling call
0709 13:02:50.220401 (+ 13669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.222061 (+  1660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.222290 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.138731 11917 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.220724 11582 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.247331  8363 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:50.249840  8363 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:50.250298 11854 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.250624  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2254) took 1910 ms. Trace:
I20260709 13:02:50.251369  8363 rpcz_store.cc:276] 0709 13:02:48.340310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.249306 (+1908996us) service_pool.cc:224] Handling call
0709 13:02:50.249639 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.250393 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.250552 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.252110 11775 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:50.252713  8363 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:02:50.253365  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2257) took 1635 ms. Trace:
I20260709 13:02:50.253865  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2202) took 1764 ms. Trace:
I20260709 13:02:50.254276  8285 rpcz_store.cc:276] 0709 13:02:48.489390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.489623 (+   233us) service_pool.cc:224] Handling call
0709 13:02:48.490033 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.414202 (+924169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.414231 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.414274 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:49.414304 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.253566 (+839262us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b5400415ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:50.253609 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.253721 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12953,"raft.queue_time_us":17104,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":1827,"spinlock_wait_cycles":2076278016}
I20260709 13:02:50.255811  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:50.257030  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.257663  8285 raft_consensus.cc:2368] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11.
I20260709 13:02:50.253659  8363 rpcz_store.cc:276] 0709 13:02:48.618607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.252130 (+1633523us) service_pool.cc:224] Handling call
0709 13:02:50.252459 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.253109 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.253312 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.259217  8363 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:50.247112 11699 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.259891  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2258) took 1638 ms. Trace:
I20260709 13:02:50.260237  8363 rpcz_store.cc:276] 0709 13:02:48.621506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.258640 (+1637134us) service_pool.cc:224] Handling call
0709 13:02:50.258980 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.259653 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.259831 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.261454  8363 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:50.261826  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1819) took 1955 ms. Trace:
I20260709 13:02:50.262257  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2259) took 1610 ms. Trace:
I20260709 13:02:50.264580  8184 leader_election.cc:400] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11.
I20260709 13:02:50.264914  8184 leader_election.cc:403] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:50.265655 11711 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.266568 11711 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:50.267047 11711 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:50.262847  8363 rpcz_store.cc:276] 0709 13:02:48.652194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.260986 (+1608792us) service_pool.cc:224] Handling call
0709 13:02:50.261282 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.261774 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.262209 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.267812  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.268401  8284 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.244398 11839 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:50.269873 11917 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.268153  8363 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:50.270879  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.271389  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.220052  8359 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:50.222765 11663 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.227696  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:50.274537  8290 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:50.219368 11731 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.199397 11734 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.115640 11837 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.203896 11758 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:50.240051 11894 log.cc:927] Time spent T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.718s	user 0.000s	sys 0.002s
I20260709 13:02:50.199364 11921 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:50.262236  8366 rpcz_store.cc:276] 0709 13:02:48.305980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.080349 (+1774369us) service_pool.cc:224] Handling call
0709 13:02:50.080669 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.148645 (+ 67976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.148680 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:50.148723 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:50.148775 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.261605 (+112830us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b54003188d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:50.261650 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.261774 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155905920}
I20260709 13:02:50.251888 11791 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.289044  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.289714  8290 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:50.244356  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.223011 11383 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:50.275796  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2262) took 1084 ms. Trace:
I20260709 13:02:50.265053 11627 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:50.344815  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:50.280401  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2251) took 1935 ms. Trace:
I20260709 13:02:50.346266  8359 rpcz_store.cc:276] 0709 13:02:48.339152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.205583 (+1866431us) service_pool.cc:224] Handling call
0709 13:02:50.219813 (+ 14230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.274214 (+ 54401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.274431 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.348856 11731 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:50.349603 11660 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:50.267868 11711 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:50.352773 11711 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.358307 11805 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11.
I20260709 13:02:50.341912 11758 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.361038 11768 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.361991  8288 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:50.337291  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 72911.8us
I20260709 13:02:50.364842  8287 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:50.284494  8284 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:50.285616  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.288002  8367 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:50.323122  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.299664  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 73726.5us
I20260709 13:02:50.370012  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2253) took 2030 ms. Trace:
I20260709 13:02:50.295051  8292 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:50.338050  8363 rpcz_store.cc:276] 0709 13:02:49.186119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.267710 (+1081591us) service_pool.cc:224] Handling call
0709 13:02:50.267995 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.270557 (+  2562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.270715 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:50.340888 11854 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.342432 11907 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.366761  8285 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:50.377820  8863 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:50.370823  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 238873us
I20260709 13:02:50.370505  8367 rpcz_store.cc:276] 0709 13:02:48.339991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.223930 (+1883939us) service_pool.cc:224] Handling call
0709 13:02:50.287691 (+ 63761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.366634 (+ 78943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.369945 (+  3311us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:50.372871  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.288681 11921 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:50.336285 11663 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.461817  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:50.373289 11876 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.407128  8862 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:50.460669  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.482915  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 106014us
W20260709 13:02:50.489233  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 82257.5us
I20260709 13:02:50.490154  8862 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:50.491340  8862 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:50.492991  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 114698us
I20260709 13:02:50.493891  8258 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:50.493259  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 116587us
I20260709 13:02:50.494904  8184 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:50.471076 11878 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:50.505369  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:50.508446 11626 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.514827  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.515344 11876 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.516099  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.461962 11921 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.494127 11722 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:50.519613 11722 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.501983 11917 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.517479  8287 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:50.523322  8287 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:50.523766 11627 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:50.524585  8287 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:50.525904  8287 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:50.534339  8285 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:50.535982 11879 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.536562 11879 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:50.536785  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:50.538100  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:50.539129  8258 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:50.540748 11731 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.541147 11731 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.541494 11731 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.542384 11718 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:50.542784 11718 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:50.543219 11718 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.544499 11922 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.544912 11922 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:50.545253 11922 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.502234 11836 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.550382 11383 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:50.505282 11835 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:50.554827 11835 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:50.550269  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 51870.2us
I20260709 13:02:50.542721  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.583050  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:50.581876  8898 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:50.591042  8364 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
W20260709 13:02:50.591665  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 100454us
I20260709 13:02:50.593050  8862 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:50.502197 11807 raft_consensus.cc:2764] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:02:50.599383  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.594990  8862 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:50.609279  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:50.613588  8291 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:02:50.616519  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.617435  8288 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:50.587632 11722 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:02:50.627231  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:50.628973  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.630321 11582 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:50.631006 11582 raft_consensus.cc:697] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:50.632001 11582 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.634418  8286 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:50.635078 11907 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.635506  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.636265 11626 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:50.637035  8286 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:50.638659  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2248) took 2300 ms. Trace:
I20260709 13:02:50.639448  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.640288  8898 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:50.639025  8362 rpcz_store.cc:276] 0709 13:02:48.338031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.162196 (+1824165us) service_pool.cc:224] Handling call
0709 13:02:50.162504 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.263120 (+100616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.263148 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.263617 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.501014 (+237397us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:50.501050 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.501119 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.638475 (+137356us) raft_consensus.cc:1685] finished
0709 13:02:50.638494 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.638608 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63599,"thread_start_us":237023,"threads_started":1,"wal-append.queue_time_us":373106}
I20260709 13:02:50.642132  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:50.642743  8213 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.642956  8891 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:50.643121  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:50.643829  8214 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:50.645004  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:50.645179  8891 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:50.646237  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:50.646804  8893 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:02:50.647465  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.642758  8209 raft_consensus.cc:1217] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Deduplicated request from leader. Original: 7.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 13:02:50.648293  8209 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:50.648499  8890 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:50.612385 11917 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:50.649477 11917 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.649823 11917 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.650038  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.651459  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:50.651868  8213 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:50.651986  8890 raft_consensus.cc:2376] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11. Re-sending same reply.
I20260709 13:02:50.653285  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.654026  8890 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 5.
I20260709 13:02:50.598664 11836 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:02:50.589176 11878 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:50.656280 11878 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.657148  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.657354  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:50.657840  8890 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:50.658262  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 94477.5us
I20260709 13:02:50.658608 11768 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:50.659281  8258 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:50.591215 11805 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:02:50.612120 11824 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:50.663214 11824 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:50.663578 11824 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:50.666225  8286 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:50.668303  8293 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:02:50.648310  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:50.630406  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:50.680433 11918 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:50.681384  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.682058  8287 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:50.681526  8892 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:02:50.674577  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:50.682050  8284 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.633632 11711 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:50.674060 11824 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:50.677616 11626 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:50.683007  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.692188  8183 leader_election.cc:400] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8.
I20260709 13:02:50.699930  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:50.700165  8183 leader_election.cc:403] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:50.698890  8891 raft_consensus.cc:2410] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:50.694319  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1747) took 1160 ms. Trace:
W20260709 13:02:50.693480  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.684939  8890 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:50.700613  8286 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.701388  8216 rpcz_store.cc:276] 0709 13:02:49.533778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.537823 (+  4045us) service_pool.cc:224] Handling call
0709 13:02:50.694109 (+1156286us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400128754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:50.694254 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707691264}
I20260709 13:02:50.685588  8289 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:50.686209  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.719861  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:50.720715  8898 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.724335  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.725060  8890 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:50.726940  8183 leader_election.cc:400] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11.
I20260709 13:02:50.729985  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.730770  8892 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:50.736583  8293 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:50.738956  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1737) took 2257 ms. Trace:
W20260709 13:02:50.740870  8364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2267) took 1466 ms (client timeout 1764 ms). Trace:
W20260709 13:02:50.741285  8364 rpcz_store.cc:269] 0709 13:02:49.274397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.317832 (+ 43435us) service_pool.cc:224] Handling call
0709 13:02:50.740699 (+1422867us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001527d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:50.740812 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2758764288}
I20260709 13:02:50.739391  8212 rpcz_store.cc:276] 0709 13:02:48.481609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.422532 (+940923us) service_pool.cc:224] Handling call
0709 13:02:49.422876 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.808225 (+385349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.738737 (+930512us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400425254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:50.738900 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885159296}
I20260709 13:02:50.698961 11805 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:50.752440  8284 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:50.698396 11626 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.735208 11663 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8.
I20260709 13:02:50.803795  8286 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:50.817682  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:50.753187 11836 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.824121  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.758901 11626 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.753295 11824 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:50.829077  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 74289.9us
I20260709 13:02:50.833698  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.834332  8896 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
W20260709 13:02:50.835410  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.814256 11925 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:50.839607 11925 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.839608 11383 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:02:50.845597  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2221) took 1064 ms. Trace:
I20260709 13:02:50.846113  8290 rpcz_store.cc:276] 0709 13:02:49.781099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.376539 (+595440us) service_pool.cc:224] Handling call
0709 13:02:50.482890 (+106351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.483118 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:50.719047 (+235929us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.845125 (+126078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:50.845188 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:50.845252 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.845327 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.845487 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6828,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":360874,"threads_started":3,"wal-append.queue_time_us":127425}
I20260709 13:02:50.759317 11740 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:02:50.854681  8286 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:50.856431 11740 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:50.830958 11731 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.857530 11838 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:50.858771  8284 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:50.832829 11836 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.874454  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:50.878870  8894 raft_consensus.cc:2368] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9.
I20260709 13:02:50.885066 11731 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:50.852361 11663 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:02:50.908721  8892 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.865091 11805 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:02:50.913590  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1816) took 2608 ms. Trace:
I20260709 13:02:50.860811 11700 consensus_queue.cc:1059] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:02:50.921164  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 104404us
I20260709 13:02:50.922609  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:50.914017  8365 rpcz_store.cc:276] 0709 13:02:48.304742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.005786 (+1701044us) service_pool.cc:224] Handling call
0709 13:02:50.052832 (+ 47046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.053194 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.053220 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.069102 (+ 15882us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.132774 (+ 63672us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:50.206399 (+ 73625us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.353751 (+147352us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b180037bee0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9160522 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:50.911424 (+557673us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b180037bee0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef90dac0a 00007f2f0281a219 00007f2ef9162a40 00007f2ef915d4e4 00007f2ef915d455 00007f2efc245060 00007f2efc257716 00007f2efc268287 00007f2efc268208
0709 13:02:50.913291 (+  1867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.913365 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.913405 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:50.913417 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.913535 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59232,"prepare.queue_time_us":67885,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1789,"raft.queue_time_us":2062,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5314,"spinlock_wait_cycles":121741952,"thread_start_us":34213,"threads_started":1,"wal-append.queue_time_us":127441}
W20260709 13:02:50.925098  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.925226  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:50.925509  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:50.926189  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.927004  8332 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:50.927100  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:50.927691  8361 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:50.927242  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:50.932680  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1834) took 1056 ms. Trace:
I20260709 13:02:50.929029  8358 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.933054  8366 rpcz_store.cc:276] 0709 13:02:49.876053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.286446 (+410393us) service_pool.cc:224] Handling call
0709 13:02:50.286742 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.286936 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:50.758291 (+471355us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.932360 (+174069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:50.932408 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:50.932455 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.932512 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.932624 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81954,"prepare.queue_time_us":67027,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"thread_start_us":499466,"threads_started":2,"wal-append.queue_time_us":84451}
I20260709 13:02:50.927593 11954 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:50.941710  8367 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:02:50.940634  8362 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:50.949101  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:50.949481  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:50.949996  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:50.902587 11922 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:50.950459  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:50.950820  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:50.951026  8894 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:50.949257  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:50.951503  8365 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:50.952019  8359 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:50.952423  8892 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:50.953008  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1815) took 2648 ms. Trace:
I20260709 13:02:50.954195  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:50.949846  8366 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:50.955322  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:50.955930  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.956481  8362 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:50.951494  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:50.957134  8363 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:50.928797 11887 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.933054 11663 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:50.942518 11954 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:50.959539  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:50.960660  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 874183us
I20260709 13:02:50.961923  8894 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:50.963714  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:50.964556  8293 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:50.967692  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.954494  8360 rpcz_store.cc:276] 0709 13:02:48.304304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.990135 (+1685831us) service_pool.cc:224] Handling call
0709 13:02:49.990468 (+   333us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:49.999001 (+  8533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.999028 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:49.999683 (+   655us) log.cc:844] Serialized 78 byte log entry
0709 13:02:50.054043 (+ 54360us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:50.078556 (+ 24513us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.260076 (+181520us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18001c8dc0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef90dac0a 00007f2f0281a219 00007f2ef9162a40 00007f2ef915d4e4 00007f2ef915d455 00007f2efc245060 00007f2efc257716 00007f2efc268287 00007f2efc268208
0709 13:02:50.589773 (+329697us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.931383 (+341610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.931456 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.952805 (+ 21349us) raft_consensus.cc:1685] finished
0709 13:02:50.952826 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.952958 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":352297,"prepare.queue_time_us":118449,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":6068,"raft.queue_time_us":535346,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":6890,"spinlock_wait_cycles":3602816,"thread_start_us":383291,"threads_started":2,"wal-append.queue_time_us":101722}
I20260709 13:02:51.016039  8331 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:51.015589  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 56163.9us
I20260709 13:02:50.953415 11867 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.017228  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:51.021615  8358 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:51.023033  8894 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:50.955374 11870 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:51.016534 11719 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.964102 11663 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:51.027801  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:51.017872 11871 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:50.963279 11814 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:51.029863 11940 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:02:51.018369 11921 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.033993 11773 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:51.034348 11867 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:51.029151  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:51.023559 11593 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.017066 11954 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.026796 11879 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:51.042827  8898 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:02:51.045181  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:51.047108  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:51.029438  8894 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:51.048980  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:51.049688  8331 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:51.066983  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:50.376245  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:51.022763 11917 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.054251  8257 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:51.052153  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:51.098227  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 44091.6us
I20260709 13:02:51.067319  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:51.052307  8218 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:51.068379  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:51.092262  8288 raft_consensus.cc:1240] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:02:51.099633  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 50022.7us
I20260709 13:02:51.094800 11807 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:51.025627 11887 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:02:51.097198  8895 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:51.047351 11814 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.040984 11871 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.052781 11791 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:51.101483  8331 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:51.025445 11870 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:51.105410  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.067726 11834 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:51.106402  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:51.050813 11867 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.100394 11807 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:51.111407  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:51.111881  8361 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:51.112075  8890 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:51.098827 11950 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.113605 11870 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.099380 11809 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:51.114395  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:51.133283 11809 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.070163 11773 raft_consensus.cc:697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:51.134656 11773 consensus_queue.cc:237] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.104046 11775 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:51.102146 11484 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:02:51.102458 11593 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:51.121536  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.144694  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:51.145442  8894 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:51.124147  8895 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:51.111646 11871 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:51.147367  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.148169  8897 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:51.148458  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:51.149302  8894 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:51.131062  8898 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:51.150311  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:51.151114  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.151857  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.152515  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.132514  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.153119  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.154238  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.154368  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.133772 11809 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:51.102746 11957 consensus_queue.cc:1059] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:02:51.156054 11775 raft_consensus.cc:3055] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:51.156514 11775 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:51.115700 11879 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:02:51.104058 11814 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:51.157467 11775 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.158612 11879 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:51.159070 11775 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.144826 11593 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.160351 11593 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.120630 11731 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:02:51.161628 11731 raft_consensus.cc:3055] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:51.162004 11731 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:51.162901 11731 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.164130 11731 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.149150  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:51.154582 11922 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.151043  8894 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.122426 11663 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.167479 11663 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:51.112242 11854 consensus_meta.cc:287] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
I20260709 13:02:51.169392 11854 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:51.169853 11854 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:51.170750 11854 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.118988 11925 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:51.174543  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:51.123174 11627 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:51.133785  8893 raft_consensus.cc:2410] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:51.179065 11627 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:51.179540 11627 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:51.180398 11627 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.181591 11627 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:51.153206  8898 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
W20260709 13:02:51.185896  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.193807  8889 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 9: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:51.196848  8862 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:51.197729 11925 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:51.198172 11925 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.198611  8895 raft_consensus.cc:2368] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:51.198707 11925 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:51.199847 11952 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:02:51.192807  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2418) took 1126 ms. Trace:
I20260709 13:02:51.200436  8287 rpcz_store.cc:276] 0709 13:02:50.066758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.526596 (+459838us) service_pool.cc:224] Handling call
0709 13:02:50.681887 (+155291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.682570 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.192601 (+510031us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001d65d0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:51.192745 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356633472}
I20260709 13:02:51.202930 11921 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.203125 11814 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.192025 11871 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.210052 11814 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.210448 11917 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:51.202608 11593 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.205585 11809 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.212100 11807 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.213091 11807 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.207322  8862 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:51.214023 11809 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:51.215693  8894 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:02:51.216806 11836 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:51.216351 11593 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:51.219425 11718 consensus_meta.cc:287] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.676s	user 0.003s	sys 0.006s
I20260709 13:02:51.223650 11718 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.224805 11626 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.216923 11768 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:51.045845 11719 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.226524 11768 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:51.228219 11768 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.229059  8897 raft_consensus.cc:2410] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:51.113778 11834 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:51.229650 11718 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.230460 11834 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.231534 11834 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.179562  8891 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:51.122460  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.264947  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.646601  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.647545  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:51.280112  8289 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:51.288097  8292 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:51.311434  8290 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:51.284821  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:51.287382  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:51.652137  8293 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
W20260709 13:02:51.415988  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.653239 11958 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.437520  8218 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:02:51.439294  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 399680us
W20260709 13:02:51.656028  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.656790  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.657162  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.493405  8211 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:51.497565  8285 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:51.498574  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:51.661455 11958 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:51.504415  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.663002  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.664690  8287 raft_consensus.cc:2393] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:51.661691  8286 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:02:51.666718  8211 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:51.668169  8218 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:51.530589  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2426) took 1388 ms. Trace:
I20260709 13:02:51.669106  8288 rpcz_store.cc:276] 0709 13:02:50.141845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.618354 (+476509us) service_pool.cc:224] Handling call
0709 13:02:50.675678 (+ 57324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.099658 (+423980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.530279 (+430621us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b540047e854. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:51.530524 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957978880}
W20260709 13:02:51.531894  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.541385  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.542459  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:51.543998  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:51.547842  8291 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:51.405043  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 298856us
I20260709 13:02:51.238003  8361 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:51.497681  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:51.491007  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:51.970415  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:51.971215  8360 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.497040  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:51.495962  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:51.974951  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:51.976063  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:51.266511  8863 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:51.707463  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:51.702718  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 44781.1us
I20260709 13:02:51.711169  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:52.384452  8360 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:52.384671 11777 consensus_queue.cc:1059] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:52.385515 11777 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:51.710491  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:52.386632 11824 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:51.842751  8114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48060 (request call id 278) took 16709 ms (client timeout 15000 ms). Trace:
I20260709 13:02:52.387013 11824 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:02:52.387203  8114 rpcz_store.cc:269] 0709 13:02:35.133298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.187155 (+ 53857us) service_pool.cc:224] Handling call
0709 13:02:51.842522 (+16655367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:43.391668 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:43.545158 (+153490us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:43.545200 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:02:43.545218 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:43.546428 (+  1210us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:43.546493 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:43.546523 (+    30us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:02:43.880686 (+334163us) tablet.cc:701] Row locks acquired
0709 13:02:43.880709 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:02:43.880853 (+   144us) write_op.cc:270] Start()
0709 13:02:43.880971 (+   118us) write_op.cc:276] Timestamp: P: 1783602163880804 usec, L: 0
0709 13:02:43.880994 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:43.881703 (+   709us) log.cc:844] Serialized 5432 byte log entry
0709 13:02:44.901037 (+1019334us) op_driver.cc:464] REPLICATION: finished
0709 13:02:45.280559 (+379522us) write_op.cc:301] APPLY: starting
0709 13:02:45.283227 (+  2668us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:45.335355 (+ 52128us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:45.359317 (+ 23962us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:45.654006 (+294689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:45.681155 (+ 27149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:02:45.681210 (+    55us) write_op.cc:312] APPLY: finished
0709 13:02:45.793302 (+112092us) log.cc:844] Serialized 101 byte log entry
0709 13:02:45.961525 (+168223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:45.961667 (+   142us) write_op.cc:454] Released schema lock
0709 13:02:45.961713 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:45.963746 (+  2033us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:45.963780 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1593154,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":352645,"apply.run_cpu_time_us":42309,"apply.run_wall_time_us":692332,"num_ops":14,"prepare.queue_time_us":236873,"prepare.run_cpu_time_us":31470,"prepare.run_wall_time_us":700841,"raft.queue_time_us":494187,"raft.run_cpu_time_us":11947,"raft.run_wall_time_us":254519,"replication_time_us":1019208,"thread_start_us":848471,"threads_started":5,"wal-append.queue_time_us":364294,"wal-append.run_cpu_time_us":30903,"wal-append.run_wall_time_us":2436317}]]}
I20260709 13:02:51.845044  8115 catalog_manager.cc:5697] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.393900  8115 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:52.394793 11824 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:52.396219 11824 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:51.726065  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.399770  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.738791  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48521.1us
I20260709 13:02:52.401202  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:51.836251  8259 leader_election.cc:336] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 2.163s (SENT)
I20260709 13:02:51.675453  8284 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.676527  8285 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:51.678581  8286 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:52.395915  8115 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 4 to 5, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 5 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.701454  8288 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:51.959048  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2440) took 1297 ms. Trace:
W20260709 13:02:51.405892  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 304586us
I20260709 13:02:52.409783  8289 rpcz_store.cc:276] 0709 13:02:50.661949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.704517 (+ 42568us) service_pool.cc:224] Handling call
0709 13:02:50.734187 (+ 29670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.650361 (+916174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.958779 (+308418us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54001d60d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:51.958983 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255610240}
I20260709 13:02:52.411018  8331 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:51.868593  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:51.919296  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:51.977224  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:52.415395  8361 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.415819  8366 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:02:52.415956 11773 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:52.416734  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:51.502432  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:52.420037  8284 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:02:51.483050  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:52.422902  8367 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:52.423903  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:52.424173  8361 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:51.483804  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:51.973759  8364 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:52.428153  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:51.964824  8359 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:51.906060  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.516073  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:51.509411  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:52.432227  8897 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.433169 11856 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:51.339756 11593 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.438863 11593 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:52.441002 11593 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.320884 11626 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:52.443856 11626 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.444319 11626 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.549166 11731 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.447428 11731 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:52.449709 11731 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.381898 11791 raft_consensus.cc:697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:51.759651 11805 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:52.460230 11791 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.824745 11807 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:51.266233 11836 consensus_queue.cc:1059] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:02:51.864454 11854 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:51.119060 11867 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:52.467257  8359 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:51.260838 11870 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:51.907406 11878 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:51.363122 11879 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:51.463662  8896 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:02:52.474443  8364 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:52.474632  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 989) took 1565 ms. Trace:
I20260709 13:02:52.475011  8896 rpcz_store.cc:276] 0709 13:02:50.909275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.909508 (+   233us) service_pool.cc:224] Handling call
0709 13:02:51.463413 (+553905us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.473770 (+1010357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.474455 (+   685us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400678c50. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:52.474577 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265362304}
I20260709 13:02:51.246357 11719 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:51.506891 11660 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.474025 11870 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:52.477324 11660 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.892114 11814 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:52.480127 11814 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:51.925159 11838 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.481179 11814 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:52.484797 11838 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:52.485224 11814 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.487025 11838 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.920853 11852 consensus_queue.cc:1059] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:51.247205 11871 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.266659 11917 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 13:02:51.247298 11925 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:52.493338 11917 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:52.493731 11917 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.493961 11917 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:52.494040 11925 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:52.494879 11867 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.735755 11950 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.496869 11950 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:52.497135 11867 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.272146 11954 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:51.694391 11958 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:52.500137 11954 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.850138 11964 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:52.501632 11964 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:52.503665 11964 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:51.867144 11965 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:51.866108 11966 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:52.407825  8115 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 4 to 5, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 5 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:52.115789  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.024729  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.126647  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.381405  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 674320us
I20260709 13:02:53.130875  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:52.389743  8184 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:51.710016  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:53.136538  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1768) took 1427 ms (client timeout 1613 ms). Trace:
W20260709 13:02:53.136904  8216 rpcz_store.cc:269] 0709 13:02:51.709556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.709707 (+   151us) service_pool.cc:224] Handling call
0709 13:02:53.136473 (+1426766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:51.675562  8217 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:52.338193  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.404661  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:52.403059  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:52.415061  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 546762us
I20260709 13:02:52.425118  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:52.496232  8358 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:53.165287  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 703) took 1685 ms. Trace:
I20260709 13:02:53.165519  8358 rpcz_store.cc:276] 0709 13:02:51.479643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.483591 (+  3948us) service_pool.cc:224] Handling call
0709 13:02:53.165112 (+1681521us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b54001f7054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:53.165234 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159380736}
I20260709 13:02:53.166781  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:53.167567  8358 raft_consensus.cc:2410] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:52.385627  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:52.442523  8362 raft_consensus.cc:1275] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:53.171155  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:53.171622  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 705) took 1676 ms. Trace:
I20260709 13:02:53.171757  8358 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.172016  8362 rpcz_store.cc:276] 0709 13:02:51.495304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.499018 (+  3714us) service_pool.cc:224] Handling call
0709 13:02:51.499281 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.170569 (+1671288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.171412 (+   843us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b5400108e54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:53.171569 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169520384}
I20260709 13:02:52.489001  8363 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:53.174856  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 701) took 2218 ms. Trace:
I20260709 13:02:53.175190  8363 rpcz_store.cc:276] 0709 13:02:50.956962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.482261 (+525299us) service_pool.cc:224] Handling call
0709 13:02:51.482602 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.174213 (+1691611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.174653 (+   440us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001531d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:53.174804 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315255552}
I20260709 13:02:53.176343  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:53.176921  8363 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.470911  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.178565 11988 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.179104  8359 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
W20260709 13:02:53.179663  8359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 718) took 1670 ms (client timeout 2156 ms). Trace:
I20260709 13:02:52.476117  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:52.484054  8365 raft_consensus.cc:2410] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:53.182535  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:52.481341  8367 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
W20260709 13:02:52.364059  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 1.09808e+06us
W20260709 13:02:53.188349  8367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2271) took 1689 ms (client timeout 2088 ms). Trace:
W20260709 13:02:53.188753  8367 rpcz_store.cc:269] 0709 13:02:51.498951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.423649 (+924698us) service_pool.cc:224] Handling call
0709 13:02:53.188172 (+764523us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400050854. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:53.188287 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25362816}
I20260709 13:02:53.189826  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:52.828823  7093 debug-util.cc:398] Leaking SignalData structure 0x7b080030fb00 after lost signal to thread 8331
I20260709 13:02:52.453804  8897 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
W20260709 13:02:53.191715  8897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 879) took 1682 ms (client timeout 2014 ms). Trace:
W20260709 13:02:53.192055  8897 rpcz_store.cc:269] 0709 13:02:51.509098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.509191 (+    93us) service_pool.cc:224] Handling call
0709 13:02:53.191655 (+1682464us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:52.403800 11383 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:53.198525 11383 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:53.199566  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.200520 11383 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:52.483258 11660 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.201943  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.202489  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.202911  8211 raft_consensus.cc:2410] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:53.203085  8218 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:52.381296 11700 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:51.467602 11768 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.206553  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.207155  8212 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.206926 11768 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.207581 11984 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.208179 11984 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.209164 11768 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:53.209717 11768 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:53.210546  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.211079  8209 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.214835  8213 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:02:53.215217  8213 pending_rounds.cc:85] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 5
I20260709 13:02:53.215413  8213 pending_rounds.cc:107] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:53.215626  8213 raft_consensus.cc:2889] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:52.405184 11775 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.217283 11775 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.219512  8212 raft_consensus.cc:2410] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:52.476791 11719 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.220571 11719 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.221352  8212 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:02:53.207212  8358 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:53.221796  8212 pending_rounds.cc:85] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 6
I20260709 13:02:52.488678 11807 raft_consensus.cc:3055] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:53.223899 11807 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:53.224768 11807 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.225356  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.225781 11807 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:52.471822 11878 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:52.364583 11907 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:53.234972  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.235494 11907 raft_consensus.cc:697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:53.235641  8215 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:53.236649  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.236424 11907 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.237347  8215 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:52.508487 11917 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.240832 11917 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:52.405664 11921 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:52.498737 11950 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.243435 11950 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.243893 11950 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.245787 11950 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:51.865185 11969 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:52.414984 11968 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:51.728665 11976 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.039930  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.259485  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.259295 11976 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.261528 11976 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:53.052601  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08001c67a0 after lost signal to thread 7091
I20260709 13:02:53.060683  8115 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 6 to 7, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 7 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:53.263027  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7ea0 after lost signal to thread 8150
I20260709 13:02:53.263162  8115 catalog_manager.cc:5697] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 4 to 6, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 6 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
W20260709 13:02:53.264617  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbc00 after lost signal to thread 8242
W20260709 13:02:53.264896  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbc60 after lost signal to thread 8243
W20260709 13:02:53.265885  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7860 after lost signal to thread 8317
W20260709 13:02:53.094661  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.095808  8314 debug-util.cc:398] Leaking SignalData structure 0x7b080009f8c0 after lost signal to thread 7091
W20260709 13:02:53.269207  8239 debug-util.cc:398] Leaking SignalData structure 0x7b0800384000 after lost signal to thread 8318
W20260709 13:02:53.269536  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb9a0 after lost signal to thread 8331
W20260709 13:02:53.269753  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.097792  8864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.007s	sys 0.006s
I20260709 13:02:53.132606 11925 raft_consensus.cc:3055] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:53.270715  8257 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.603s (SENT) [suppressed 14 similar messages]
I20260709 13:02:53.156872  8332 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:53.270726  8864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.008s	sys 0.006s
I20260709 13:02:53.271301 11383 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.159415 11990 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:53.160375 11985 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:53.271557  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 1.75716e+06us
I20260709 13:02:53.272733 11985 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:53.273684 11985 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.274865  8864 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:53.276981  8864 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:53.277339 11990 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:53.277948 11990 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:53.278247 11917 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.278959 11917 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:53.279299 11917 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.279614 11917 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:53.271649  8314 debug-util.cc:398] Leaking SignalData structure 0x7b0800168760 after lost signal to thread 8150
W20260709 13:02:53.161247  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 771894us
I20260709 13:02:53.162034 11986 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:53.282788 11986 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:53.283356  8314 debug-util.cc:398] Leaking SignalData structure 0x7b08003c16a0 after lost signal to thread 8242
W20260709 13:02:53.283648  8314 debug-util.cc:398] Leaking SignalData structure 0x7b08003c16c0 after lost signal to thread 8243
W20260709 13:02:53.284618  8314 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1900 after lost signal to thread 8317
W20260709 13:02:53.284866  8314 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1920 after lost signal to thread 8318
I20260709 13:02:53.285017 11986 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:53.285897  8314 debug-util.cc:398] Leaking SignalData structure 0x7b080041c3a0 after lost signal to thread 8391
I20260709 13:02:53.286701  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:53.287324  8314 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0920 after lost signal to thread 8922
I20260709 13:02:53.287899  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.288532  8213 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:53.290848  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:53.162480  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:53.163066  8361 raft_consensus.cc:2376] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7. Re-sending same reply.
W20260709 13:02:53.164085  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 759844us
I20260709 13:02:53.168856  8360 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.179160 11988 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.180630 11991 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:53.180960  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 712) took 1682 ms. Trace:
I20260709 13:02:53.292734 11383 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.182822  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 708) took 1685 ms. Trace:
I20260709 13:02:52.417814  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:53.183346  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 1.34771e+06us
W20260709 13:02:53.180006  8359 rpcz_store.cc:269] 0709 13:02:51.508789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.470639 (+961850us) service_pool.cc:224] Handling call
0709 13:02:53.179599 (+708960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.178781 11992 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:53.190821  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:52.458117 11626 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.197185  8363 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:02:53.200778  8216 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:53.204314  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.222025  8212 pending_rounds.cc:107] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:02:52.436560 11856 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.226166  8214 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:53.227118  8218 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:53.228276 11719 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.205829 11700 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.229382  8367 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:53.224112  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:53.238094  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.238503 11984 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.241338 11993 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:52.504926 11965 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.236040 11878 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:53.219651 11775 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:53.088081  8862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.009s
I20260709 13:02:53.265388  8115 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 4 to 6, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 6 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:53.270395 11768 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.147423  8217 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
W20260709 13:02:53.271625  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 114906us
I20260709 13:02:53.157977 11989 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.270092  8239 debug-util.cc:398] Leaking SignalData structure 0x7b0800316f40 after lost signal to thread 8358
I20260709 13:02:53.271709 11925 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:53.271525 11968 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:53.293866  8361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2284) took 1443 ms (client timeout 1764 ms). Trace:
I20260709 13:02:53.332566 11968 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:53.332756  8332 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:53.333101  8361 rpcz_store.cc:269] 0709 13:02:51.850669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.424895 (+574226us) service_pool.cc:224] Handling call
0709 13:02:53.293809 (+868914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.334010 11968 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:53.334203  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.334717  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:53.294322 11986 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:53.335431 11986 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:53.335536 11968 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.335829 11986 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.336892  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:53.337692 11968 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.334856  8361 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:53.338829  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.339895  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.340857  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:53.294653  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 132331us
I20260709 13:02:53.341912  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.302260  8365 rpcz_store.cc:276] 0709 13:02:51.496996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.502155 (+  5159us) service_pool.cc:224] Handling call
0709 13:02:53.182629 (+1680474us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b5400067cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:53.182770 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148784896}
I20260709 13:02:53.305855  8360 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:53.344154  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:53.344259  8360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2275) took 1844 ms (client timeout 1874 ms). Trace:
I20260709 13:02:53.307118  8359 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:02:53.344853  8360 rpcz_store.cc:269] 0709 13:02:51.500047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.385394 (+885347us) service_pool.cc:224] Handling call
0709 13:02:53.344205 (+958811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.345322  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 710) took 1847 ms. Trace:
I20260709 13:02:53.345868  8361 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:53.311534  8212 raft_consensus.cc:2889] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.293020  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:53.320482  8358 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.307603  8362 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:53.344548  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.303092  8366 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:53.311384  8211 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
W20260709 13:02:53.409324  8366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 714) took 1901 ms (client timeout 2034 ms). Trace:
W20260709 13:02:53.325990  8862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.005s	sys 0.009s
W20260709 13:02:53.331317  8239 debug-util.cc:398] Leaking SignalData structure 0x7b0800383cc0 after lost signal to thread 8365
I20260709 13:02:53.345635  8359 rpcz_store.cc:276] 0709 13:02:51.497584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.306561 (+1808977us) service_pool.cc:224] Handling call
0709 13:02:53.306902 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.345052 (+ 38150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.345254 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:53.410763  8239 debug-util.cc:398] Leaking SignalData structure 0x7b080019bca0 after lost signal to thread 8367
W20260709 13:02:53.411401  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08003568a0 after lost signal to thread 8391
W20260709 13:02:53.411890  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08000ced20 after lost signal to thread 8864
I20260709 13:02:53.412035  8211 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:53.412549  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08000408e0 after lost signal to thread 8896
W20260709 13:02:53.412832  8239 debug-util.cc:398] Leaking SignalData structure 0x7b080032be40 after lost signal to thread 8897
I20260709 13:02:53.299031  8364 rpcz_store.cc:276] 0709 13:02:51.498618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.475849 (+977231us) service_pool.cc:224] Handling call
0709 13:02:53.180904 (+705055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.330674  8210 raft_consensus.cc:1240] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:53.331856  8363 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:53.326589  8115 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 6, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 6 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.413269  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.322382  8209 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:53.416515  8211 raft_consensus.cc:2410] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:02:53.409760  8366 rpcz_store.cc:269] 0709 13:02:51.507882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.417594 (+909712us) service_pool.cc:224] Handling call
0709 13:02:53.409257 (+991663us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:53.330379  8217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39866 (request call id 839) took 1896 ms (client timeout 1893 ms). Trace:
I20260709 13:02:53.418220  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.419097  8362 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
W20260709 13:02:53.419863  8217 rpcz_store.cc:269] 0709 13:02:51.433902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.543761 (+109859us) service_pool.cc:224] Handling call
0709 13:02:53.330306 (+1786545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.426191  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.426965  8367 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:53.428234  8367 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:02:53.429167  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2279) took 1928 ms. Trace:
I20260709 13:02:53.429634  8367 rpcz_store.cc:276] 0709 13:02:51.501173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.427662 (+1926489us) service_pool.cc:224] Handling call
0709 13:02:53.427934 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.428931 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.429111 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:53.413389  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6b20 after lost signal to thread 8922
W20260709 13:02:53.432271  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3980 after lost signal to thread 11593
W20260709 13:02:53.432585  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08003d84e0 after lost signal to thread 11626
I20260709 13:02:53.322060 11990 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.436949 12009 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:53.437875 11990 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.431615 11996 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:53.438627 11996 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:53.432900  8239 debug-util.cc:398] Leaking SignalData structure 0x7b080035bbc0 after lost signal to thread 11660
W20260709 13:02:53.441519  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 157951us
I20260709 13:02:53.442272  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2277) took 1941 ms. Trace:
I20260709 13:02:53.442718  8363 rpcz_store.cc:276] 0709 13:02:51.500596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.308795 (+1808199us) service_pool.cc:224] Handling call
0709 13:02:53.309122 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.415283 (+106161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.441943 (+ 26660us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54000c5654. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:53.442189 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51767040}
I20260709 13:02:53.356408  8332 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:53.435392 11907 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:53.437556 12009 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:53.443902  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08001afa60 after lost signal to thread 11719
I20260709 13:02:53.434585  8331 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:53.435312  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.434840 11992 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:53.442315  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.308362 11626 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:53.446969  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.306712 11383 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:53.447371  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 154515us
I20260709 13:02:53.467594  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:53.451759  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:53.448648  8184 connection.cc:256] RPC call timeout handler was delayed by -1.099109435999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 13:02:53.449007  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 103438us
I20260709 13:02:53.452149  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:53.448385  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 177768us
I20260709 13:02:53.469480  8183 leader_election.cc:400] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9.
I20260709 13:02:53.469842  8183 leader_election.cc:403] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:53.444658  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.452943  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.299890 11988 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.299150 11976 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.443943 11994 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:53.312176 11856 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:53.316745 11719 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.324694 11965 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:53.476464  8363 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:53.476794  8184 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:53.477954  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 713) took 1970 ms. Trace:
W20260709 13:02:53.454316  8239 debug-util.cc:398] Leaking SignalData structure 0x7b080029d280 after lost signal to thread 11731
I20260709 13:02:53.454118  8358 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:53.458105  8115 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 2 to 5, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 5 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:53.332294 11969 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 13:02:53.327615 11768 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:53.303339 11950 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.459928  8360 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:02:53.454698  8213 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:02:53.460306  8331 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:53.461899  8367 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:53.321228 11917 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.485069  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 715) took 1977 ms. Trace:
I20260709 13:02:53.463032  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.418682 11878 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:53.472029  8365 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:53.473985  8359 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:53.487588  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2280) took 1986 ms. Trace:
I20260709 13:02:53.471652  8257 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:53.475454  8259 connection.cc:256] RPC call timeout handler was delayed by -1.3172246559999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30600000000000005s for a response
W20260709 13:02:53.478626  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0c00 after lost signal to thread 11768
I20260709 13:02:53.478320  8363 rpcz_store.cc:276] 0709 13:02:51.507646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.461165 (+1953519us) service_pool.cc:224] Handling call
0709 13:02:53.476179 (+ 15014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.477732 (+  1553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.477903 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:53.488409  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08004145c0 after lost signal to thread 11791
W20260709 13:02:53.488739  8239 debug-util.cc:398] Leaking SignalData structure 0x7b080022f4e0 after lost signal to thread 11836
W20260709 13:02:53.489133  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08004144a0 after lost signal to thread 11867
I20260709 13:02:53.298903 11991 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.479465  8364 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:53.457171 11968 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:53.317032 11700 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.480811  8366 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:53.484459  8360 pending_rounds.cc:85] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 7
I20260709 13:02:53.453382 12004 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.475907 11995 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:53.482060  8183 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:53.331835 11925 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.487665  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2283) took 1637 ms. Trace:
W20260709 13:02:53.449599  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 93339.7us
I20260709 13:02:53.485411  8367 rpcz_store.cc:276] 0709 13:02:51.508117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.461499 (+1953382us) service_pool.cc:224] Handling call
0709 13:02:53.461700 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.484720 (+ 23020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.485016 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.487994  8365 rpcz_store.cc:276] 0709 13:02:51.501465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.449316 (+1947851us) service_pool.cc:224] Handling call
0709 13:02:53.471677 (+ 22361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.487371 (+ 15694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.487541 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.489866 11968 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.484489 11985 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9.
I20260709 13:02:53.479269  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 711) took 1981 ms. Trace:
I20260709 13:02:53.490372  8360 pending_rounds.cc:107] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:02:53.508436  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:53.490446  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 720) took 1973 ms. Trace:
I20260709 13:02:53.332149 11987 consensus_queue.cc:1059] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.145s
I20260709 13:02:53.492520  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 719) took 1983 ms. Trace:
I20260709 13:02:53.474663 11921 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:53.492599  8259 connection.cc:256] RPC call timeout handler was delayed by -1.2566285450000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:02:53.474499 11993 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:53.518263 11993 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.489749 11991 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.518690 11993 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.491858 11950 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.519179 11994 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.519600 11994 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.494771 11775 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:53.493263 11768 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:53.520823 11991 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.521029 11775 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.510571 11968 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.471169 11626 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.506978 11719 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:53.522477 11719 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.522832 11719 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.524017 11626 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.525733 11917 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.484745 12008 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.489288  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 51376.8us
W20260709 13:02:53.489387  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08004144e0 after lost signal to thread 11870
I20260709 13:02:53.331255 11989 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.510902  8360 raft_consensus.cc:2889] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.506528  8359 rpcz_store.cc:276] 0709 13:02:51.850422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.473678 (+1623256us) service_pool.cc:224] Handling call
0709 13:02:53.473869 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.487477 (+ 13608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.487621 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.486313 11907 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:53.510830  8358 rpcz_store.cc:276] 0709 13:02:51.497862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.223838 (+1725976us) service_pool.cc:224] Handling call
0709 13:02:53.479221 (+255383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.511155  8366 rpcz_store.cc:276] 0709 13:02:51.516814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.473244 (+1956430us) service_pool.cc:224] Handling call
0709 13:02:53.477852 (+  4608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.490217 (+ 12365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.490395 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.512907  8364 rpcz_store.cc:276] 0709 13:02:51.509029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.463175 (+1954146us) service_pool.cc:224] Handling call
0709 13:02:53.479348 (+ 16173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.489800 (+ 10452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.492468 (+  2668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.507158 11996 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:53.480139 11976 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.493618 11965 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:53.514957  8259 connection.cc:256] RPC call timeout handler was delayed by -1.2021761529999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 13:02:53.514662  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:53.489952 11992 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.492017 11878 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.494828 11660 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:53.521667 11775 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.494163  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:53.490506 11990 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:53.554112 11925 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:53.520812 11950 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.527930  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.478997 11383 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.534960  8115 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 5 to 8, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 8 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:53.536867  8239 debug-util.cc:398] Leaking SignalData structure 0x7b08004144c0 after lost signal to thread 11871
I20260709 13:02:53.539047  8359 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:53.547305  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 84779.2us
I20260709 13:02:53.564409  8863 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:53.561012  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2281) took 2059 ms. Trace:
I20260709 13:02:53.580753  8363 raft_consensus.cc:2376] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10. Re-sending same reply.
W20260709 13:02:53.555220  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 73265.3us
W20260709 13:02:53.627041  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 133028us
I20260709 13:02:53.583611 11719 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.498600 12004 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.637472  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.637768  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.619992 12019 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:53.508077 12010 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:02:53.619752  8259 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:53.623318  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 115011us
I20260709 13:02:53.625994  8364 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:02:53.493760 11988 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.583256 11921 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.629884  8360 rpcz_store.cc:276] 0709 13:02:51.501774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.459269 (+1957495us) service_pool.cc:224] Handling call
0709 13:02:53.459587 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.560746 (+101159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.560950 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:53.628573  8239 debug-util.cc:398] Leaking SignalData structure 0x7b0800414580 after lost signal to thread 11879
W20260709 13:02:53.645887  8239 debug-util.cc:398] Leaking SignalData structure 0x7b0800414520 after lost signal to thread 11917
W20260709 13:02:53.646211  8239 debug-util.cc:398] Leaking SignalData structure 0x7b0800414340 after lost signal to thread 11925
W20260709 13:02:53.646533  8239 debug-util.cc:398] Leaking SignalData structure 0x7b0800414420 after lost signal to thread 11954
I20260709 13:02:53.629159  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1838) took 1205 ms. Trace:
W20260709 13:02:53.627043  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 118814us
W20260709 13:02:53.633960  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 147145us
I20260709 13:02:53.556298 11968 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.635229 11987 raft_consensus.cc:3055] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:53.635809  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.635952  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.636711  8214 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:53.637449  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:53.624152  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 156709us
I20260709 13:02:53.538388 11985 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:02:53.639060  8115 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:02:53.642778  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 78474.1us
I20260709 13:02:53.616962 11989 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.638247 11626 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:53.617933 12009 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:53.626319 12006 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.507474 11995 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.666159  8331 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:53.672472  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:53.650863  8359 rpcz_store.cc:276] 0709 13:02:52.423660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.538553 (+1114893us) service_pool.cc:224] Handling call
0709 13:02:53.538868 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.628929 (+ 90061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.629110 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:53.618798 11996 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:02:53.664996  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:53.618692 11965 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:53.644170  8332 leader_election.cc:400] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:53.665228  8213 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:53.623358 12021 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:53.665876  8864 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:53.632793 11383 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.666415  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.695503  8115 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:02:53.684315  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.662815 12015 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:53.666707 12022 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:53.705698  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 63881.7us
I20260709 13:02:53.719308  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:53.706377  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:53.720257  8365 raft_consensus.cc:2376] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9. Re-sending same reply.
I20260709 13:02:53.699584  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:53.721288  8359 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:53.701308  8366 raft_consensus.cc:2376] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7. Re-sending same reply.
I20260709 13:02:53.554097 12008 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.694902 11626 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:53.703218  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.668329 11987 raft_consensus.cc:740] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:53.710482  8218 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:53.617255 11969 consensus_queue.cc:1059] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:53.707967 11991 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:53.713414 11995 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.713346  8115 catalog_manager.cc:5697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:53.696977 12020 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:02:53.723114  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 56147.8us
I20260709 13:02:53.663117 12005 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.707692  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2282) took 2205 ms. Trace:
W20260709 13:02:53.726819  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.702188 11990 raft_consensus.cc:697] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:53.704699 12023 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:53.728950  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.734058  8285 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:53.735517  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:53.738159  8257 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:53.723410 12026 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:53.674453 11917 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:02:53.743506  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:53.744541  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.746729  8293 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:02:53.747352  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:53.747915  8287 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.722507 12022 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.695562 12012 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:02:53.748869  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:53.744098  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.751531  8291 raft_consensus.cc:2368] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:53.737478  8362 rpcz_store.cc:276] 0709 13:02:51.502092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.459563 (+1957471us) service_pool.cc:224] Handling call
0709 13:02:53.459863 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.475085 (+ 15222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.475115 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.478521 (+  3406us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.620960 (+142439us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:53.624646 (+  3686us) log.cc:844] Serialized 14 byte log entry
0709 13:02:53.707416 (+ 82770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.707486 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.707529 (+    43us) raft_consensus.cc:1685] finished
0709 13:02:53.707540 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.707646 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2396,"prepare.queue_time_us":1545,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":13104,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4816,"spinlock_wait_cycles":9421056,"thread_start_us":204914,"threads_started":2,"wal-append.queue_time_us":134777}
I20260709 13:02:53.753957  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.708401 11907 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:02:53.695904 11856 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.704093 11988 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.675077 12011 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:02:53.734371 11626 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.762527  8286 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:53.705180 12009 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:02:53.769897  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:53.791209  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 52395.9us
W20260709 13:02:53.794958  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.795039  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:53.724568 11984 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:02:53.747254 12026 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.742483 12023 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:53.746205 11991 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:53.778440 11700 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:53.842990  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 168273us
I20260709 13:02:53.843315  8367 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:53.701666 12006 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.741133 11950 consensus_queue.cc:1059] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:02:53.763154 12022 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.728438 12017 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:02:53.843806  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:53.816922  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 78874.7us
I20260709 13:02:53.848424  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:53.849339  8862 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:53.779129 11969 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:02:53.867347  8293 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:53.852020  8286 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 6.
I20260709 13:02:53.871179  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.871850  8286 raft_consensus.cc:2393] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:53.853603  8287 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
W20260709 13:02:53.846027 11986 consensus_meta.cc:287] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:02:53.806454 11999 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:53.851269  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.879268  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.872164  8259 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:53.843683 12024 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.846506 12023 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.876392  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.870491  8285 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:53.877167  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:53.877878  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.878278  8257 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:53.844892 12026 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:53.880151  8287 raft_consensus.cc:2393] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:53.856058 12010 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.855506 11660 raft_consensus.cc:3055] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:53.891566  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 96670.2us
I20260709 13:02:53.892405  8864 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:53.892894  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.867367 11878 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:53.867949 11719 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.895522  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:53.896310  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:53.870340 11976 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.881693 11986 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.916311 12024 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.916173 11991 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.890640 12012 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.919941  8286 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.879158 11999 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.841931 11965 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.866474 12032 consensus_queue.cc:1048] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:02:53.887159 11700 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.930806  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.896597 11950 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:53.958424 11950 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:53.958876 12006 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:53.960054 12029 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:02:53.959498 11950 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.960568  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1835) took 1537 ms. Trace:
I20260709 13:02:53.960950  8367 rpcz_store.cc:276] 0709 13:02:52.422935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.508515 (+1085580us) service_pool.cc:224] Handling call
0709 13:02:53.509774 (+  1259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.849254 (+339480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.960310 (+111056us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54001f7a54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:53.960507 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767013248}
I20260709 13:02:53.964918  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.968312  8291 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:53.969731  8291 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:53.970367 12037 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:53.970731  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:53.971483  8284 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:53.971966 12037 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:53.929246  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.972545  8284 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:53.972975 11993 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.924232 11878 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:53.974005 11878 raft_consensus.cc:697] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:53.959749  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:53.975409  8285 raft_consensus.cc:2410] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:53.975097 11878 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.973832  8284 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:53.943980 11856 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.891010 11660 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:53.977205 11660 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.945791  8212 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:53.978405 11660 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:53.982363 12004 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.983033 12004 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:53.983394 12004 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.983727 12004 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.987305 11986 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:53.945672  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 57355.2us
I20260709 13:02:53.924096 12010 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.959518 12006 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:53.988883 12006 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:53.988724 12010 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.989390 11988 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.990231 11383 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.989904 12006 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.991370 12010 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:53.919354 11968 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:53.993773  8863 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:53.994419  8286 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:02:53.974093  8361 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:54.014771  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:54.026345  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2cc0 after lost signal to thread 7088
W20260709 13:02:54.026849  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5400 after lost signal to thread 7091
W20260709 13:02:54.027843  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08003684a0 after lost signal to thread 8150
W20260709 13:02:54.028816  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2c40 after lost signal to thread 8216
W20260709 13:02:54.029095  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2d00 after lost signal to thread 8217
W20260709 13:02:54.029641  8919 debug-util.cc:398] Leaking SignalData structure 0x7b080032b940 after lost signal to thread 8242
W20260709 13:02:54.029882  8919 debug-util.cc:398] Leaking SignalData structure 0x7b080009d080 after lost signal to thread 8243
W20260709 13:02:54.031004  8919 debug-util.cc:398] Leaking SignalData structure 0x7b080033bca0 after lost signal to thread 8317
W20260709 13:02:54.031316  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08003242a0 after lost signal to thread 8318
W20260709 13:02:54.032346  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08003fb020 after lost signal to thread 8391
W20260709 13:02:54.032160  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 160142us
I20260709 13:02:54.044332  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.015501  8218 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
W20260709 13:02:54.049365  8919 debug-util.cc:398] Leaking SignalData structure 0x7b0800374d40 after lost signal to thread 8922
W20260709 13:02:54.054797  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 424134us
I20260709 13:02:53.874807 11990 consensus_queue.cc:237] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:53.846428 11987 consensus_queue.cc:260] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.056257  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:54.057389  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1f40 after lost signal to thread 11768
W20260709 13:02:54.061615  8919 debug-util.cc:398] Leaking SignalData structure 0x7b0800348a80 after lost signal to thread 11969
W20260709 13:02:54.057060  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 63408.6us
W20260709 13:02:54.057910  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 393756us
I20260709 13:02:53.933743 11719 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:53.946096 11999 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.060114  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:54.061944  8919 debug-util.cc:398] Leaking SignalData structure 0x7b08002f64a0 after lost signal to thread 11976
W20260709 13:02:54.062536  8332 connection.cc:256] RPC call timeout handler was delayed by -2.1761275180000439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:02:54.063259  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:54.064246  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.075271  8184 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:54.064656  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.066874  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:54.077461  8332 connection.cc:256] RPC call timeout handler was delayed by -1.92642970899999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:02:54.065752  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:54.066125  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:54.067546  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:54.115834  8257 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:54.116360  8215 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:54.115619  8895 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:54.015200 11700 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.103820 11987 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.065675  8894 raft_consensus.cc:1240] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:54.104507  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.125557  8285 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:54.094499  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.071245 11719 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:54.049901 11383 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:54.092693  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.100157 11917 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.078464  8863 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:54.073181  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.076332  8184 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:54.155956  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 79725.4us
I20260709 13:02:54.156292  8286 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 13: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:54.156731  8184 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:54.158191  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 65612.8us
I20260709 13:02:54.083024  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.082604  8890 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:54.159521  8259 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:54.082830  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:54.090543  8893 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:54.072794 11856 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.083544 11989 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:54.059091 11996 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.101526 12005 raft_consensus.cc:3055] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:54.100970 12017 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:54.089535 12010 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:54.072531 11660 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.117077  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:54.069226 11986 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:02:54.069368  8862 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:54.202556  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 133339us
I20260709 13:02:54.070675  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.080066 12019 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:02:54.056560 11994 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:53.934813 12024 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.149941  8894 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:02:54.113161 12031 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:54.160281  8367 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:02:54.160352  8259 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:54.080332 12028 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:02:54.165117  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.103667 11775 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:54.171558  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 93209.9us
I20260709 13:02:54.119980 12008 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:54.223004  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 62773us
I20260709 13:02:54.224005  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.190245 11807 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:54.189091  8895 raft_consensus.cc:1240] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:54.151494 11719 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:54.201470  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.202766 12041 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.203830  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:54.212028  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 95078.7us
I20260709 13:02:54.153554 11917 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:54.216184  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.216635  8863 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:54.184391 11992 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:54.103003 12027 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
W20260709 13:02:54.237147  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 343061us
I20260709 13:02:54.223980 12034 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:54.265815  8290 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:54.173586 12005 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:54.202096  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:54.211145 11878 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:54.281548  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 65034.5us
I20260709 13:02:54.285094 11992 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:54.281200  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.280973  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 77248.5us
W20260709 13:02:54.286227  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.215758 12031 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:54.190884 11856 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.316488 11991 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.352308  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:54.281255  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:54.206635 12047 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:54.212450 12046 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:54.363934 12046 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.364468 12046 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.252877 11807 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.366312 11807 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.366564 12012 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.328840  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.328066  8360 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:54.266319 11983 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.329298 11383 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:54.367199 12012 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.371707  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:54.334227  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.374279 12012 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:54.334542  8367 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:54.335532  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.275781 11950 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.339180  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:54.374368  8365 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.277021  8213 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:54.230646 12009 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:02:54.379199 12009 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.212553 11660 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.285779 12010 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:54.341650  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 271225us
I20260709 13:02:54.301640 12011 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:54.383345 12011 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:54.384750  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.385012  8286 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:54.384447 12011 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.383605  8361 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:54.370652  8366 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:54.383296 12010 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:54.387398 12010 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.389549 12010 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:54.390326  8292 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:02:54.390447 11660 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:54.392556 12046 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:54.393729 12046 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:54.394965 12009 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.396179  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.397547  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:54.398645  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.400487  8292 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:54.401872  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.404071  8292 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:54.409473  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.413002  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:54.406553  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.408128  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.404851 12010 raft_consensus.cc:3055] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:54.418212 12010 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:54.420018 12010 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.420481  8183 connection.cc:256] RPC call timeout handler was delayed by -2.928268183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 13:02:54.426975 11660 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:54.427618 11660 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:54.428877 11660 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.319569 12034 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.329078 12032 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:54.442657  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.444512 12015 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:54.352638 11992 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.459793  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.284904 11921 consensus_queue.cc:1059] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:02:54.460711  8291 raft_consensus.cc:2410] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:54.331275 11993 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:54.452468  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:54.455252  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.275110 12025 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.221s
I20260709 13:02:54.475629  8365 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:02:54.450773 12053 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:54.498749 12053 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.500630  8209 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:54.501185 12053 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:54.352922 12031 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.355155 12014 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:54.328868 11989 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:54.503219 11989 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.451821  8863 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:54.461659 12015 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:54.506492  8183 connection.cc:256] RPC call timeout handler was delayed by -2.1886948729999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
I20260709 13:02:54.422983 12010 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:54.511780  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:54.511875  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:54.455319 12034 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:54.511427  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:54.533870  8215 raft_consensus.cc:2393] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 6: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:02:54.559199  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 107590us
I20260709 13:02:54.561435  8183 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:54.427623  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 146479us
I20260709 13:02:54.565960 11660 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:54.568208 11660 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:54.569116 11993 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:54.569528 11993 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:54.569913  8332 leader_election.cc:400] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:54.570323 11993 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.454811 12047 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:54.583201  8894 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: [7.8-11.10]
I20260709 13:02:54.570314  8332 leader_election.cc:403] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:54.490350 12017 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:54.591289 12053 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:54.517041 11856 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:54.550384 12014 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.475780 11986 consensus_queue.cc:1059] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:02:54.458491 11991 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.479157 12038 consensus_queue.cc:1059] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.478s
I20260709 13:02:54.600236  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:54.595254 12054 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:02:54.576340 12048 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:54.598650 12035 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.476s	user 0.001s	sys 0.000s
I20260709 13:02:54.588222 12009 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.637928  8894 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:54.598055 12063 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:54.604089 11921 raft_consensus.cc:3055] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:54.614928 12053 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.461710 11917 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.511546 11807 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.638695 12006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.010s	sys 0.000s
W20260709 13:02:54.654469  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 84739.3us
I20260709 13:02:54.641245 11993 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.659276  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:54.621166 11990 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:02:54.666703  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:54.661682 12045 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:02:54.657003 12053 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.656770 11775 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.661877 11856 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9.
I20260709 13:02:54.664742 12024 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:54.657893 12006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.010s	sys 0.000s
I20260709 13:02:54.653829 11921 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:54.653508 11700 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:54.680632  8898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.001s	sys 0.013s
I20260709 13:02:54.670275 11994 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:54.677868  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:54.732304  8894 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:54.549970 12005 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.672204 12026 consensus_meta.cc:287] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.753s	user 0.007s	sys 0.003s
W20260709 13:02:54.692016  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.752679  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2285) took 1468 ms. Trace:
W20260709 13:02:54.748939  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.673621 12022 consensus_meta.cc:287] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.009s
I20260709 13:02:54.648350 12028 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:02:54.661125 12071 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.682909  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:54.704658 12055 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
W20260709 13:02:54.798588 12064 log.cc:927] Time spent T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:02:54.679288 12044 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:54.705469 12062 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:02:54.800573 11768 raft_consensus.cc:3055] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:54.801066 11768 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:54.801959 11768 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.804950 11719 consensus_meta.cc:287] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.000s
I20260709 13:02:54.756333 11994 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.805779 11994 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.806603  8209 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:54.443511 11907 consensus_queue.cc:1175] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ee13752324154b1293a47c9dcd8d6ba5" responder_term: 6 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:54.808357  8258 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.808519 11994 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:54.706086 12061 log.cc:927] Time spent T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:02:54.707094 11925 consensus_meta.cc:287] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.078s	user 0.009s	sys 0.001s
W20260709 13:02:54.809674 11996 consensus_meta.cc:287] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 13:02:54.809855  8897 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:54.810258 12031 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:54.740432 12004 consensus_meta.cc:287] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.002s
I20260709 13:02:54.811472 12004 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.812351 12031 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.812906 12011 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.813486 12004 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:54.813397 12011 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.708343 12052 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:02:54.711561 11626 consensus_meta.cc:287] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.867s	user 0.004s	sys 0.004s
I20260709 13:02:54.814445 11626 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.814672 12044 consensus_queue.cc:1059] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:54.752817 12047 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.815551 12044 raft_consensus.cc:3055] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:54.773617 12026 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.816521 11626 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.634864 12014 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.816776  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:54.818413 12014 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.818565 12071 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.819145  8289 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:54.820727 12071 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:54.719166  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 132473us
I20260709 13:02:54.773087 11985 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:54.821478 11985 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:54.822050  8365 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:54.677546  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:54.724344  8898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.001s	sys 0.013s
W20260709 13:02:54.823308  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.724841  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:54.728540 11991 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.685513 12050 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:02:54.730646 12058 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:54.678825 11965 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:54.679196 11917 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.723811 12038 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.707144 11807 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:54.678694 12063 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:54.734393 12068 raft_consensus.cc:3055] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:54.749015 11921 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.750327 11987 consensus_meta.cc:287] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.003s
I20260709 13:02:54.686730 12017 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.648761 12048 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.694450  8288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.013s
W20260709 13:02:54.756769  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.855021 12041 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:54.772773  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 208554us
I20260709 13:02:54.794386 11383 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:54.795074  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.854305 12038 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:54.745558 12023 consensus_meta.cc:287] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.850s	user 0.011s	sys 0.000s
W20260709 13:02:54.706368 12056 log.cc:927] Time spent T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:02:54.816202  8286 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:54.653720 12009 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.821049  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 2228) took 1092 ms. Trace:
I20260709 13:02:54.825289  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:54.825951  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:54.826524  8367 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:54.864759 11991 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.835090  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.888298  8289 rpcz_store.cc:276] 0709 13:02:53.729094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.729480 (+   386us) service_pool.cc:224] Handling call
0709 13:02:54.820835 (+1091355us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540047d954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:54.820967 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429657344}
I20260709 13:02:54.890492  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:54.891130  8892 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:54.835734  8364 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:02:54.836172 12079 log.cc:927] Time spent T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:02:54.838177 12005 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:54.839521 12053 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.840634 12074 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:02:54.840940  8891 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:02:54.792411 12022 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.844065 11992 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:54.792209 11999 consensus_meta.cc:287] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.699s	user 0.006s	sys 0.004s
I20260709 13:02:54.822336 11985 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.832922 11996 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:54.845577 12050 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.847075  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:54.848869  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 171465us
I20260709 13:02:54.849023 12024 raft_consensus.cc:2764] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:02:54.850729  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.909498  8896 raft_consensus.cc:1240] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:54.851608  8864 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.851961  8214 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:54.806711 12069 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.854557  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.826890 12044 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:54.877748  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.877689  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.753095  8358 rpcz_store.cc:276] 0709 13:02:53.284755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.584493 (+299738us) service_pool.cc:224] Handling call
0709 13:02:53.627852 (+ 43359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:53.883300 (+255448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.883328 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:53.918985 (+ 35657us) log.cc:844] Serialized 52 byte log entry
0709 13:02:54.083839 (+164854us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:54.286116 (+202277us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.287033 (+   917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.287126 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.752461 (+465335us) raft_consensus.cc:1685] finished
0709 13:02:54.752479 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.752623 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10336,"prepare.queue_time_us":106784,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4981,"raft.queue_time_us":61148,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":19852,"thread_start_us":520838,"threads_started":3,"wal-append.queue_time_us":222255}
I20260709 13:02:54.795730 11878 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:54.858810 12068 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:02:54.885525 12076 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
I20260709 13:02:54.858446 11965 raft_consensus.cc:697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:54.834262 11719 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:54.888552  8288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.009s	sys 0.013s
I20260709 13:02:54.888959  8210 raft_consensus.cc:2410] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:54.817837 12026 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.891896  8364 pending_rounds.cc:85] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 6
I20260709 13:02:54.892854  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:54.892887  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.936025  8367 raft_consensus.cc:2410] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:54.877539 11921 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:54.882313 12041 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.894548  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:54.883683 11383 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.940898  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.941354  8892 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:54.892433 11768 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:54.942698 12087 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:54.903858  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:54.905047  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.921211 11987 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:02:54.947630 12014 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:54.948096 12014 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.948424 12014 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.928118 12021 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:02:54.950371  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:54.906843 11999 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.950713  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:54.951227 12082 log.cc:927] Time spent T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:02:54.951386  8890 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:02:54.951771  8287 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:54.952354  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.952534  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:54.911162  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 59674.2us
I20260709 13:02:54.952910  8890 raft_consensus.cc:2376] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10. Re-sending same reply.
I20260709 13:02:54.953079  8366 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:54.953852  8864 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.955392  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.887705 11807 consensus_queue.cc:1059] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:02:54.956334 11807 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.956684 11807 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:54.956809 11992 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.911510  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:54.958572 12081 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:54.952888 11999 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:54.961215 12068 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.962607 12068 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:54.940627 12088 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 13:02:54.964995  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:54.965636  8358 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:54.966189  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2373) took 1301 ms. Trace:
I20260709 13:02:54.966588  8216 rpcz_store.cc:276] 0709 13:02:53.665041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.665172 (+   131us) service_pool.cc:224] Handling call
0709 13:02:53.665469 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.149272 (+483803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.149341 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.205073 (+ 55732us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.680815 (+475742us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:54.680848 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.680917 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.812497 (+131580us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:54.965882 (+153385us) raft_consensus.cc:1685] finished
0709 13:02:54.965903 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.966124 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51256,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3146,"spinlock_wait_cycles":19072384,"thread_start_us":829272,"threads_started":2,"wal-append.queue_time_us":520434}
I20260709 13:02:54.952888  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 870) took 1083 ms. Trace:
I20260709 13:02:54.968446  8287 rpcz_store.cc:276] 0709 13:02:53.869127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.973239 (+104112us) service_pool.cc:224] Handling call
0709 13:02:53.973575 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.952139 (+978564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.952657 (+   518us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b540028e954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:54.952827 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250201984}
I20260709 13:02:54.969619  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.940824 12041 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.971808  8895 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:54.973187  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.975579 12053 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:54.966497  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.976302 12053 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:54.888288 11994 consensus_queue.cc:1059] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:02:54.893397 12028 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:02:54.918773  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.920317  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:54.920533 11983 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:02:54.977391 12048 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:54.976539 11996 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:54.976788  8358 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:54.930001  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.895684 12019 consensus_queue.cc:1059] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:02:54.977679  8898 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.979425 12019 raft_consensus.cc:3055] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:54.979782 12019 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:54.980113  8285 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:54.980541 12019 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.981117 12009 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.981779 12019 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.933413  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:54.934563 12070 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.167s	user 0.000s	sys 0.003s
I20260709 13:02:54.994719  8210 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:54.994906  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:54.995241  8209 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:54.935371  8364 pending_rounds.cc:107] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:02:54.995769  8364 raft_consensus.cc:2889] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:54.935465  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:54.916076 12058 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.906729 12050 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:54.941210  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.895138  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.938323 11985 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.002636  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.945920  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.907998  8897 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:54.958462  8361 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:54.982895 11719 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:55.004730  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 109736us
I20260709 13:02:54.976365 12011 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.976162 11925 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:54.977311 11994 raft_consensus.cc:3055] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:54.888561 12023 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.895541 11991 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:55.015502  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:55.016294 11984 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:55.016678 11984 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.016769 11991 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:55.017073 11984 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.977746 12028 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:55.017619 12028 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:55.018472 12028 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.019728 12028 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.928637 12069 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:54.982997  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:55.023056  8291 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:55.023914  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.983337 12034 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:55.025024 12072 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.287s	user 0.003s	sys 0.000s
I20260709 13:02:54.983727  8892 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:54.983525 11965 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.975754 11383 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:54.982208  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:54.984269 12044 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.031005  8893 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:02:54.985986  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2229) took 1256 ms. Trace:
I20260709 13:02:54.915407  8365 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.986591  8864 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.971140  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:54.953897  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:54.924896  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.990826  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:54.987783  8184 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:55.037784  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 50079.9us
I20260709 13:02:55.039592  8332 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:54.991815  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.041160  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:55.036760  8363 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:55.043576  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 57093us
I20260709 13:02:54.991881  8898 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:55.044430  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:54.953789  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:54.995453  8293 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:55.001914  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:54.914480  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:55.047681  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 133334us
I20260709 13:02:55.048635  8365 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:55.003484  8894 raft_consensus.cc:2410] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:55.004035  8895 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:55.049860  8184 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:54.955628 12022 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:54.911739 12063 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:55.012603  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:55.012763  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:55.013382  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:54.909221 12038 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.014052  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:54.933691 12043 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:55.027812  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:55.028878  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.010123 11994 raft_consensus.cc:740] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:55.031827  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:55.030929  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.036831  8366 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:55.049604  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:55.004557 12048 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:55.064320 12048 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:55.046830  8359 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:55.055632  8285 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:02:55.064659  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.065675  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:55.065860  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.066789  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:55.067860  8359 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:55.066748  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:55.055764  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:55.033655  8288 rpcz_store.cc:276] 0709 13:02:53.729926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.736736 (+  6810us) service_pool.cc:224] Handling call
0709 13:02:53.755202 (+ 18466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.058490 (+303288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.058522 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.083496 (+ 24974us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.932653 (+849157us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:54.932696 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.932763 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.985797 (+ 53034us) raft_consensus.cc:1685] finished
0709 13:02:54.985816 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.985933 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8061,"raft.queue_time_us":46581,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":39046,"thread_start_us":1043661,"threads_started":2,"wal-append.queue_time_us":697019}
I20260709 13:02:55.055591  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.069593  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:55.070179  8895 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.070557  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.071105  8898 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.060340  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.058182  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:55.072877  8897 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.071163  8890 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:55.072821  8893 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:02:55.073318  8363 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:55.023056 12069 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:55.075958 11993 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:54.977447 11807 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.076740  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.122638  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.063479  8258 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:55.083184  8895 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:55.062661 11660 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:55.057835 11878 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:02:55.094271  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:55.052225 12011 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:02:55.098930  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:55.136792  8361 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:55.066094  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:55.138819  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 72862.2us
I20260709 13:02:55.139099  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:55.140373  8364 raft_consensus.cc:2393] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 7: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:55.100210  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.141052  8894 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:55.100481  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:55.100612  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:55.129865  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:55.054723 11768 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:55.051993 11987 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.053964 11991 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.052785 11719 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.153522  8365 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:02:55.054929 11700 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:55.123966  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 60594.7us
I20260709 13:02:55.067224 12048 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.133643  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.134408  8366 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:02:55.163237  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.186800  8889 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:55.187321  8363 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:55.132082 11999 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.077951 12044 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.185190  8893 raft_consensus.cc:2376] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8. Re-sending same reply.
W20260709 13:02:55.196764  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 57800.9us
I20260709 13:02:55.132928 11660 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.142689  8359 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:02:55.144150  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:55.152504 11985 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:55.144968  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 104058us
I20260709 13:02:55.078183 12025 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:55.142598  8293 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
I20260709 13:02:55.056391 12053 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:02:55.058647 12047 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:55.189602  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:55.185860  8366 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:55.185667 12024 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.191352  8258 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:55.126384 12017 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:02:55.140103 11878 consensus_queue.cc:1243] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:55.142140  8897 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:55.144572  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:55.173718 11807 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.230902  8259 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:55.232043  8364 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:55.234377  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:55.253547  8212 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.235111  8214 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:02:55.254314  8214 pending_rounds.cc:85] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 4
I20260709 13:02:55.254411  8215 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:55.254753  8215 pending_rounds.cc:85] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 9
I20260709 13:02:55.255004  8215 pending_rounds.cc:107] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:55.236564  8895 raft_consensus.cc:1240] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:55.235729 11383 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.185187 11700 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.238049 11719 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.300206  8212 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
W20260709 13:02:55.243950  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.243072  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 202078us
W20260709 13:02:55.223783 12015 consensus_meta.cc:287] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
I20260709 13:02:55.247589  8894 raft_consensus.cc:2393] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 7: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:55.244866  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:55.153824  8361 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:02:55.304379  8361 pending_rounds.cc:85] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 10
I20260709 13:02:55.304616  8361 pending_rounds.cc:107] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:02:55.304893  8361 raft_consensus.cc:2889] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:55.245860  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 54618.4us
I20260709 13:02:55.250139  8890 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 9: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:55.253979  8259 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:55.255621  8214 pending_rounds.cc:107] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:02:55.088822  8898 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:55.255270  8215 raft_consensus.cc:2889] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:55.182629 12032 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:02:55.252475 11991 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:55.190050 12061 log.cc:927] Time spent T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:02:55.319115  8863 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:55.238325 11985 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.238479 12025 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.240470 11660 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.174320 11987 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.302027  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:55.303066  8893 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:55.307426  8894 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:55.304117  8366 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.305755  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:55.308007  8898 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:02:55.306766  8214 raft_consensus.cc:2889] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:55.257838  8897 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:55.078497 12050 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.314275  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:55.313769  8890 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:55.324465 12078 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.585s	user 0.003s	sys 0.000s
I20260709 13:02:55.326548 11917 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:55.250547 12024 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:55.330765  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 76892.8us
I20260709 13:02:55.335024  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:55.315903 11991 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:02:55.336012 12110 log.cc:927] Time spent T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:02:55.252152 12068 consensus_queue.cc:1059] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:02:55.259326 12034 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.182725 11994 consensus_queue.cc:260] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.296200 11700 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.307269 12021 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:02:55.418958  8365 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:55.340219  8284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 873) took 1340 ms. Trace:
I20260709 13:02:55.381342 11950 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:55.372536  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 70613.4us
I20260709 13:02:55.328408 12089 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:55.374722  8285 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:55.304157 11999 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:55.375447  8361 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:55.375633  8898 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:55.380929  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 75294.2us
I20260709 13:02:55.380942  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:55.381237  8364 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.429255  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:55.430418  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.384044  8894 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:55.429306  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 48456.7us
I20260709 13:02:55.389226  8366 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:55.333276 11985 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.338737 12025 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.391598  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:55.393129  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:55.339444 11383 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:55.246229  8889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:02:55.381258 11991 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.260860 12047 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:55.341822  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:55.311939 12015 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.419575  8284 rpcz_store.cc:276] 0709 13:02:54.000107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.000352 (+   245us) service_pool.cc:224] Handling call
0709 13:02:54.059829 (+ 59477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.259267 (+199438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.259305 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.276036 (+ 16731us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.360708 (+ 84672us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:54.360754 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.261138 (+900384us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54001d56d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:55.297139 (+ 36001us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.297409 (+   270us) raft_consensus.cc:1685] finished
0709 13:02:55.297463 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.340150 (+ 42687us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32873,"raft.queue_time_us":35197,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":17100,"spinlock_wait_cycles":373862656,"thread_start_us":26384,"threads_started":1,"wal-append.queue_time_us":354613}
I20260709 13:02:55.422251  8289 raft_consensus.cc:2410] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:55.423426  8332 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:55.422099  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.523010  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.430788  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:55.524534  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 93875.9us
I20260709 13:02:55.438239  8893 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 13:02:55.459726  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:55.526475  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:55.439728  8894 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:55.441267  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:55.527024  8285 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
I20260709 13:02:55.443334  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:55.442867  8366 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:55.529117  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:55.529666  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 728) took 1200 ms. Trace:
I20260709 13:02:55.446012  8889 raft_consensus.cc:606] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:55.512672  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:55.525192  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:55.515620  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:02:55.435837 12005 consensus_meta.cc:287] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.003s
I20260709 13:02:55.418511 12068 raft_consensus.cc:3055] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:55.543363  8292 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 6.
I20260709 13:02:55.529966  8217 raft_consensus.cc:2410] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:55.530319  8889 raft_consensus.cc:614] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:55.536926  8364 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:55.427763 11999 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.530040  8360 rpcz_store.cc:276] 0709 13:02:54.329216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.372822 (+ 43606us) service_pool.cc:224] Handling call
0709 13:02:54.373135 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.373501 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.373528 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.374035 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.509020 (+134985us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:54.509068 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.509149 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.323876 (+814727us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:55.447804 (+123928us) raft_consensus.cc:1685] finished
0709 13:02:55.447829 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.529606 (+ 81777us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":90272640,"thread_start_us":113138,"threads_started":1,"wal-append.queue_time_us":343233}
I20260709 13:02:55.436296 11921 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:55.438683 11994 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.541003  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:55.541656  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.548468  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:55.560719  8285 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:55.545512 12054 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:02:55.527751 12110 log.cc:927] Time spent T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:55.550267  8211 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:55.512669 12058 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:55.518877 12069 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.537649 11383 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:55.548462  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:55.514092 11950 consensus_queue.cc:1059] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:02:55.570713  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:55.571496  8284 raft_consensus.cc:2368] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:02:55.572327  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:55.573354  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:55.520208 11984 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:55.574604 12109 log.cc:927] Time spent T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:02:55.562435  8258 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:55.543303 12068 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:55.576351  8284 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:55.577996  8216 raft_consensus.cc:2393] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:02:55.579180  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.579739  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.580363  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:55.566743 11383 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:55.566880 12051 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.586977  8863 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:55.588112  8863 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:55.589423  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.589846  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.554708 12005 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:55.555676 11999 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.567870 12023 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:55.594153  8284 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:55.596215  8863 leader_election.cc:400] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:02:55.598898  8863 leader_election.cc:403] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:55.562225 11996 raft_consensus.cc:3055] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:55.570645 11987 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.608626  8360 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:55.578727 11921 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:55.582216 11984 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.613554 12027 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.596323 12010 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:55.631189 12111 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:55.609786 11996 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:55.592321 11719 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:55.635190  8863 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:55.637714  8285 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
W20260709 13:02:55.631829 12105 log.cc:927] Time spent T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:02:55.655877  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 223046us
I20260709 13:02:55.611001 12011 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.609516 12107 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.585902 12069 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.663117  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:55.636312 12010 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.664959 11917 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:02:55.662319 12022 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:55.675256 12108 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:02:55.710718 12121 log.cc:927] Time spent T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:55.688642 12010 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.632400 12063 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:55.598727 12047 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:55.722334 12105 log.cc:927] Time spent T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:55.685448 12025 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:55.724817 12019 consensus_meta.cc:287] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.708s	user 0.005s	sys 0.005s
I20260709 13:02:55.631707 11921 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:55.667372 12011 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.729516 12069 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.655628 12068 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:55.775933  8213 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:55.725857 11985 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.787113 12011 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:55.782379 12015 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:55.794595 12117 log.cc:927] Time spent T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:02:55.804965  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1009) took 1219 ms. Trace:
I20260709 13:02:55.805370  8895 rpcz_store.cc:276] 0709 13:02:54.585835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.256706 (+670871us) service_pool.cc:224] Handling call
0709 13:02:55.256998 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.313293 (+ 56295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.313322 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.322801 (+  9479us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.435780 (+112979us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:55.436149 (+   369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.804610 (+368461us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54001743d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:55.804656 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.804699 (+    43us) raft_consensus.cc:1685] finished
0709 13:02:55.804711 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.804903 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1158,"raft.queue_time_us":1735,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":125881088,"thread_start_us":111795,"threads_started":1,"wal-append.queue_time_us":306408}
W20260709 13:02:55.810322 12044 consensus_meta.cc:287] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.589s	user 0.000s	sys 0.009s
W20260709 13:02:55.811161 12041 consensus_meta.cc:287] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.840s	user 0.004s	sys 0.004s
I20260709 13:02:55.811542 12041 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.811128  8367 raft_consensus.cc:2410] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:55.730973 11996 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.813226 11996 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:55.814860 11999 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:55.815868  8286 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:55.816833 11999 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:55.817440 11999 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:55.820731 12027 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
W20260709 13:02:55.821520 12014 consensus_meta.cc:287] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.001s
W20260709 13:02:55.821818 12115 log.cc:927] Time spent T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:02:55.821933 12014 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:55.823096  8212 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:55.824144 12014 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:55.825961 12025 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.827201 12094 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:55.787935 11700 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:55.827749 11660 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.828824  8362 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:55.828987  8214 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:55.829725 11660 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.829967 11700 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:55.830401  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2298) took 1005 ms. Trace:
I20260709 13:02:55.830767  8362 rpcz_store.cc:276] 0709 13:02:54.825008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.123528 (+298520us) service_pool.cc:224] Handling call
0709 13:02:55.123839 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.829184 (+705345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.830150 (+   966us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400067cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:55.830340 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621606784}
I20260709 13:02:55.839979  8331 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:55.876503 12038 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.877068 11985 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.817983 11999 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.877840 11991 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:55.879946 11991 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:55.873294  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:55.886508  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 324287us
I20260709 13:02:55.888048  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:55.888768  8287 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:02:55.890779  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 310642us
I20260709 13:02:55.891579  8257 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:55.827765 12094 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:55.894340  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:55.890118 11807 consensus_meta.cc:287] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.001s
I20260709 13:02:55.886677 12044 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:55.908763  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 485618us
W20260709 13:02:55.891383 12048 consensus_meta.cc:287] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.000s
I20260709 13:02:55.890328 11991 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:55.886224 12021 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:55.906478 12012 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:55.920421  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.886449 12107 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:02:55.927166  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:55.918124 11999 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:55.916778  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 253846us
W20260709 13:02:55.918397  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 327710us
I20260709 13:02:55.943411  8259 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:55.909791 11383 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:55.920857 12044 raft_consensus.cc:697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:55.904515  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:55.946048 11999 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:55.946705 12008 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:55.949116  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:55.918589  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:55.950271  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 45879.6us
I20260709 13:02:55.955927  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:55.956539  8362 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.958595  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:55.958952  8332 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:55.913849 12048 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:55.976339  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:55.976698  8362 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:02:55.977281  8892 raft_consensus.cc:2410] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:55.974256  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:55.984023  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:55.972677 11993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.017s	sys 0.045s
I20260709 13:02:55.966214 11965 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.949261 11987 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:55.996376  8289 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:02:55.999280  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.938004 12043 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:02:55.944895 11991 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:02:56.015070  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:55.962924 12010 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.016405  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:56.019404  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:56.025182  8292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 880) took 1574 ms (client timeout 1916 ms). Trace:
I20260709 13:02:55.997000 11987 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:55.998553 11993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.018s	sys 0.045s
W20260709 13:02:56.025626  8292 rpcz_store.cc:269] 0709 13:02:54.451228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.452050 (+   822us) service_pool.cc:224] Handling call
0709 13:02:56.025007 (+1572957us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400146254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:56.025122 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383055616}
I20260709 13:02:56.021571 11660 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:56.021759 11965 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:56.032835 11987 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.969079 12094 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:56.079550  8892 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:55.998487 12005 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:56.091032  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.012630 11950 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:56.030821 12107 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:56.036836 12041 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:56.071077 12142 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:02:56.075295 12023 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.028913 12134 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:56.025125 11983 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:02:56.081557 12051 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.289714  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 186261us
I20260709 13:02:56.100711 12049 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.201781 12046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.015s	sys 0.036s
W20260709 13:02:56.318086  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.341869  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.342286  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.343546  8361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.019s	sys 0.027s
W20260709 13:02:56.343942  8361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.019s	sys 0.027s
W20260709 13:02:56.345148 12046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.015s	sys 0.037s
W20260709 13:02:56.332510  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.100898 12141 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:56.363258 12048 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:56.368598 12131 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:02:56.369169 11921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.003s	sys 0.013s
W20260709 13:02:56.369702 11921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.003s	sys 0.013s
I20260709 13:02:56.370342  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1286) took 1448 ms. Trace:
I20260709 13:02:56.370795  8897 rpcz_store.cc:276] 0709 13:02:54.922042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.391296 (+469254us) service_pool.cc:224] Handling call
0709 13:02:55.420987 (+ 29691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.425101 (+  4114us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:55.443023 (+ 17922us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.906785 (+463762us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.907261 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.907383 (+   122us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.907415 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.907556 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.370123 (+462567us) raft_consensus.cc:1685] finished
0709 13:02:56.370143 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.370287 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3696,"prepare.queue_time_us":21361,"raft.queue_time_us":8862,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":15224,"spinlock_wait_cycles":165860096,"thread_start_us":361459,"threads_started":1,"wal-append.queue_time_us":543114}
I20260709 13:02:56.289294 11907 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.041692 12044 consensus_queue.cc:237] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:56.314556 12021 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.435243 11907 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.045820 11383 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.326444 11660 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.446374  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 481188us
I20260709 13:02:56.106796 12127 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.510s
W20260709 13:02:56.453876  8217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.049s
I20260709 13:02:56.377712 12141 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:56.455981  8217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.011s	sys 0.049s
I20260709 13:02:56.314126 11965 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:02:56.314195 12023 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.448447  8259 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:56.462391  8209 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.036s	sys 0.032s
W20260709 13:02:56.468966  8209 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.036s	sys 0.032s
W20260709 13:02:56.462251  8216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.030s	sys 0.041s
W20260709 13:02:56.470536  8216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.030s	sys 0.041s
I20260709 13:02:56.426422 12049 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.371731 12051 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.456995 12134 raft_consensus.cc:697] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:56.468398 12127 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:56.449065 12145 log.cc:927] Time spent T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.341s	user 0.005s	sys 0.004s
W20260709 13:02:56.462306 11925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.055s	sys 0.013s
I20260709 13:02:56.447806 12021 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.451720 11660 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:56.497761  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.002s	sys 0.026s
I20260709 13:02:56.492128 12010 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:56.495092 12139 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:56.524322  8359 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:56.460819 12005 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:56.510488 11996 consensus_meta.cc:287] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.000s
W20260709 13:02:56.512696  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.003s	sys 0.027s
I20260709 13:02:56.491755 12127 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:56.513852  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:56.502609 11925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.056s	sys 0.013s
I20260709 13:02:56.521232 11907 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:56.537027  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.532382  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 642363us
I20260709 13:02:56.569133  8258 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:02:56.573980  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.536147 12139 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:56.568435 12108 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:56.527184 12138 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:56.582122 12107 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.584026 12132 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:02:56.584343  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1016) took 1575 ms. Trace:
W20260709 13:02:56.599073  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.599823  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.575732 12041 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.584882 12135 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:02:56.569932 12010 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.598769  8898 rpcz_store.cc:276] 0709 13:02:55.008660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.428723 (+420063us) service_pool.cc:224] Handling call
0709 13:02:55.444955 (+ 16232us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:55.445366 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.445392 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:55.515398 (+ 70006us) log.cc:844] Serialized 52 byte log entry
0709 13:02:55.908297 (+392899us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.911771 (+  3474us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.912039 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.912106 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.948459 (+ 36353us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b18004095a0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:02:56.584025 (+635566us) raft_consensus.cc:1685] finished
0709 13:02:56.584125 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.584282 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6123,"prepare.queue_time_us":4051,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":598,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":1185,"spinlock_wait_cycles":34780800,"thread_start_us":354664,"threads_started":1,"wal-append.queue_time_us":1025043}
I20260709 13:02:56.574407 11921 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:56.579339 12134 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.629041 12068 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:56.633183 11985 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:56.633632 11985 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:02:56.644204  8293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.013s	sys 0.024s
I20260709 13:02:56.634485 11985 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:56.645354  8293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.013s	sys 0.024s
I20260709 13:02:56.646627  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:56.648518  8362 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:56.649994  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2460) took 1638 ms. Trace:
W20260709 13:02:56.646970  8284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.016s	sys 0.030s
I20260709 13:02:56.518652 12141 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:56.612056 12107 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:56.615800 12041 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.627609 12010 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.607673 12138 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.617939 12127 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.649474 12034 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:56.719367  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 278253us
I20260709 13:02:56.733378  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 741) took 1630 ms. Trace:
I20260709 13:02:56.654055  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:56.650761  8284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.016s	sys 0.030s
W20260709 13:02:56.702984  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.663357  8367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2296) took 1838 ms (client timeout 1814 ms). Trace:
I20260709 13:02:56.668632  8863 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:56.665454  8291 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:56.638453 11921 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:02:56.751967 12148 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 13:02:56.770022  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 116098us
W20260709 13:02:56.751546 12159 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:02:56.653002 12122 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 1.021s	user 0.004s	sys 0.008s
I20260709 13:02:56.650441  8293 rpcz_store.cc:276] 0709 13:02:55.011363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.243292 (+231929us) service_pool.cc:224] Handling call
0709 13:02:55.256862 (+ 13570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.257057 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:55.432713 (+175656us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.968572 (+535859us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.649222 (+680650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.649271 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:56.649314 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.649740 (+   426us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.649947 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95367,"prepare.queue_time_us":354455,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":3102,"raft.queue_time_us":574358,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":177,"thread_start_us":1342453,"threads_started":4,"wal-append.queue_time_us":347002}
I20260709 13:02:56.714239 11996 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.772192  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 103697us
I20260709 13:02:56.725492 12157 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.767985  8361 rpcz_store.cc:276] 0709 13:02:55.102873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.433864 (+330991us) service_pool.cc:224] Handling call
0709 13:02:55.434515 (+   651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.794094 (+359579us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b480012c258. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f01176aa1 00007f2f0116db37 00007f2f0116d9ca 00007f2f0126526f 00007f2f01264f37 00007f2f0127955c 00007f2f01279508 00007f2f01279488 00007f2f01279443 00007f2f012786ec 00007f2f001a2a96
0709 13:02:56.344298 (+550204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.344334 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.426810 (+ 82476us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.572281 (+145471us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:56.572318 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.572399 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.733071 (+160672us) raft_consensus.cc:1685] finished
0709 13:02:56.733092 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.733316 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136129,"raft.run_cpu_time_us":1892,"raft.run_wall_time_us":223241,"spinlock_wait_cycles":12541696,"thread_start_us":1012679,"threads_started":2,"wal-append.queue_time_us":281172}
I20260709 13:02:56.692575 12051 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:56.752517 12050 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:56.667913 12023 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:56.768769  8367 rpcz_store.cc:269] 0709 13:02:54.824513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.940999 (+116486us) service_pool.cc:224] Handling call
0709 13:02:56.663137 (+1722138us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54004614d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:56.663281 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859436288}
I20260709 13:02:56.796016  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:56.651026 11985 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:56.778172 12089 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:56.797078  8863 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:56.674855 12027 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.734495 12049 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:56.779399 12127 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:56.651491 11660 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:56.803174  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:56.783459  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.829389  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.825062  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.696290 11907 consensus_queue.cc:1059] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:02:56.776527 12161 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:56.819456  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1795) took 1445 ms. Trace:
I20260709 13:02:56.836092  8291 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:56.652113 12139 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:56.833614  8214 rpcz_store.cc:276] 0709 13:02:55.374513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.376019 (+  1506us) service_pool.cc:224] Handling call
0709 13:02:55.376327 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.829411 (+453084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.819177 (+989766us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54000ed154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:56.819384 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041168256}
W20260709 13:02:56.843432  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.818272 12027 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.832065 12063 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.833448 12161 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.823808 12089 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:02:56.851828  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.825012 12046 raft_consensus.cc:2764] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:56.799479 11996 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.855939 11921 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.860167  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:56.851454 12038 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:56.805127 12157 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.844864 12048 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:56.877043 11660 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.900627  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:56.884717 12047 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:56.883607 12161 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:56.874914 12063 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.914676  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:56.920599  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 119654us
I20260709 13:02:56.922575  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:56.924484  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 127554us
I20260709 13:02:56.928190  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:56.904016 12048 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:56.934592  8291 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:56.923684 12027 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:56.905139 11660 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:56.927723 12010 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:56.942863  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2385) took 1711 ms. Trace:
I20260709 13:02:56.930418 12041 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:56.962845  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.989077  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.913400 12047 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:56.935691 12136 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:57.028501 12107 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:57.266783  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.282145 12157 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.297603 12180 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:57.289974 11987 consensus_meta.cc:287] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 1.000s	user 0.015s	sys 0.003s
I20260709 13:02:57.279821 12063 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:57.280325 12168 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.343s	user 0.009s	sys 0.001s
I20260709 13:02:56.944121  8211 rpcz_store.cc:276] 0709 13:02:55.231951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.232102 (+   151us) service_pool.cc:224] Handling call
0709 13:02:55.232403 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.565070 (+332667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.942614 (+1377544us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54000ec754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:56.942806 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730855808}
W20260709 13:02:57.281032 12165 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.343s	user 0.001s	sys 0.010s
I20260709 13:02:57.281746 11985 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.282135 12027 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:57.283131  8105 maintenance_manager.cc:419] P 49ab8a0cd4ae4427b46500594085b384: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033348
I20260709 13:02:56.924252 12089 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.283430 11660 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.312187  8293 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:57.286093 12068 consensus_meta.cc:287] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.657s	user 0.002s	sys 0.016s
I20260709 13:02:57.288939  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:57.290618 11996 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:56.936925 12128 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:57.292342 12170 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.389s	user 0.000s	sys 0.011s
I20260709 13:02:57.293385 12161 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:57.294028 12171 log.cc:927] Time spent T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.358s	user 0.011s	sys 0.000s
I20260709 13:02:57.280615 12010 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:02:57.294417 12012 consensus_meta.cc:287] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.367s	user 0.015s	sys 0.005s
W20260709 13:02:57.307582  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.302386 11987 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.298561 12048 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.285624 12047 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.314177  8291 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:57.317816 12068 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.350648  8360 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:57.351030 12068 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.353137 12068 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.353739 12182 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.355094  8895 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:02:57.355479  8895 pending_rounds.cc:85] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 8
I20260709 13:02:57.355696  8895 pending_rounds.cc:107] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:02:57.355922  8895 raft_consensus.cc:2889] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:57.356137  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.306694 12063 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:57.320928  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2250) took 1355 ms. Trace:
I20260709 13:02:57.361984  8889 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:57.362452  8288 rpcz_store.cc:276] 0709 13:02:55.965700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.966220 (+   520us) service_pool.cc:224] Handling call
0709 13:02:55.993722 (+ 27502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:56.491275 (+497553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.497907 (+  6632us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.512188 (+ 14281us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.844860 (+332672us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:56.844899 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.846290 (+  1391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.320720 (+474430us) raft_consensus.cc:1685] finished
0709 13:02:57.320739 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.320870 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16618,"raft.queue_time_us":460003,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3900,"thread_start_us":769351,"threads_started":2,"wal-append.queue_time_us":343973}
W20260709 13:02:57.322330 12050 consensus_meta.cc:287] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.012s
I20260709 13:02:57.323710 12161 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.364619 12066 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.365134 12066 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.319941 12128 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.366875 12053 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.330449  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.298238 12180 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:57.332922  8213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1799) took 1934 ms (client timeout 2542 ms). Trace:
W20260709 13:02:57.378247  8213 rpcz_store.cc:269] 0709 13:02:55.398263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.446576 (+ 48313us) service_pool.cc:224] Handling call
0709 13:02:57.332673 (+1886097us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54002a8854. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:57.332849 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557931776}
I20260709 13:02:57.311432 11985 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.334283 12012 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:57.335400  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.340197  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1793) took 2025 ms. Trace:
I20260709 13:02:57.357355  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.387912  8898 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:57.358527  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.358815  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.389142  8895 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:57.359876  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.361086 12182 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.389289  8897 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:57.312173 12027 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.361909  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.393463  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:57.398923  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.400059  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:57.401463  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.402110  8217 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:57.403849  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:57.405279  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.398782  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.405932  8217 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:57.387239  8212 rpcz_store.cc:276] 0709 13:02:55.315213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.316545 (+  1332us) service_pool.cc:224] Handling call
0709 13:02:55.316750 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.823448 (+506698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.339925 (+1516477us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54002a8354. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:57.340128 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164663168}
W20260709 13:02:57.379912 12188 log.cc:927] Time spent T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:02:57.407322  8183 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:57.372963 11907 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.425352  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.405568  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.379220 12090 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.377830 12063 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.360406 12010 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.409080 12050 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:57.386430 12053 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.409256 12068 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:57.431376  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:57.407869 12181 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:57.440205  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 59116.7us
I20260709 13:02:57.435591  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2247) took 2515 ms. Trace:
I20260709 13:02:57.446012  8287 rpcz_store.cc:276] 0709 13:02:54.920471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.970673 (+ 50202us) service_pool.cc:224] Handling call
0709 13:02:54.970996 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.889213 (+918217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.435322 (+1546109us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54000870d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:57.435530 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111163648}
I20260709 13:02:57.447574 12047 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:02:57.457535 12178 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:57.457758 12047 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.460314 12047 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.462205 12010 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.433545 12128 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.429652 12185 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:57.453864  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2461) took 2373 ms. Trace:
I20260709 13:02:57.448401 12184 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:57.428339 11907 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.469821  8286 rpcz_store.cc:276] 0709 13:02:55.080021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.259542 (+179521us) service_pool.cc:224] Handling call
0709 13:02:55.309902 (+ 50360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.816199 (+506297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.453646 (+1637447us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400275bd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:57.453808 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163761024}
I20260709 13:02:57.468108  8864 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:57.449229 12050 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:57.434624 12090 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.455030 12021 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.490234  8892 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.471470 11990 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:57.498558 12050 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.499131 11907 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.475001 12012 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:57.504824 11985 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.506281  8284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2251) took 1540 ms. Trace:
I20260709 13:02:57.507817 12066 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.508352 12066 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:57.508502 12194 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:57.508849 12066 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.509040 12194 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.510535 11907 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:57.511045 11907 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.512192 11996 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.512673 11996 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.513435  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:57.514674 11996 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:02:57.515336 12185 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.515825 12185 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.516812  8213 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:57.518823  8863 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:57.519307 12027 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.469949 12048 consensus_queue.cc:1059] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:02:57.521636 12182 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.496307 11990 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:57.522202 12128 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.522480 11985 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.523154 12068 raft_consensus.cc:3055] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:57.523028 11985 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.523587 12068 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:57.524040 12126 raft_consensus.cc:3055] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:57.524434  8211 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:57.524415 12126 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:57.502089  8891 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:57.523326 12038 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:57.531808 12038 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:57.532235  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.531117 12193 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:57.533470 12193 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.525791 12126 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.535475 12090 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.495343 12184 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:57.536626 12138 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.537235 12138 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.537361  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:57.537077 12184 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.539988 11990 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.506722  8284 rpcz_store.cc:276] 0709 13:02:55.966065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.966734 (+   669us) service_pool.cc:224] Handling call
0709 13:02:55.967098 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:56.768390 (+801292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.768423 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:56.773837 (+  5414us) log.cc:844] Serialized 52 byte log entry
0709 13:02:56.933538 (+159701us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:56.933575 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.933657 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.506002 (+572345us) raft_consensus.cc:1685] finished
0709 13:02:57.506025 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.506223 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8019,"raft.queue_time_us":350424,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":37454,"thread_start_us":931876,"threads_started":2,"wal-append.queue_time_us":512466}
I20260709 13:02:57.530236 12182 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.530428 12063 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.502789 11987 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.520753 12179 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:57.540478  8361 pending_rounds.cc:85] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 6
I20260709 13:02:57.517840 12185 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:57.543648  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.561015  8366 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:57.561234  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.562167  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.563297  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:57.545815  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.546481  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.566468  8895 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:57.567543  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.569103  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.528910  8257 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:57.550913  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.552654  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.570842  8214 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:57.553006  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.547415  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.568189  8889 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:02:57.570451  8217 raft_consensus.cc:2410] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:57.572269  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.574589  8362 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:57.575443  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:57.576676  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 58609.4us
W20260709 13:02:57.557150  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 105298us
I20260709 13:02:57.558449  8361 pending_rounds.cc:107] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:02:57.542194  8892 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:57.559758  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:57.578399  8361 raft_consensus.cc:2889] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:57.558173  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.559969  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.579411  8893 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
W20260709 13:02:57.559283  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 120235us
I20260709 13:02:57.569711  8898 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.585431  8897 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:57.589543  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:57.526141 12128 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.596470  8898 raft_consensus.cc:2410] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:57.560847 12179 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.597071  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.660914  8364 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:57.654060  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.662215  8891 raft_consensus.cc:2376] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8. Re-sending same reply.
I20260709 13:02:57.600157  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:57.664481  8284 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:57.665623  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:57.602839  8895 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:57.570595 11990 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:57.606515  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.668628  8217 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:02:57.604329 12041 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:02:57.670163  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:57.564070 12182 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.678663 12128 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.679793 12041 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:57.680213 12041 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:57.681039 12041 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.615010  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:57.615249 11907 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:57.589257 12137 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:57.619635 11985 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.537704 12138 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.626006 11925 raft_consensus.cc:3055] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:57.524379 12068 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.626179 12039 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:02:57.632645  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.634320  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.634829  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 47570.3us
I20260709 13:02:57.640921  8293 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:57.688740 12041 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.707571  8896 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:57.706220  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:57.683866 11983 consensus_queue.cc:1059] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:02:57.653896  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 56350.9us
I20260709 13:02:57.654351  8286 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:57.656484  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:57.657137  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:57.590348 12066 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.657743  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:57.658687  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.658631  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.675776  8284 raft_consensus.cc:2393] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 8: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:57.655436 12063 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:02:57.723860 11660 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:57.706624 11985 consensus_queue.cc:1059] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:02:57.724565 11660 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.726754 12107 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:57.726747 11660 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.676566  8331 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:57.677242  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:57.728065 12066 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:57.728338  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 51904.4us
I20260709 13:02:57.728624  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.728909 11660 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:57.729223  8364 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:57.670902  8362 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.730022  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.710335 12021 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.730826 12021 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.731066  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.731644  8364 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:57.699007 11925 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:57.684764  8217 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:57.685285  8891 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:02:57.732913  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 285919us
W20260709 13:02:57.685681  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.734047  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:57.673020 11987 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.671681 12179 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.693514  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:57.696318 12138 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:57.672237 12112 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.679347 12182 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:57.716890  8898 raft_consensus.cc:2410] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:57.719094  8214 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:02:57.720747  8218 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:57.767529  8214 pending_rounds.cc:85] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 5
I20260709 13:02:57.767834  8214 pending_rounds.cc:107] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 13:02:57.721844  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.676713  8895 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:57.738494  8331 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:57.749619  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:57.752024  8362 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:57.768882  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.769431  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.614027  8366 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:57.758396  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:57.769951  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.758050  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:57.760025  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.770560  8217 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:57.707319 12068 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:57.768064  8214 raft_consensus.cc:2889] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:57.761332  8216 raft_consensus.cc:2410] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:57.771554  8364 raft_consensus.cc:2410] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:57.776306  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.776502  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.777415  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.778360  8214 raft_consensus.cc:2410] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:02:57.770548  8895 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:57.770500  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.772346  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.774768  8891 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:57.775229  8210 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:57.779680  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.710232 12039 consensus_queue.cc:1243] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:57.780370  8895 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:57.780812  8366 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:57.778659  8331 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:02:57.775735  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 118331us
I20260709 13:02:57.776654  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.782413  8364 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:57.783182  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.781872  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.786967  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:57.787534  8898 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:57.707442 12185 consensus_queue.cc:1175] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ee13752324154b1293a47c9dcd8d6ba5" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
I20260709 13:02:57.788627  8215 raft_consensus.cc:2410] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:02:57.789039  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.777163  8218 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:57.790432  8184 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:57.777329  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.789546  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.793294  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.790867  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.794090  8364 raft_consensus.cc:2393] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:57.794014  8366 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:02:57.796933  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:57.797789  8366 raft_consensus.cc:2410] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:57.799044  8366 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:57.801491  8898 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:02:57.806721  8217 raft_consensus.cc:3055] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:57.807169  8217 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:57.807886  8217 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.808791  8217 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.758025 12090 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.829365  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.819294  8364 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:02:57.863601  8364 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:57.761575 11996 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.829064  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 79570.8us
I20260709 13:02:57.873487  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:57.764902 12012 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.898167  8364 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:57.830431  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.729369 12066 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:02:57.832456  8216 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:57.834156  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.834965  8184 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:57.819169  8214 raft_consensus.cc:3055] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:57.775130 11383 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:57.774957 12112 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:57.766664 12181 raft_consensus.cc:697] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:57.843799  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:57.727299 12107 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.747466 12038 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.820623 11983 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:57.763899 12034 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:02:57.849951  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.849738 12137 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.898633 12026 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.774784 12136 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:02:57.941768  8217 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:02:57.836689 12196 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.841028 12027 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.903278  8210 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
W20260709 13:02:57.904742  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 56849.2us
I20260709 13:02:57.961956  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:57.905292  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.906488  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.963326  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.963899  8210 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:02:57.964267  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.964663  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:57.906664  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 71792.5us
I20260709 13:02:57.963320  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.907132  8889 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:02:57.967224  8889 pending_rounds.cc:85] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 6
I20260709 13:02:57.967478  8889 pending_rounds.cc:107] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:02:57.967697  8889 raft_consensus.cc:2889] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:57.818732 12182 consensus_queue.cc:1059] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:57.904768  8214 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:57.841583  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:57.847358 12134 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.969965 12134 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.822054  8362 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:57.879380  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:57.899371 12090 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.763232 11987 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.918085 11921 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.945065  8366 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:57.938242 12089 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:57.948566  8217 pending_rounds.cc:85] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 5
I20260709 13:02:57.911458 12154 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:58.006204  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.905228 11996 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.905252 12012 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:58.010514  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 131254us
I20260709 13:02:57.969655  8214 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.020007  8214 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.020028  8258 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:57.910684 12094 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:02:58.014318  8217 pending_rounds.cc:107] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:58.028805  8217 raft_consensus.cc:2889] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:57.973539  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 267507us
I20260709 13:02:58.032245  8258 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:57.958746 11983 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.957376 12184 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:57.962098 12196 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.035897  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 894) took 1367 ms. Trace:
I20260709 13:02:57.914785 11383 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.030980  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:57.960498 12027 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.049060  8292 rpcz_store.cc:276] 0709 13:02:56.668546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.668668 (+   122us) service_pool.cc:224] Handling call
0709 13:02:56.669011 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:56.777885 (+108874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.777916 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:56.797970 (+ 20054us) log.cc:844] Serialized 52 byte log entry
0709 13:02:56.923981 (+126011us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:56.924018 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.015154 (+1091136us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400400e54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:58.015202 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.015247 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:58.015260 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.035817 (+ 20557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":539824,"raft.queue_time_us":537,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":544025,"spinlock_wait_cycles":249599872,"thread_start_us":121709,"threads_started":1,"wal-append.queue_time_us":229590}
I20260709 13:02:58.008926 12195 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.947625 12142 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:02:58.036034 11983 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.945081 12026 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:57.951421 12157 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:02:57.960923 11999 consensus_queue.cc:1059] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 13:02:58.063802  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 285346us
I20260709 13:02:58.030822 12190 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:57.940763 12137 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.044941 12184 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.974331 12090 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.012953 12162 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:02:58.125121  8214 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:02:58.125664  8214 pending_rounds.cc:85] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 6
I20260709 13:02:58.125933  8214 pending_rounds.cc:107] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:58.126246  8214 raft_consensus.cc:2889] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.129220 12090 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:58.086649  8183 connection.cc:256] RPC call timeout handler was delayed by -1.1836794769999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:02:58.067199 12027 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.136196 12038 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.137295 12190 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:58.054756 12196 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.138053 12190 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.138674 12190 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:58.139110 12190 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.141566 12190 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.017565 12154 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.059900 12066 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.143697 12066 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.143952 12154 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.059931 11907 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:58.017259 11921 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.145064 11907 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.146386 11921 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.104817  8331 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:58.111274 12026 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.076279 11983 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.137377 12162 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:58.116436 12107 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.117220 12137 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.117552 12184 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.117775 11383 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:58.118515 12200 log.cc:927] Time spent T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:02:58.111131 12128 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:58.147486 11907 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.114723 12112 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.075610 12021 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:58.152685  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 390929us
I20260709 13:02:58.159072  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:02:58.105994 12189 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:02:58.159351 12162 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.163487 12053 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.178840 11987 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.106973 12134 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.144115 12066 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.196882 12128 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:58.198611  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.205451  8214 raft_consensus.cc:606] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.219359  8214 raft_consensus.cc:614] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:58.209131  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:58.060998 12181 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.073225 12195 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.230513  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:58.219388 12162 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:58.237772  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 320327us
W20260709 13:02:58.203069  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 329816us
I20260709 13:02:58.243289  8864 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.234382  8183 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:02:58.233932  8285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.007s
W20260709 13:02:58.235612  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.250998  8285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.009s	sys 0.007s
W20260709 13:02:58.306912  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 63737.7us
I20260709 13:02:58.310021  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.311589  8864 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.232456 12214 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.326026 12216 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:58.329269 11907 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:58.325546 12053 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:58.340694  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 106445us
W20260709 13:02:58.345234  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.345863  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.285030 12218 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:58.350327  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.348261 12213 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.333309 12112 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:58.328924 12026 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:58.343348 11996 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.370638 12038 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.351531 12012 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.353809 12218 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.353561 12156 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.392028 12232 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:02:58.351976 12063 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 13:02:58.463822  8359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.026s
W20260709 13:02:58.467935  8359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.009s	sys 0.027s
I20260709 13:02:58.468747  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 1025) took 1109 ms. Trace:
I20260709 13:02:58.469128  8892 rpcz_store.cc:276] 0709 13:02:57.359435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.359639 (+   204us) service_pool.cc:224] Handling call
0709 13:02:58.468573 (+1108934us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400744ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:02:58.468692 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231228288}
I20260709 13:02:58.465231 12090 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.342701 12128 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.353958 12217 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:02:58.447350 12024 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.450939 12218 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.465764 12156 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:58.494861 12210 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:02:58.496305 12208 log.cc:927] Time spent T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:02:58.455142 12038 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.504652 12038 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:58.505271 12179 consensus_meta.cc:287] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.001s
I20260709 13:02:58.466976 12232 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:58.482717 12209 log.cc:927] Time spent T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:02:58.514885 12156 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.512480 12232 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.505796 12179 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.522922 12195 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.489531 12196 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.552727 12196 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.555505 12179 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:58.368512  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.595940  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2394) took 1046 ms. Trace:
W20260709 13:02:58.598623  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.596593  8211 rpcz_store.cc:276] 0709 13:02:57.548939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.549318 (+   379us) service_pool.cc:224] Handling call
0709 13:02:57.588750 (+ 39432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.653109 (+ 64359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.653146 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:57.653684 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.034884 (+381200us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:58.034923 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.034988 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.594977 (+559989us) raft_consensus.cc:1685] finished
0709 13:02:58.595060 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.595574 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63929,"raft.queue_time_us":90165,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":350077,"threads_started":1,"wal-append.queue_time_us":569763}
W20260709 13:02:58.600435  8183 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.508s (SENT) [suppressed 23 similar messages]
W20260709 13:02:58.604626  8209 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.014s	sys 0.027s
W20260709 13:02:58.605116  8209 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.014s	sys 0.027s
W20260709 13:02:58.606350  8257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.003s	sys 0.012s
W20260709 13:02:58.606863  8257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.003s	sys 0.012s
I20260709 13:02:58.607522  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:58.609426  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 647759us
I20260709 13:02:58.610284  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:02:58.611409  8211 raft_consensus.cc:606] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:58.611804  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.612210  8211 raft_consensus.cc:614] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:58.612797  8288 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:58.613495  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.614215  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.614404  8287 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:02:58.614984  8289 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
W20260709 13:02:58.610316  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.000s	sys 0.015s
W20260709 13:02:58.615796  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.000s	sys 0.016s
I20260709 13:02:58.616703  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.618575  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.620239  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.620429  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
W20260709 13:02:58.620956  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.621121  8211 raft_consensus.cc:606] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:58.617954  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 586043us
I20260709 13:02:58.615936  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.621644  8211 raft_consensus.cc:614] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:58.624022  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.624477  8258 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.610888  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:58.626775  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 402947us
I20260709 13:02:58.558503 12184 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:58.626959  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 522254us
I20260709 13:02:58.650092  8331 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:02:58.448077  8358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.053s
W20260709 13:02:58.391517  8333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.018s	sys 0.031s
W20260709 13:02:58.651677  8358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.012s	sys 0.053s
I20260709 13:02:58.628592  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1878) took 2113 ms. Trace:
I20260709 13:02:58.629478  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 746) took 1090 ms. Trace:
I20260709 13:02:58.629491  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 745) took 1090 ms. Trace:
I20260709 13:02:58.652210  8365 rpcz_store.cc:276] 0709 13:02:56.515268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.515607 (+   339us) service_pool.cc:224] Handling call
0709 13:02:56.515898 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:56.516263 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:56.516292 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.516752 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:02:57.691899 (+1175147us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b1800075a60. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1 00007f2efc208a0f
0709 13:02:58.052951 (+361052us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:58.052990 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.053055 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.627759 (+574704us) raft_consensus.cc:1685] finished
0709 13:02:58.627797 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.628284 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":18206592,"thread_start_us":360880,"threads_started":1,"wal-append.queue_time_us":1810337}
I20260709 13:02:58.652627  8367 rpcz_store.cc:276] 0709 13:02:57.539080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.540076 (+   996us) service_pool.cc:224] Handling call
0709 13:02:57.540365 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.540689 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.540714 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:57.557675 (+ 16961us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.044837 (+487162us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:58.044877 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.051530 (+  6653us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.628952 (+577422us) raft_consensus.cc:1685] finished
0709 13:02:58.628984 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.629281 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":895,"raft.queue_time_us":12647,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":15360,"thread_start_us":430383,"threads_started":1,"wal-append.queue_time_us":653906}
W20260709 13:02:58.651849  8333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.019s	sys 0.031s
I20260709 13:02:58.656562  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 744) took 1119 ms. Trace:
I20260709 13:02:58.656755  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.653764 12107 consensus_queue.cc:1059] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:02:58.657742  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.658849  8292 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 6.
W20260709 13:02:58.513777 12041 consensus_meta.cc:287] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.802s	user 0.007s	sys 0.002s
I20260709 13:02:58.652412  8361 rpcz_store.cc:276] 0709 13:02:57.539364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.539939 (+   575us) service_pool.cc:224] Handling call
0709 13:02:57.540254 (+   315us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:57.579053 (+ 38799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.579083 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:57.588896 (+  9813us) log.cc:844] Serialized 78 byte log entry
0709 13:02:57.897696 (+308800us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:58.285247 (+387551us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.628095 (+342848us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.628670 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.628841 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.628956 (+   115us) raft_consensus.cc:1685] finished
0709 13:02:58.628972 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.629250 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7621,"prepare.queue_time_us":395589,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":90,"raft.queue_time_us":139182,"raft.run_cpu_time_us":456,"raft.run_wall_time_us":15539,"thread_start_us":823337,"threads_started":3,"wal-append.queue_time_us":433311}
I20260709 13:02:58.660862  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:58.625866  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:58.662755  8864 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:58.664819 12195 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:58.665012  8184 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:58.665427 12195 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.633395 12012 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:58.665956 12195 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.666793 12179 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.634166 12026 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.667346 12179 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.510038 11983 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.667790 12026 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.635054 12046 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.659328 12181 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.532969 12066 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.670464 12046 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.672892 12066 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.673084 12046 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.638581 12090 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:58.674738 12196 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:58.674320 12090 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.675249 12196 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.675725 12196 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:58.677253 12090 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.638487 11996 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.678434 11996 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.679716 12218 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.681169 11996 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.638538 12128 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.682195 12128 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.683123 12242 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:58.683444  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.683867 12242 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.684223 12242 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:58.684868 12128 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.688565 12232 raft_consensus.cc:3055] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:58.689146 12232 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:58.637781 12162 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.641006 12038 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:58.633119  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 743) took 1096 ms. Trace:
I20260709 13:02:58.691862  8360 rpcz_store.cc:276] 0709 13:02:57.536756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.537250 (+   494us) service_pool.cc:224] Handling call
0709 13:02:57.537541 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.537722 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:57.864991 (+327269us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.632167 (+767176us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.632517 (+   350us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:58.632596 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:58.632684 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.632783 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.632952 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155750,"prepare.queue_time_us":677212,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":90,"raft.queue_time_us":178599,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":306,"thread_start_us":938940,"threads_started":3,"wal-append.queue_time_us":589108}
I20260709 13:02:58.678308 12217 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 13:02:58.695133  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.695756 12236 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:58.696264 12231 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:58.666563 12012 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.699766 12184 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.670382 11983 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.660316  8358 rpcz_store.cc:276] 0709 13:02:57.537139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.538276 (+  1137us) service_pool.cc:224] Handling call
0709 13:02:57.538544 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.538711 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:57.915994 (+377283us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.655811 (+739817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:58.655911 (+   100us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:58.656055 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.656164 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.656421 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10663,"prepare.queue_time_us":559402,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":12160,"thread_start_us":1082797,"threads_started":2,"wal-append.queue_time_us":623928}
I20260709 13:02:58.641348 12027 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.667840 12179 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.704213  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:58.703976  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 54174.5us
I20260709 13:02:58.710366  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.714643  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2321) took 1058 ms. Trace:
I20260709 13:02:58.715130  8364 rpcz_store.cc:276] 0709 13:02:57.655858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.898913 (+243055us) service_pool.cc:224] Handling call
0709 13:02:57.899155 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.937734 (+ 38579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.937761 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.937797 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:57.937826 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.714040 (+776214us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b540043b054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:02:58.714186 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.714445 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88312704}
I20260709 13:02:58.719655 12005 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:58.720690 12005 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.726194  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.727128  8209 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:58.720706  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:58.728829  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:58.732419  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2254) took 2754 ms. Trace:
I20260709 13:02:58.734427  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.735081 12129 raft_consensus.cc:3055] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:58.735540 12129 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:58.736114 12228 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:58.736662 12228 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.737069 12228 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.682236 12218 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.701907 12012 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.704241 12026 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.751781 12050 raft_consensus.cc:3055] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:58.752480  8209 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:02:58.752942  8209 pending_rounds.cc:85] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 9
I20260709 13:02:58.753168  8209 pending_rounds.cc:107] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:02:58.736799 12129 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.753309 12128 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:58.754248 12128 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.753468  8209 raft_consensus.cc:2889] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.710772 12162 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:58.754308  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.752404 12050 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:58.754683 12129 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.694298 12038 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.732951  8285 rpcz_store.cc:276] 0709 13:02:55.977518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.977648 (+   130us) service_pool.cc:224] Handling call
0709 13:02:55.977909 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.339532 (+1361623us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b18002e76e0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef90dac0a 00007f2f0281a219 00007f2f01176328 00007f2f0116d901 00007f2f0116d8a7 00007f2f01265288 00007f2f01264f37 00007f2f0127955c 00007f2f01279508
0709 13:02:57.710889 (+371357us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18002e76e0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2efbdf54bc 00007f2ef914348b 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915d455 00007f2efc245060 00007f2efc245bfb 00007f2efc25064b
0709 13:02:57.711028 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.711054 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:57.731273 (+ 20219us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.251477 (+520204us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:58.718700 (+467223us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.719220 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.731869 (+ 12649us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.731961 (+    92us) raft_consensus.cc:1685] finished
0709 13:02:58.731977 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.732202 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3120,"raft.queue_time_us":482179,"raft.run_cpu_time_us":17557,"raft.run_wall_time_us":856688,"spinlock_wait_cycles":53136000,"thread_start_us":1386599,"threads_started":3,"wal-append.queue_time_us":663037}
I20260709 13:02:58.758339 12128 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.751801 12027 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.766968  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.769150  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.746340 12184 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:58.776465 12034 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:58.777237 12233 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.220s	user 0.004s	sys 0.000s
I20260709 13:02:58.777427 12034 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:58.779305 12050 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.779807 12034 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.780689 12050 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.781319 12126 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:58.782637  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 158504us
I20260709 13:02:58.782398 12232 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.783905 12232 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.784673 12162 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:58.788396  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 54134.9us
I20260709 13:02:58.790885  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.794759  8292 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
W20260709 13:02:58.813143  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.813995  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.814368  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.814944  8209 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:02:58.815594 12193 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.818290 12189 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:02:58.819628 12199 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.766s	user 0.000s	sys 0.001s
I20260709 13:02:58.796918 12038 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.792968 12180 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:58.825652 12206 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.650s	user 0.000s	sys 0.003s
I20260709 13:02:58.807031 12026 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:02:58.829335 12185 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:02:58.840755  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.828186 11992 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:58.829005 12184 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:58.831413  8864 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.832471  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.834429  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.835487  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.829274 11990 raft_consensus.cc:3055] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:58.826556  8286 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:58.841862  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.829521 12196 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.838876  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:58.841313 12195 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.853075  8258 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:58.846431 11992 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:58.854113  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.861706 11992 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.863511 11992 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.807919 12242 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:58.866263 12038 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:58.848132 11990 raft_consensus.cc:740] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:58.869581  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.871604  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.876468  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.880272  8212 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:58.880167  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:58.878598 11925 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.882531  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:58.882735  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:58.872916 12185 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:58.884342  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 80079.5us
W20260709 13:02:58.889714  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 66653.6us
I20260709 13:02:58.890913  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:58.881866  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:58.891855  8898 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:58.892614 11925 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:58.892985 12126 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:58.883195 12038 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:58.891083  8361 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:02:58.894999  8361 pending_rounds.cc:85] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 6
I20260709 13:02:58.891748  8367 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:58.895326  8361 pending_rounds.cc:107] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:58.895638  8361 raft_consensus.cc:2889] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.895881  8360 raft_consensus.cc:2376] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9. Re-sending same reply.
I20260709 13:02:58.890926  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:58.893868 12126 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.897405  8212 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:58.895476  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.894603 12038 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.899559 12126 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.900353 12038 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:58.901906  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:58.902725  8892 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:58.894733 12195 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:58.904799  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:58.905488  8892 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:58.906597  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:58.907325 12242 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.903414  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:58.907928 11990 consensus_queue.cc:260] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:58.908732  8212 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:58.909179 11990 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.910209  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:58.910977  8367 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:58.911403  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 748) took 1369 ms. Trace:
I20260709 13:02:58.911754  8363 rpcz_store.cc:276] 0709 13:02:57.541918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.542036 (+   118us) service_pool.cc:224] Handling call
0709 13:02:57.562430 (+ 20394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.562813 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.562842 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:57.567177 (+  4335us) log.cc:844] Serialized 26 byte log entry
0709 13:02:57.946906 (+379729us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:57.946946 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.947011 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.821153 (+874142us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:58.910902 (+ 89749us) raft_consensus.cc:1685] finished
0709 13:02:58.910932 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.911200 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4755,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":19812,"spinlock_wait_cycles":30673792,"thread_start_us":343094,"threads_started":1,"wal-append.queue_time_us":588800}
I20260709 13:02:58.882851  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.909765  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:58.884599 12026 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:58.918453 12250 log.cc:927] Time spent T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.358s	user 0.000s	sys 0.003s
I20260709 13:02:58.918722  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:58.866319 12189 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:02:58.891664  8894 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:02:58.907287  8358 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.910254  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:58.927407  8364 raft_consensus.cc:2376] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10. Re-sending same reply.
I20260709 13:02:58.930508  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:58.930956  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.932153  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:58.933037  8365 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 12: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:58.932358  8362 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:58.933849  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.934489  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:58.935362  8898 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
I20260709 13:02:58.935506  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:58.934374  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:58.936406  8890 raft_consensus.cc:2410] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:58.934561  8218 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:58.937283  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:58.937713  8363 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:58.937812  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:58.938697  8218 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 12: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:58.939568  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.940475  8218 raft_consensus.cc:2410] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:02:58.942663 12252 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:02:58.943012  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:58.944410  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.934921  8215 raft_consensus.cc:2410] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:58.944271  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:02:58.950798  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.953012  8360 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:58.956699  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:58.957957  8214 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:02:58.921705 12127 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:58.960810  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:58.963608 12229 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.409s	user 0.004s	sys 0.001s
I20260709 13:02:58.970256  8894 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:02:58.953121 12194 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:58.975183  8364 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:58.975617  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:58.978026  8212 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.973610  8361 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:02:58.922143 12038 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:02:58.978154  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:58.983301  8363 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.986898  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:58.989660  8364 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:58.995435  8894 raft_consensus.cc:2393] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:58.997716  8292 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:58.999372 12218 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:59.000344 12190 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.000744 12190 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:59.001298  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.002009  8890 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 6.
W20260709 13:02:59.003355 12240 log.cc:927] Time spent T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.462s	user 0.000s	sys 0.001s
I20260709 13:02:59.006635  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1295) took 1257 ms. Trace:
I20260709 13:02:59.007082  8897 rpcz_store.cc:276] 0709 13:02:57.748856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.749021 (+   165us) service_pool.cc:224] Handling call
0709 13:02:57.749696 (+   675us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:57.771591 (+ 21895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.771625 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:58.151044 (+379419us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b2c00047ae8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efab46a11 00007f2efab56372 00007f2efc288a01 00007f2efc24d43a 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2
0709 13:02:58.151696 (+   652us) log.cc:844] Serialized 78 byte log entry
0709 13:02:58.367428 (+215732us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:58.631295 (+263867us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.632186 (+   891us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.632469 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.632614 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.002541 (+369927us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:02:59.005960 (+  3419us) raft_consensus.cc:1685] finished
0709 13:02:59.005982 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.006412 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10591,"prepare.queue_time_us":248388,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":102,"raft.queue_time_us":39312,"raft.run_cpu_time_us":559,"raft.run_wall_time_us":45076,"spinlock_wait_cycles":359151616,"thread_start_us":396429,"threads_started":2,"wal-append.queue_time_us":323708}
I20260709 13:02:59.011031  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.011824  8892 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:59.000092 12218 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.013831  8290 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:59.014011 12218 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.001765 12190 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.015841 12190 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:59.016197 12247 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.465s	user 0.000s	sys 0.001s
I20260709 13:02:59.018764  8892 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:02:59.020578 12246 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.470s	user 0.001s	sys 0.000s
I20260709 13:02:59.021723 12161 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:59.022168 12161 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:59.023286 12161 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.024400 12161 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.026104  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.028209  8890 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:59.028970  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.029873  8292 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:02:59.033412 12239 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.483s	user 0.000s	sys 0.001s
I20260709 13:02:59.028139  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.035051  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.035889  8288 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:02:59.030056  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:59.030779  8894 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:59.031387  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.038924  8286 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:02:58.981042 12228 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.040343 11993 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:59.041268  8213 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:59.041894 12228 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.042905  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.043690  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:59.044638  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.044837  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.045758  8359 raft_consensus.cc:2410] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:59.046613  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.047206  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:59.047341  8359 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:59.047524  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:59.047775  8895 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.048259  8898 raft_consensus.cc:2376] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10. Re-sending same reply.
I20260709 13:02:59.048225  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:59.046566  8256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.050455  8359 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:59.045727  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:59.052940  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.046533  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.044013  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.058853  8365 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:02:59.071230  8894 raft_consensus.cc:1240] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: [8.9-11.10]
I20260709 13:02:59.071422  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:59.072187  8893 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:59.074177  8211 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:02:59.074565 12249 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.514s	user 0.002s	sys 0.001s
I20260709 13:02:59.075762  8211 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:59.076115 12127 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.075644  8332 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:59.079324  8359 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:59.078610  8895 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:02:59.049230  8862 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.086670  8358 raft_consensus.cc:2410] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:02:59.096819  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 137022us
W20260709 13:02:59.100845  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 51850us
I20260709 13:02:59.102766  8862 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:59.104094 12071 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.105808 12038 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:59.106273 12232 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:59.106725 12232 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.107079 12232 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.069360 12196 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:59.114601  8363 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:59.115628  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.116657  8895 raft_consensus.cc:2410] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:59.120955  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.077848 12139 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:59.103958 12127 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.124993  8363 raft_consensus.cc:2393] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:02:59.122231  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.126230  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.129817  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.131019  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.131662  8286 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:59.131948  8358 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:59.132840  8367 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:02:59.136535  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.124424 12071 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:59.154276 12071 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:59.154734 12071 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.157814  8358 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:59.159426  8359 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:59.106472 12038 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:59.137823  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 62315us
I20260709 13:02:59.138262  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:02:59.142410  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.164004  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.143002  8366 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:59.145112  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.146226  8288 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:59.137768  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.147086  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.147854  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.148555  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:59.149305  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.134959 12156 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.150022  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.150786  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:59.171123  8363 raft_consensus.cc:2410] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:59.171545  8286 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:59.170593  8285 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:59.178613  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.185122  8292 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.186264  8366 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:02:59.185946  8287 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:02:59.175238 12179 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.189380  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.189992  8291 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:59.190873  8897 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:02:59.191301 12021 consensus_queue.cc:1059] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:59.192346 12021 raft_consensus.cc:3055] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:59.192651 12021 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:02:59.194864 12267 log.cc:927] Time spent T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:02:59.195806 12038 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:02:59.196959 12260 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 13:02:59.199589  8259 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:59.191329  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.206046  8292 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:59.203914  8290 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
W20260709 13:02:59.207324  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 73306.1us
I20260709 13:02:59.180205  8862 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.207875  8215 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:02:59.191314  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:59.227941  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:02:59.185142 12259 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:02:59.227548  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:59.207377 12253 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:02:59.190847 12179 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:02:59.231400  8331 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:59.241770  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:59.138615 12139 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:59.247822  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.219067 12005 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:59.178241 12156 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:59.260241  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 52667.4us
W20260709 13:02:59.262406  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 56362.8us
W20260709 13:02:59.265322  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.267033  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 90565.4us
I20260709 13:02:59.267804  8218 raft_consensus.cc:2410] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:59.258998  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.269057  8212 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:02:59.270318 12219 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:59.278025  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:59.283419 12190 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:59.283943 12190 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:59.284014 11990 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:59.284411 12190 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.283310 12161 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:59.239109 12038 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:02:59.288492  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.294016  8862 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:59.240252 12128 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.266741 12218 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:59.298236  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:59.300051 12034 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:59.302600 12071 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.304675  8893 raft_consensus.cc:2410] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:59.305533 12071 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:59.290621 11990 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:59.307142 11990 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:59.270260 12231 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:02:59.314235  8894 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13. Ops: [8.9-12.11]
W20260709 13:02:59.315568  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 70648.2us
I20260709 13:02:59.305972  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.316562  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:59.305303  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 47406.2us
I20260709 13:02:59.317315  8889 raft_consensus.cc:2393] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 12: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:59.318213  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.319445  8258 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:59.314056  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:02:59.320070  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 128876us
I20260709 13:02:59.315841  8894 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:59.321556  8364 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:59.225229 12021 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.326377 11993 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.326848 12218 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:59.286525 12242 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:59.327704 12071 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:59.328704  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:59.329979 12156 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:59.331727 12161 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:59.352172 12161 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:59.353749 12161 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:59.355028 12228 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:59.355504 12228 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.355882 12228 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.334095 12231 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:59.336378 12154 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:59.358572 12128 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.358898 12154 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.359344 12154 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:59.338291  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:59.355580 12180 consensus_queue.cc:1059] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:02:59.360679  8897 raft_consensus.cc:2393] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:59.360883 12180 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:59.327491  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:59.361281 12180 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:59.347126 12242 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:59.362557 12021 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.363641  8862 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:59.327381 12139 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:59.358475 12231 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:59.370998 12231 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:59.372320 12231 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.374727 12161 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.344223  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:59.381637  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:02:59.382261  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 82471.6us
I20260709 13:02:59.383033  8862 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:02:59.384105 12219 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:59.384545 12219 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:59.384795  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.385239 12194 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:59.385754 12194 raft_consensus.cc:697] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:02:59.386361 12034 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:59.386633 12194 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.390161  8892 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
W20260709 13:02:59.391044  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 91595.4us
I20260709 13:02:59.394932 12242 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.396569 12180 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.351466  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.398177 12180 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.399272  8184 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:59.399645 12185 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:59.400133  8115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35680 (request call id 398) took 34761 ms (client timeout 15000 ms). Trace:
I20260709 13:02:59.401885  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:59.354704 12218 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.402581  8364 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.402910 12129 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:59.403349 12129 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.403718 12129 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:59.398731  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 47389.9us
I20260709 13:02:59.354625  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.350708 11993 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.408934 11993 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.375721  8209 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 14: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:59.376134  8332 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:02:59.410109  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 62661.1us
I20260709 13:02:59.410805  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:59.412330 12024 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:59.413048 12024 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.413461  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:59.374591  8112 catalog_manager.cc:5697] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.413722 12024 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:59.359773  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.414558  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:59.335646  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.325397  8863 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:59.379552 11925 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:59.380569 12071 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:59.346915 12179 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.384868 12219 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.415861  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:02:59.415273  8287 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.398612 12196 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:59.420991  8112 catalog_manager.cc:5697] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.421717 12050 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:59.421427 12129 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:59.422991 12128 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:59.418524  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:02:59.376866  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 97902us
W20260709 13:02:59.416536  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.394975  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.423045  8184 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.414119  8290 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:59.426792  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.384133  8331 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:59.439043  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.512344  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:02:59.513477  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.434625 11925 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:59.528584  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 144560us
I20260709 13:02:59.526242  8366 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:59.524156  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 198921us
I20260709 13:02:59.532202 12235 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:59.535360  8863 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:59.536876 12228 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:59.538470  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.539142  8210 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:02:59.541739 12142 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:59.542253 12228 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:59.542605  8288 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:59.543738  8211 raft_consensus.cc:2393] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:59.434577 12027 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:59.546622  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:59.529407  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.548293  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:02:59.530949  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.531565 11965 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:59.400568  8115 rpcz_store.cc:269] 0709 13:02:24.638654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.638826 (+   172us) service_pool.cc:224] Handling call
0709 13:02:59.399891 (+34761065us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:54.746637 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:54.747275 (+   638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:54.747324 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:02:54.747345 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:54.748858 (+  1513us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:54.748930 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:54.748961 (+    31us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:54.750229 (+  1268us) tablet.cc:701] Row locks acquired
0709 13:02:54.750289 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:02:54.750463 (+   174us) write_op.cc:270] Start()
0709 13:02:54.750604 (+   141us) write_op.cc:276] Timestamp: P: 1783602174750399 usec, L: 0
0709 13:02:54.750623 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:54.751368 (+   745us) log.cc:844] Serialized 5126 byte log entry
0709 13:02:55.674226 (+922858us) op_driver.cc:464] REPLICATION: finished
0709 13:02:55.991989 (+317763us) write_op.cc:301] APPLY: starting
0709 13:02:56.004341 (+ 12352us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:56.081900 (+ 77559us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:56.290034 (+208134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:56.365870 (+ 75836us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:56.366281 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:02:56.366323 (+    42us) write_op.cc:312] APPLY: finished
0709 13:02:56.366676 (+   353us) log.cc:844] Serialized 95 byte log entry
0709 13:02:56.366868 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:56.367010 (+   142us) write_op.cc:454] Released schema lock
0709 13:02:56.367074 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:56.453144 (+ 86070us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:56.456695 (+  3551us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":843388,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":317456,"apply.run_cpu_time_us":4515,"apply.run_wall_time_us":438470,"num_ops":13,"prepare.queue_time_us":651057,"prepare.run_cpu_time_us":40314,"prepare.run_wall_time_us":251419,"raft.queue_time_us":527676,"raft.run_cpu_time_us":30950,"raft.run_wall_time_us":245836,"replication_time_us":914463,"thread_start_us":824045,"threads_started":4,"wal-append.queue_time_us":311169,"wal-append.run_cpu_time_us":29784,"wal-append.run_wall_time_us":2302689}]]}
I20260709 13:02:59.440040 12024 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.447715 12071 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:59.551414  8285 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.556419  8364 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:59.560835  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:59.566126 12242 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:59.557871  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 222388us
I20260709 13:02:59.568835 12185 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.546192 12027 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.523706 11878 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:59.570586  8112 catalog_manager.cc:5697] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 8 to 10, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:59.584034  8293 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:59.559922  8215 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:02:59.585131  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:02:59.585361  8215 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:59.521324 12196 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:59.585973 12196 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.570779  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.571380  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.588272  8212 raft_consensus.cc:2368] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10.
I20260709 13:02:59.584530  8112 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 6 to 8, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 8 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.549996 11925 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.590034  8112 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 4 to 7, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 7 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.447047  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:02:59.578452  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.583194  8258 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.591816  8112 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 5 to 6, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 6 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:59.599800  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.559201 11965 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:02:59.568208 12071 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.609879  8293 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 9: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:02:59.514408 11993 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.513979 12179 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.568835 12245 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.572309 12107 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:59.585451 12027 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:02:59.626161  8290 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:02:59.616972  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.615355  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.615435  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:59.616379  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.571012 12050 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:02:59.619529  8362 raft_consensus.cc:1240] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:59.620572  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.434630 12232 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.629930  8892 raft_consensus.cc:2393] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:02:59.568118 12024 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:02:59.640309  8366 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:02:59.615298 11965 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.663630  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.664286  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.642014  8889 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:59.645565  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 128883us
I20260709 13:02:59.628257  8891 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
W20260709 13:02:59.648039  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.653316  8291 raft_consensus.cc:2410] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:59.655350  8897 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:59.666169  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:02:59.645717  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 118405us
I20260709 13:02:59.666793  8891 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.666980  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:59.668419 12050 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.668884  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.671475 12127 consensus_queue.cc:1059] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:59.648679  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 65619.7us
I20260709 13:02:59.663038  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:02:59.635162  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.676035  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.628808 12107 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.635057 12010 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.648859 12034 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:59.683183  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.683020  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:02:59.688138  8895 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:59.657101  8112 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:59.696041  8892 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:02:59.697547  8898 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:02:59.696256  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.699563  8894 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:59.646616 12126 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:02:59.697113  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:02:59.703528  8257 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:02:59.683704 12107 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.642181 11993 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.702323  8285 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
I20260709 13:02:59.689337 12034 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:59.710464  8257 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:59.713153  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:02:59.709800  8862 leader_election.cc:400] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10.
I20260709 13:02:59.692977 11992 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.712184  8895 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:59.714253  8862 leader_election.cc:403] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:59.712968  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:02:59.700354 12129 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:02:59.743705  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 66426.4us
I20260709 13:02:59.712620 12161 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:59.715462 12034 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:59.756745  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 43861us
I20260709 13:02:59.702847 11990 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:02:59.795934  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 91254.5us
I20260709 13:02:59.800920  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.709475 12190 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.740099 12005 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.706095 12196 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.751740  8112 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.819658 11999 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:59.820130 11999 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.820454 11999 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.822371  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:02:59.826102 12139 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:59.826683 12139 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:02:59.827647 12139 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.827904 12154 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:02:59.829475 12273 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:59.833060  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.834527 12038 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:59.835214 11993 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.835760 11993 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.836174 11993 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.837482  8292 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:59.837718 12235 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:02:59.838240 12235 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.838860  8112 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.840759  8112 catalog_manager.cc:5697] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:02:59.845225  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.846041  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.846733  8359 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:02:59.847203  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.846767  8367 raft_consensus.cc:3055] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:59.849195  8367 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:02:59.850111  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.850987  8210 raft_consensus.cc:2410] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:59.851629  8891 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:59.851910  8112 catalog_manager.cc:5697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:02:59.755066 12161 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:02:59.864086  8287 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:02:59.853616  8112 catalog_manager.cc:5697] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 6, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 6 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.877238  8216 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.813759 12129 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.883119  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:02:59.826136 12137 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.818437 12218 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.829983 12154 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.880045  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:02:59.862799 12027 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10.
I20260709 13:02:59.862448 12161 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.861419 11993 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.916613  8112 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 7, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 7 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.898860 12179 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:02:59.933017  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.929804  8112 catalog_manager.cc:5697] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 8, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 8 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.944504 12024 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:02:59.943953  8112 catalog_manager.cc:5697] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 1 to 6, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 6 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.946062  8112 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 4 to 6, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 6 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:59.948532  8112 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 4 to 6, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 6 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:02:59.930900 12232 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:02:59.952844  8112 catalog_manager.cc:5697] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.988351  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:02:59.988965  8210 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
W20260709 13:02:59.950026 12180 consensus_meta.cc:287] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.551s	user 0.002s	sys 0.006s
W20260709 13:02:59.961337 12021 consensus_meta.cc:287] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 13:02:59.950237 12234 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:59.995064  8112 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:59.998360  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.909256 12218 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.954882 12190 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:00.000819  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 578077us
I20260709 13:02:59.959525 12196 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:00.002219 12231 consensus_meta.cc:287] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.006s
I20260709 13:03:00.017797  8112 catalog_manager.cc:5697] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:00.028796  8289 raft_consensus.cc:2410] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:59.953951 12034 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:00.001197 12194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.004s	sys 0.015s
W20260709 13:03:00.023869  8864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.030s	sys 0.054s
W20260709 13:03:00.034925  8864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.030s	sys 0.055s
W20260709 13:03:00.035256  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 577896us
W20260709 13:02:59.995594 12275 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.004s
I20260709 13:02:59.963480 11925 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.981611 12219 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:02:59.957680 12107 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:00.043437  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.035056  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:00.034866 12194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.005s	sys 0.015s
I20260709 13:03:00.067085  8889 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 14: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:00.067494  8112 catalog_manager.cc:5697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 4 to 7, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 7 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:00.072970  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.105537  8184 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.110378 11987 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:03:00.106849  8863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.002s	sys 0.039s
W20260709 13:03:00.111009  8863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.002s	sys 0.039s
W20260709 13:03:00.111589  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 576525us
W20260709 13:03:00.111534 12282 log.cc:927] Time spent T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:03:00.110894 12284 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.005s
I20260709 13:03:00.066946 11990 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:00.074386 12184 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:00.122392  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 467559us
I20260709 13:03:00.110270 12180 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:00.061271 12071 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.127637  8184 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:00.122346 12190 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.131137  8863 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:00.131698  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.005s	sys 0.022s
W20260709 13:03:00.133500  8213 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.026s
W20260709 13:03:00.133232  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.005s	sys 0.022s
I20260709 13:03:00.136211  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:00.143914  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.144981  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:00.145697  8214 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.147960  8897 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:00.148908  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.130441 11999 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:00.132606 12184 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:00.133514 12180 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:00.162830 12010 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.163746  8864 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.172765  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.120110 11987 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.184118  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:00.137532 12127 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:03:00.140359 12179 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:03:00.189558  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 53452.3us
I20260709 13:03:00.190855  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:00.183940  8284 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.013s	sys 0.025s
I20260709 13:03:00.163261 12128 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.145632 12190 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.178620 12219 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:00.205022  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:00.205864  8210 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 14: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:00.153527 11965 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.164217 12129 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:03:00.213589  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 93232.7us
I20260709 13:03:00.214803  8184 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.233987 12242 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.238580 12303 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.239137 12194 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:00.239562 11925 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:00.240702  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:00.244172  8360 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:03:00.224069 12034 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.246454  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:00.247110  8291 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:00.249516  8218 raft_consensus.cc:1240] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:03:00.239637 12290 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:00.255658 12190 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.258311 11999 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:00.259284  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.259852  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:00.201685 12288 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:00.262233  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:03:00.262471  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 57386.5us
I20260709 13:03:00.263708  8363 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:03:00.259891  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:03:00.267930 12285 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:03:00.268572  8213 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.261379  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:00.239557 12194 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:00.272486  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.280894  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:00.281488  8365 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.281716  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:00.272083  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:00.279688  8214 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:00.279834  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.284327  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.284087  8358 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:00.287843  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:00.288621  8290 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:03:00.288975  8290 pending_rounds.cc:85] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting all ops after (but not including) 10
I20260709 13:03:00.289283  8290 pending_rounds.cc:107] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:03:00.289523  8290 raft_consensus.cc:2889] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.228931 12300 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:00.293803  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:00.296021  8287 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.296447  8898 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:00.293851  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.298527  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:00.299186  8894 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.321187  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:00.284053 12194 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.323441  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:00.326838  8291 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 12: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:00.282171 11993 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:00.287829 12290 raft_consensus.cc:697] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:00.290503 12218 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.290953 11999 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.331377  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:00.337343  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:00.337466  8363 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.288044 12184 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.332965 11993 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:00.296988 12128 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.329347 12228 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:00.358863  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:00.338007  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 178543us
I20260709 13:03:00.321345 12107 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.339264  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:00.330046 12139 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.377799  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 186936us
W20260709 13:03:00.382685  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 89228.4us
I20260709 13:03:00.342617 12071 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:00.356946 12288 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.397784  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 122168us
I20260709 13:03:00.401469  8363 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
W20260709 13:03:00.402278  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 43520.1us
I20260709 13:03:00.403028  8332 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:00.404454  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:00.342902 12129 consensus_queue.cc:1243] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:00.363040 12228 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:00.413674  8365 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:00.415877  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:00.410892 12235 consensus_meta.cc:287] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.002s
I20260709 13:03:00.420956  8287 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:00.421857  8863 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.367663 12128 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.412149 12228 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.406134 12107 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.410678 12219 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.335426 12180 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.428805  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:00.386063 12139 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.443404  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.427769 12235 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.447391 12128 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.449050 12235 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.430213 12127 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.442354 12290 consensus_queue.cc:237] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:00.437830 12190 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.451125 12190 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.454656  8863 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:00.460238 12218 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.410014 12288 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.442380 12287 consensus_queue.cc:1059] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:00.465581  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:00.465893 12161 consensus_meta.cc:287] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.004s
I20260709 13:03:00.466470 12161 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:00.468523 12161 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:00.469094 12107 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:00.469233  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:00.469955  8209 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:00.470500  8213 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:00.465838 12320 raft_consensus.cc:3055] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:00.475116  8218 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:00.415354 12316 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:00.420542 12196 consensus_queue.cc:1059] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:03:00.430532 12050 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:00.450610 12301 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.508s	user 0.005s	sys 0.002s
W20260709 13:03:00.485459  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 96155.7us
W20260709 13:03:00.485532  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 69766.8us
I20260709 13:03:00.488384  8894 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
W20260709 13:03:00.491784 12310 log.cc:927] Time spent T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:00.453459 12071 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.495765  8864 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.497130  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:00.464826 12139 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.501072  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:00.472417 12314 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.477656 12320 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:00.484061 12179 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:00.480924 12161 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:00.505229  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.512480  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 2272) took 1080 ms. Trace:
I20260709 13:03:00.516726  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:00.535769  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.508539 12010 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.538693  8864 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:00.538836  8332 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:00.541299  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:00.542089  8287 raft_consensus.cc:2368] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10.
I20260709 13:03:00.513209 12321 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:00.544590  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.546687  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.515764  8286 rpcz_store.cc:276] 0709 13:02:59.429816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.429935 (+   119us) service_pool.cc:224] Handling call
0709 13:02:59.456568 (+ 26633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.531318 (+ 74750us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:00.028378 (+497060us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.301014 (+272636us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.301495 (+   481us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.327845 (+ 26350us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.327995 (+   150us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:00.328031 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.328099 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.509891 (+181792us) raft_consensus.cc:1685] finished
0709 13:03:00.509916 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.510065 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23255,"prepare.queue_time_us":130543,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":73,"raft.queue_time_us":24477,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":10158,"spinlock_wait_cycles":12429440,"thread_start_us":751792,"threads_started":2,"wal-append.queue_time_us":335651}
I20260709 13:03:00.547643 12242 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:00.547861  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:00.548053 12024 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.548432  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:00.513892 12289 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.553990  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.562713 12154 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:00.563210 12288 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:00.586911  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:00.505983 12107 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:00.563906  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:00.496083 12050 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:00.568480  8894 raft_consensus.cc:2410] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:03:00.513353 12179 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:00.572306  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:00.574293  8290 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.550652 12315 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:00.574669  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:00.575276  8365 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:03:00.578161  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:00.578276  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 105256us
I20260709 13:03:00.579924  8259 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.581190 12228 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.600323  8284 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:00.582952  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:00.521307 12300 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:00.593941  8895 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:00.543701 12322 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.566604 12298 log.cc:927] Time spent T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:03:00.567770 12190 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.543190 12218 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:00.567039 12321 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:00.581221 12139 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:00.603084  8292 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 14: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:03:00.578521 12276 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:00.519448 12161 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:00.588171 12323 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:00.579017 11925 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.573966 12245 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:00.606310 12005 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:00.582593 12292 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.593493 12010 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:00.598423  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 62790.2us
I20260709 13:03:00.599526 12179 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.599077 12315 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:00.616711 12283 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.788s	user 0.005s	sys 0.000s
I20260709 13:03:00.565655 12127 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:03:00.616968 12290 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.605370 12300 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:00.613406 12218 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.635207  8290 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:00.582224 12024 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.623251 12242 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:00.647169  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:00.648303 12318 log.cc:927] Time spent T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:03:00.648833 12050 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:00.649112 12313 log.cc:927] Time spent T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:00.626039 12323 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:00.653067  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:00.625608 12139 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:00.669696  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:00.616609 12322 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:00.646680 12315 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.667232 12242 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.670814 12323 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.650707 12245 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:00.712112  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 65013.7us
I20260709 13:03:00.683355 12161 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:00.663686 12300 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:00.686916 12327 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:03:00.596647 12320 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.724457 12320 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.687067 12228 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.631109 11925 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.727979 11925 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:00.654368 12005 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:00.729148 12005 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:00.665122 12218 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.672509 12050 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:00.667547 12190 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.718895  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:00.709867  8331 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.719955  8183 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:00.666816 12010 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:00.664490 12290 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.706722 12242 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.745357  8361 raft_consensus.cc:2393] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:03:00.748627  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 210090us
W20260709 13:03:00.750679  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 175448us
I20260709 13:03:00.748931  8331 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.745077 12021 raft_consensus.cc:2764] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:03:00.760151  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:00.762765  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:00.662113 12321 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.764825  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:00.766937  8361 raft_consensus.cc:2393] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:00.750885 12228 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.771868  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:00.772468  8891 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:00.774333  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:00.775417  8890 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:00.776216  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.776724  8358 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:00.776818  8892 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:00.778224  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:00.778473  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:00.779253  8361 raft_consensus.cc:2410] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:03:00.779886  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.750013 12190 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:00.846330  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 86769.4us
I20260709 13:03:00.839818  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:00.782635  8864 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:00.848022  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 65518.4us
I20260709 13:03:00.841462  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.849004  8890 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:00.850445  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:00.754693 11925 consensus_queue.cc:1059] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:03:00.854002 11878 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.857437 12334 consensus_queue.cc:1059] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:03:00.858618 12311 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
W20260709 13:03:00.860817 12332 log.cc:927] Time spent T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:03:00.864681  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.866269 12180 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:00.866701 12180 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:00.867053 12180 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.872047 12196 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:00.873034  8183 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:00.874398 12228 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:00.874993 12228 raft_consensus.cc:697] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:00.876255 12228 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.882648 11990 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.873587 12196 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:00.883317 11990 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.883987 12196 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:00.884922 12196 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.894244 12339 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:00.894932 12339 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.895820 12196 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:00.842164  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 87602.9us
I20260709 13:03:00.843148  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.777545  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:00.897523  8891 raft_consensus.cc:2468] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
W20260709 13:03:00.810025  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.900636  8863 leader_election.cc:400] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10.
I20260709 13:03:00.902284 12322 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:00.855201 12139 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.760363 12127 consensus_queue.cc:1059] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:03:00.775223 12219 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.903226 12334 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.903437 12024 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.873579 12245 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:00.904165 12290 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:00.910092  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.914652  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 137266us
I20260709 13:03:00.897033 12339 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.775715 12292 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:00.895893 11990 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:00.917948 11999 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.933460  8332 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:00.969110  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:00.774695 12010 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:00.948256 12194 consensus_meta.cc:287] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.001s
I20260709 13:03:00.936110 12219 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.945683 12179 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.948897 12322 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:00.984303  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:00.984668  8285 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:00.985644  8892 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:00.950639 12050 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:00.951520  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:00.955402 11965 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:00.955682 12279 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.977s	user 0.004s	sys 0.004s
I20260709 13:03:00.959002 12242 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.960656 12034 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.961104 12137 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.963266 12277 log.cc:927] Time spent T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 1.022s	user 0.003s	sys 0.000s
I20260709 13:03:00.965888  8258 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:00.970644  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:00.997689  8363 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:00.934859 12334 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:00.973523 12107 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:00.970139 12129 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:00.976758  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.876964 12315 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.978193  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.991001 12322 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:00.979645 12219 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:00.982158 12194 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:00.987661  8288 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:01.020550  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:00.992133  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:00.970185 12292 raft_consensus.cc:697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:01.002156  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:01.004334  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.022435  8285 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 13: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:01.021459  8293 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:01.023830  8361 raft_consensus.cc:2410] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:01.015038  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:01.024338  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:01.027629  8286 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:03:01.028023  8286 pending_rounds.cc:85] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting all ops after (but not including) 8
I20260709 13:03:01.028228  8286 pending_rounds.cc:107] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:03:01.028457  8286 raft_consensus.cc:2889] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.027670  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.029553  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:00.915216 12323 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.007145  8890 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:01.008683  8363 raft_consensus.cc:1240] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:03:01.034570  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:01.038348  8895 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:01.038925  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 73169us
I20260709 13:03:01.039456  8889 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 12: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:01.039670  8258 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:01.039831  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.016979 12319 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.041716  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.042460  8890 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:01.005621 11965 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:03:01.007670 12338 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:01.031092 12322 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:01.046713  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.005052 12034 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.057996  8285 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:01.052963  8258 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:01.050411  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:00.996975 12180 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.050627  8183 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:01.055094  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:01.032678 12107 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:01.060156  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:01.061391  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:01.059657  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.007814 12137 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.039202 11990 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:01.067227  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.069376  8292 raft_consensus.cc:2410] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:01.070534  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.075676  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:01.053519 12219 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.060554 12307 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:01.068074 12184 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:01.114012  8284 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:01.113605  8895 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:01.115712  8258 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.078238 12287 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:01.079921 11992 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:01.126941  8890 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:01.127626  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.128137  8890 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:01.129115  8890 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:01.126699  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:01.057343 12319 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.132663  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.133608  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:01.131157  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:01.063396 12005 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:03:01.134465  8362 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
W20260709 13:03:01.126469 12309 log.cc:927] Time spent T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.009s
I20260709 13:03:01.148355  8258 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.079571 12050 consensus_queue.cc:1059] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:01.153926  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:01.124377 12287 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.130012 11925 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.115547 12347 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:01.131197 12184 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:01.136557 12311 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:01.113520 12219 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.135174 12190 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.153234 12162 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.140081 12161 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:01.152007 12335 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:01.150377 12338 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:01.155475 12234 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:03:01.180667  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 53156.1us
I20260709 13:03:01.161828 12307 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:01.160755 12311 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.054705 12292 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.184340  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.184733  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:01.162271 11925 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.187383 12162 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:01.176321 12338 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.180336 12242 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.187696  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1837) took 1924 ms. Trace:
I20260709 13:03:01.188657 12137 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.189905 12218 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.073346 12334 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.171401 11990 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:01.195781  8890 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:01.156090 12235 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:03:01.177671 12335 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:01.192983 12336 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:01.193827 12311 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:01.207122  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 49283.1us
I20260709 13:03:01.207974  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 939) took 1768 ms. Trace:
I20260709 13:03:01.204090  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.183077 12234 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.186036 12307 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:01.158308 12107 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.207585 12338 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:01.222448 12300 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.223657  8360 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:01.204922  8217 rpcz_store.cc:276] 0709 13:02:59.209192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.209322 (+   130us) service_pool.cc:224] Handling call
0709 13:02:59.266484 (+ 57162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.302799 (+ 36315us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:59.303144 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.693220 (+390076us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.712819 (+ 19599us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.712950 (+   131us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:59.712981 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.713060 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.962671 (+1249611us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:03:01.126679 (+164008us) raft_consensus.cc:1685] finished
0709 13:03:01.133513 (+  6834us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.133632 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1062,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":1168,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":3454,"spinlock_wait_cycles":47176448,"thread_start_us":389549,"threads_started":1,"wal-append.queue_time_us":608192}
I20260709 13:03:01.161386 12322 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.218768  8258 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:01.216717  8896 rpcz_store.cc:276] 0709 13:02:59.313972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.318206 (+  4234us) service_pool.cc:224] Handling call
0709 13:02:59.318549 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:59.319002 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.319030 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:59.319599 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 13:02:59.788331 (+468732us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:00.144587 (+356256us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.152383 (+  7796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.152466 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.900758 (+748292us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:03:01.079118 (+178360us) raft_consensus.cc:1685] finished
0709 13:03:01.082610 (+  3492us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.082743 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7558,"prepare.queue_time_us":535302,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":63780,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":22501,"spinlock_wait_cycles":2629376,"thread_start_us":813152,"threads_started":2,"wal-append.queue_time_us":608174}
W20260709 13:03:01.220710 12346 log.cc:927] Time spent T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Append to log took a long time: real 0.160s	user 0.000s	sys 0.002s
I20260709 13:03:01.210387 12290 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:01.216675 12335 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.242038  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.205821 12315 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:01.242215  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.247057  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:01.217384 12317 log.cc:927] Time spent T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.654s	user 0.002s	sys 0.004s
I20260709 13:03:01.209394 12162 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.252941 12162 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.230691 12307 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.256275  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:01.232972 12356 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.259217  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:01.260601 12348 log.cc:927] Time spent T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:03:01.262665 12334 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.246064 11990 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:01.254935 12139 raft_consensus.cc:2804] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:01.250990 12180 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.256428 12360 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.243733 12184 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.284164 12338 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.285590  8286 raft_consensus.cc:2368] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10.
I20260709 13:03:01.286298 12357 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:01.286877 12357 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.288874 12357 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.289330 12357 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:01.259616 11999 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:01.290701 12353 log.cc:927] Time spent T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:01.291198 12219 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.230468 12336 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.292361 12156 raft_consensus.cc:3055] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:01.292765 12156 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:01.293442 12336 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.290779  8293 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:01.275354 12290 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:01.298090 12290 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:01.298480 12290 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:01.293601 12156 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:01.291280 12306 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.881s	user 0.000s	sys 0.012s
I20260709 13:03:01.289737 12357 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:01.309830  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.303494 12156 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.311030 12360 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.314954 11993 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:01.316311  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.317322 12335 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.325390  8894 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:01.327859  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.329388 12289 raft_consensus.cc:3055] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:01.329792 12289 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:01.330358  8214 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:01.330651 12289 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.331431  8889 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:01.331729 12289 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:01.332705  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:01.333410 12351 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:03:01.333971 12139 raft_consensus.cc:697] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:01.329797  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:01.335004  8211 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:01.340369  8284 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:01.340643  8894 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:03:01.341848  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:01.342636  8213 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:01.303534  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:01.346740 12221 raft_consensus.cc:3055] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:01.345942 12335 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:01.347136 12221 raft_consensus.cc:740] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:01.347031 12290 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.349344 12179 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:01.349512 12290 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.352880 12287 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.354799  8367 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.331621  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:01.363313  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:01.376219  8367 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:01.377036  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1045) took 1755 ms. Trace:
I20260709 13:03:01.364638  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:01.377403  8897 rpcz_store.cc:276] 0709 13:02:59.622143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.680631 (+ 58488us) service_pool.cc:224] Handling call
0709 13:02:59.694888 (+ 14257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.152033 (+457145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.367261 (+1215228us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540075dd54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:01.376977 (+  9716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042060160}
I20260709 13:03:01.346307 12319 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.378666  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:01.387409  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.317406 12321 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.313956 12360 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.332705 12194 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.314185 12357 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.412075  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:01.419302  8367 raft_consensus.cc:1275] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:01.420253  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1904) took 1575 ms. Trace:
I20260709 13:03:01.420656  8367 rpcz_store.cc:276] 0709 13:02:59.845099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.846334 (+  1235us) service_pool.cc:224] Handling call
0709 13:02:59.846623 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.235278 (+388655us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b4c0042b100. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efa519a20 00007f2efa52aa29 00007f2efa4f0644 00007f2efa517f2d 00007f2efa517b93 00007f2efc24818b 00007f2efc248cb5 00007f2efc243f30 00007f2efc2457de 00007f2efc24fb49 00007f2efc250416
0709 13:03:01.338636 (+1103358us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400256320. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc1cb06f 00007f2efc243f60 00007f2efc2457de 00007f2efc24fb49 00007f2efc250416 00007f2efc24cd8f 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62
0709 13:03:01.419985 (+ 81349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.420193 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418430592}
I20260709 13:03:01.340500 12235 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:03:01.385878 12242 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:03:01.424278  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 182390us
I20260709 13:03:01.432425  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:01.434409  8891 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:01.423772 12154 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:01.412762 12190 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:01.439538  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.448928  8217 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:01.459995  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:01.424046 11992 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:01.463563  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:01.395561 11999 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:03:01.434188 11925 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.434590 12338 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.431941 12357 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:01.450675 12242 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:01.461324 12154 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:01.463380 12196 consensus_meta.cc:287] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:03:01.422305 12335 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.475697  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.481113  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.480683 12335 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.433296 12107 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:01.482568 12107 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.484737 12107 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.460485 12231 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:03:01.469172  8891 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:01.479463  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:01.488826  8894 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:01.488170  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:01.466507 12290 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:01.465737 12190 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:01.491323  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:01.499176  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:01.450330 12142 consensus_queue.cc:1048] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:03:01.472023 12287 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:01.449266 12345 consensus_queue.cc:1059] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:03:01.486143 12154 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.478675 12137 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:01.508973 12190 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.431814 12221 consensus_queue.cc:260] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.514760 12221 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:01.515857 12242 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.517131  8894 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:01.517762  8889 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:01.502049 12287 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.518509 12287 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.474916 11992 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.518844  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.520421 11992 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.520870  8894 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:01.521446 12365 log.cc:927] Time spent T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:03:01.461628 12139 consensus_queue.cc:237] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.487841 12323 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:01.523686  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.522804 12137 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:01.478895 12357 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.502763 12338 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:01.492444 12290 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.534469  8891 raft_consensus.cc:3055] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:01.546119  8891 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:01.536432  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:01.546923  8367 raft_consensus.cc:2410] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:03:01.537309  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:01.541608  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:01.542420  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:01.547405  8365 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:01.548358  8259 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:01.503636 12196 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.554560  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:01.554404  8891 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.555769  8891 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:01.554697  8362 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:01.554396  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:01.557425  8359 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:01.539188 12320 raft_consensus.cc:3055] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:01.569983 12320 raft_consensus.cc:740] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:01.570161 12287 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.570961  8891 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:01.570894 12320 consensus_queue.cc:260] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.571950 12320 raft_consensus.cc:3060] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:01.572352 12038 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:01.567752  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:01.567553  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.574610  8287 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 12: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:01.563802 12196 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.567543 12137 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.577193 12137 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.577778 12196 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:01.579082 12360 consensus_queue.cc:1175] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca43983edda443fa9d74c1f80252f1fc" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 13:03:01.568379  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.580242  8291 raft_consensus.cc:2410] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:03:01.583288 12300 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.568591 12357 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.589509  8217 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:01.592494  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:01.594475  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:01.595810  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:01.596704  8331 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:01.556315 12290 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.613341  8892 raft_consensus.cc:2368] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10.
I20260709 13:03:01.551561 12366 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:01.617599  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:01.559644 11992 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:01.617735  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:01.618067  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.618304  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:01.626487  8217 raft_consensus.cc:2393] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:01.626855  8894 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:01.618712  8216 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:01.619441 12161 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:01.620141  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:01.629043  8218 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:01.625626  8211 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
W20260709 13:03:01.621171 12371 log.cc:927] Time spent T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:01.560230 12156 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:01.623278  8863 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:01.624763  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:01.625903  8292 raft_consensus.cc:2410] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:03:01.628597  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.586400 12287 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:01.635656  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.630100  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:01.563877 12338 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:01.639992  8214 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 7: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:01.644157  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:01.644047  8862 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.645231  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.609659 12357 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:01.628718 12161 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:01.649478 12161 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:01.651067 12154 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.651350 12234 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.641099 12156 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.652848 12156 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.653192 12154 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.610823 12142 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:03:01.632959 12366 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.657740 12342 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:01.658349 12342 raft_consensus.cc:697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:01.658564 12366 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.659301 12342 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.659876 12338 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.662703 12316 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.663154 12316 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.665200 12316 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.662283 12010 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:01.666807  8212 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:03:01.670287 12010 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:01.670792 12010 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:01.671972 12010 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.669852 12234 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.622632 12300 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.681209  8894 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:01.682644  8863 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:01.708101  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 93594.1us
W20260709 13:03:01.642884 12372 log.cc:927] Time spent T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:03:01.709779  8257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.710413  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.712101  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:03:01.719972  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 98539us
I20260709 13:03:01.727674  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.641677 11925 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.642036 11992 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.729581  8293 raft_consensus.cc:1240] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:01.677383 12179 raft_consensus.cc:2764] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:03:01.645167 12034 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.730145  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:01.736382  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:01.731686  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.736912  8290 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.738030  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.738955  8289 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:01.732913  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:01.738629  8892 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:01.733565  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:01.732168  8287 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:01.735625  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:01.742638  8894 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:01.721417 12221 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:01.749451 12368 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:03:01.705876 12190 consensus_queue.cc:1059] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:03:01.760474 12221 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.762758 12221 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:01.708534 12357 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.768911 12357 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:01.772385  8258 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:01.726632 11878 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:01.673838 12307 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.774708  8290 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
W20260709 13:03:01.777226  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.732290 11992 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.791218  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:01.824795  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 52503.6us
I20260709 13:03:01.831497  8892 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:03:01.739573 11925 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:01.778442 12336 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:03:01.836814 12137 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:01.893743  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.950584  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.952297  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.948444 12289 consensus_meta.cc:287] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.003s
I20260709 13:03:01.816047 12010 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:03:01.965020 12156 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:01.966233  8897 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
W20260709 13:03:01.977135  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 151463us
W20260709 13:03:02.005657 12384 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:03:02.070595  8285 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:01.833176 12290 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.006004 12334 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:03:02.092020 12311 consensus_meta.cc:287] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.000s
I20260709 13:03:02.108917  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:02.109614  8285 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.092788 12334 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.112166 12242 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:03:02.155177  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.161226  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1057) took 1134 ms. Trace:
I20260709 13:03:02.161751  8895 rpcz_store.cc:276] 0709 13:03:01.026307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.118339 (+ 92032us) service_pool.cc:224] Handling call
0709 13:03:01.534955 (+416616us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.632219 (+ 97264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.632252 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:01.632640 (+   388us) log.cc:844] Serialized 52 byte log entry
0709 13:03:01.720590 (+ 87950us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:01.740808 (+ 20218us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.795389 (+ 54581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.795476 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.091210 (+295734us) raft_consensus.cc:1685] finished
0709 13:03:02.091234 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.160989 (+ 69755us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400678c50. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:02.161126 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150885,"prepare.queue_time_us":15093,"prepare.run_cpu_time_us":231,"prepare.run_wall_time_us":232,"raft.queue_time_us":151629,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":27465,"spinlock_wait_cycles":957663488,"thread_start_us":71307,"threads_started":1,"wal-append.queue_time_us":114100}
I20260709 13:03:02.163872 11925 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:02.164934  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.167582 12218 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.170143  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.170915  8291 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:03:02.172119  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:02.173424  8360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51072 (request call id 775) took 1411 ms (client timeout 1824 ms). Trace:
W20260709 13:03:02.173894  8360 rpcz_store.cc:269] 0709 13:03:00.761469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.762501 (+  1032us) service_pool.cc:224] Handling call
0709 13:03:02.173155 (+1410654us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54001f7054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:02.173290 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058691968}
I20260709 13:03:02.179419 12335 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.180418  8863 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.181723 11925 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:02.182365 11925 raft_consensus.cc:697] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:02.114152 12221 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:02.187947  8285 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:02.185025  8257 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:02.109094 12311 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.189514  8257 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:02.184950  8291 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:02.196676  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:02.196779  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:02.197691  8218 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.143290 12307 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.119029 12161 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.195042 12357 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:02.204237  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.205022  8285 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:02.196458 12039 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.205958  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.206437  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.206725  8285 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:02.208709  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.209733  8285 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:02.215682 12156 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:02.217856 12352 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 1.079s	user 0.005s	sys 0.010s
I20260709 13:03:02.204806 12373 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:02.187835 12242 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.245640  8218 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:02.248914 12161 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.249526 12107 raft_consensus.cc:3055] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:02.249953 12107 raft_consensus.cc:740] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:02.250852 12107 consensus_queue.cc:260] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.251902 12107 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:02.183391 11925 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.198130 12221 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.265391  8291 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:03:02.270187  8183 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.061s	sys 0.068s
W20260709 13:03:02.274036  8183 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.061s	sys 0.068s
I20260709 13:03:02.274303  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:03:02.274488  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 592355us
W20260709 13:03:02.274953  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 240733us
I20260709 13:03:02.275147  8218 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.228569 12357 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.238443 12307 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:03:02.281529  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:02.285063  8218 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:02.285828  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.290427 12339 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:02.290880 12339 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:02.291252 12339 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.294633 12179 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:02.294859  8211 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:02.296193  8211 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:03:02.296473  8211 pending_rounds.cc:85] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 6
I20260709 13:03:02.296680  8211 pending_rounds.cc:107] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:03:02.296885  8211 raft_consensus.cc:2889] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:02.297745 12321 consensus_meta.cc:287] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.902s	user 0.007s	sys 0.000s
I20260709 13:03:02.270355 12139 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.298918 12339 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.299562 12311 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.300535 12334 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.301147 12339 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.304893  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 2296) took 1054 ms. Trace:
I20260709 13:03:02.305320  8286 rpcz_store.cc:276] 0709 13:03:01.249996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.250136 (+   140us) service_pool.cc:224] Handling call
0709 13:03:02.304653 (+1054517us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5400172ad4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:02.304800 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58989312}
I20260709 13:03:02.307780  8332 leader_election.cc:400] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10.
I20260709 13:03:02.308157  8332 leader_election.cc:403] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:03:02.307682 12179 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:02.310118 12179 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.311084 12179 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:02.291244 12386 log.cc:927] Time spent T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:03:02.315390  8184 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:02.315897 12234 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:02.316303 12234 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:02.317396  8210 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.318648  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.279013 12290 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.329934  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.323136  8218 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:02.322705 12221 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.339154  8218 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:02.339186  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.345575 12039 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:02.346129 12039 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:02.346678 12373 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:02.346922 12039 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:02.348853 11992 consensus_meta.cc:287] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.001s
I20260709 13:03:02.343976  8257 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.286804 12292 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:02.351210 12154 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:02.353608  8286 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:02.357120 12335 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.357653 12335 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.359310  8289 raft_consensus.cc:1240] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:02.298882 12139 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.317838 12339 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:02.321960 12321 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.323146 12311 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.352751 12156 consensus_queue.cc:1059] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:03:02.342962 12221 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.349248 11992 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.364318  8289 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:02.371106 11987 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.376313  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.377262  8332 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:02.381281  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.382512 12335 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:02.360530 12391 log.cc:927] Time spent T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:03:02.396130  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:02.368458  8286 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:02.368192  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.409070  8210 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:02.410754  8218 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:02.411993  8331 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:02.414374  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:02.353134 12231 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:02.418005  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:02.403038 12357 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:02.419479  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.423339  8212 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:02.365011 12321 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.367161 12245 raft_consensus.cc:3055] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:02.421168 12242 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.365737 12154 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:02.403467 12221 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.424994  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.454677  8212 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:03:02.455543  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.455737  8898 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:02.456596  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.424091 12218 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.363269 12292 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.427263  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.428648 12156 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:02.434662  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:02.440809  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:02.450935  8862 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:02.451720  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:02.451882  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:02.365661 12342 consensus_queue.cc:1059] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:03:02.426038  8331 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:02.422247 12335 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.457641  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.432389 12321 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.460263  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.466142  8893 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:02.472009  8889 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.415872 11987 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:03:02.472617  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.431833 12245 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:02.464955  8892 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:02.408907 12311 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.466517  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:02.473647  8862 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:02.472481  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:02.471666  8212 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:02.430032 12307 consensus_queue.cc:1059] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:03:02.482856  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 167609us
I20260709 13:03:02.467937 12335 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.485625  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:02.461349 12218 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:02.490833 12218 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.463940 12156 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:02.494036 12156 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.466786 12010 raft_consensus.cc:3055] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:02.471076 12242 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:02.490370 12184 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.496311 12357 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.497264  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.499373 12336 consensus_queue.cc:1059] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:02.475838 12342 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.484352 12219 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:02.506191  8360 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:02.516278  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.506951  8361 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:02.507709  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.508016  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.518932  8358 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:02.509055  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:02.509690  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.520500  8367 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:02.521917  8367 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:02.512020  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.523111  8365 raft_consensus.cc:2393] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:02.489612 11987 consensus_queue.cc:1243] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:02.520594  8363 raft_consensus.cc:2393] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:02.511382  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:02.539458  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.553249  8359 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:02.496290 12010 raft_consensus.cc:740] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:02.559365  8358 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:03:02.560145  8367 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:02.560321  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2511) took 1068 ms. Trace:
I20260709 13:03:02.497965 12242 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:03:02.568007  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 97340.3us
I20260709 13:03:02.572271  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.573033  8332 leader_election.cc:400] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10.
I20260709 13:03:02.560691  8293 rpcz_store.cc:276] 0709 13:03:01.491556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.494319 (+  2763us) service_pool.cc:224] Handling call
0709 13:03:01.494609 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.732192 (+237583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.560095 (+827903us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400146254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:02.560266 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539754240}
I20260709 13:03:02.575188  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:02.558712 11987 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:02.570971 12342 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:03:02.596024  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.576465 12242 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.598580  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.600035  8367 raft_consensus.cc:1240] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:02.513489 12357 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.503515 12154 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.594349 12219 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.589385 12401 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:02.617658 12311 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.618026 12401 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:02.618618 12401 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.620683 12401 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.621901 12401 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:02.622213 12010 consensus_queue.cc:260] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.623467 12010 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.624765 12234 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.625941 12234 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.626590 12292 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:02.627234 12396 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:02.627640 12396 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:02.628280 12357 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.628443 12396 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.629456 12396 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.634953 12137 raft_consensus.cc:3055] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:02.635439 12137 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:02.637993 12401 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:02.642598  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:02.606724 12139 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.618328 12311 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.653995 12221 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.606300 12245 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.658209 12401 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.658867 12245 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:02.658623 12321 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.660732 12321 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.661391  8212 raft_consensus.cc:1240] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:02.606485 11987 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.662681  8211 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:02.663285  8285 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:02.664016 11987 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:02.609061 12342 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.671340  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.672017  8359 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:02.672827  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.673929  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:02.674492  8365 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.641844 12219 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.682204  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.683063  8361 raft_consensus.cc:2410] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:03:02.685163  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.685604  8360 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:02.686724  8359 raft_consensus.cc:1240] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:02.687937  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 91460.9us
I20260709 13:03:02.662881  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 932) took 1101 ms. Trace:
I20260709 13:03:02.689428  8257 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.690196 12231 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:02.690371 12342 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:02.690758 12231 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.692593  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:02.693033 12335 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:02.693430  8898 raft_consensus.cc:2410] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:03:02.693799 12311 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.694406 12139 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:02.694895 12139 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:02.695801 12139 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.696566 12305 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:02.697105 12305 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.698372  8364 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:02.698800 12039 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:02.292892  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:02.699313 12039 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.699885 12219 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:02.701395 12039 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:02.701483  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.699038 12305 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:02.706529 12231 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.653388 12156 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.712007  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 1065) took 1007 ms. Trace:
I20260709 13:03:02.735762  8897 rpcz_store.cc:276] 0709 13:03:01.705053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.705505 (+   452us) service_pool.cc:224] Handling call
0709 13:03:02.711846 (+1006341us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54005c9ed4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:02.711949 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547333504}
I20260709 13:03:02.717049  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.736951  8291 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:02.736822  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.717432  8889 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
W20260709 13:03:02.717985 12379 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.748s	user 0.003s	sys 0.000s
I20260709 13:03:02.745308  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.746035  8211 raft_consensus.cc:2393] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:02.746652 11992 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.748004  8894 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:02.748890  8218 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:02.688979  8292 rpcz_store.cc:276] 0709 13:03:01.561373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.561499 (+   126us) service_pool.cc:224] Handling call
0709 13:03:02.662661 (+1101162us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b5400187c54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:02.662826 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117100800}
I20260709 13:03:02.718338  8285 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:02.646808 12218 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.723728  8365 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:02.727213 12137 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.728969  8363 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:02.730011  8290 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:02.731391  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.731839  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:02.754235  8293 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.732376  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:02.733713  8896 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:02.696556 12311 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.734321  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:02.761654  8210 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:03:02.734694  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.735257  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.739390  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.739543  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.739718  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.763417  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:02.763793  8898 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.740134  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:02.740530  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.764796  8216 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:03:02.741425  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.742203 12399 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:03:02.743183 12403 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:03:02.748921  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.750924  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.756268  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.772796 12357 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:02.772907  8288 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:02.773352 12357 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:02.774355  8286 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:02.774293 12357 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.775478  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:02.776536  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.777232  8292 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 14: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:02.767750 12320 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.777760 12320 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.778401  8183 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.779292 12397 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:02.779700 12397 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:02.780230 12397 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.780483  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:02.781044  8287 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.781111  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.780031 12414 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:02.781742  8284 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:02.734973 12228 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.782060 12414 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.782678 12228 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.784662 12228 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.770573 12408 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.753899  8890 raft_consensus.cc:2393] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 14: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:02.786970  8183 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.797186  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.804344  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:02.760124 11992 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.764961  8889 raft_consensus.cc:1275] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:02.764034  8896 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
W20260709 13:03:02.765563  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.766258  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.767153 12218 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.767964  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.769268  8863 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:02.804970  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:02.779651 12320 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.814558  8864 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:02.815310  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:03:02.811980  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.812574 12338 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.770537 12034 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:02.799612 12415 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.785869 12408 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.803984 12231 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:03:02.806865 12228 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:02.777148  8293 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
W20260709 13:03:02.825929  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.827262  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 58108.1us
I20260709 13:03:02.864059  8863 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:02.827793  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.866724  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:02.812389 12290 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.872001  8364 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:02.874832  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:02.830060  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:02.831595  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.838922  8898 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:02.840838  8213 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:03:02.833072  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.847586  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:02.848109  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1932) took 1136 ms. Trace:
I20260709 13:03:02.880174  8217 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:02.883426  8863 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:02.889529  8210 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:02.834187 12137 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.893396  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:02.842247 12142 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.898412 12412 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:02.898746 12242 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.869577 12184 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:02.900224 12397 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:02.833225 12179 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.839723 12415 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.842651 12408 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:02.845000 12414 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.846314 12228 raft_consensus.cc:697] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:02.901434  8363 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:02.893998  8365 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.904582  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:02.880579  8362 rpcz_store.cc:276] 0709 13:03:01.711349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.711527 (+   178us) service_pool.cc:224] Handling call
0709 13:03:01.721388 (+  9861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.721859 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:01.721887 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.727301 (+  5414us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.303711 (+576410us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b18003b3140. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1 00007f2efc208a0f
0709 13:03:02.526538 (+222827us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:02.526582 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.526658 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.847829 (+321171us) raft_consensus.cc:1685] finished
0709 13:03:02.847849 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.848048 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4650,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6857,"spinlock_wait_cycles":6275456,"thread_start_us":222603,"threads_started":1,"wal-append.queue_time_us":884140}
I20260709 13:03:02.906329  8216 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:02.832824 12342 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.868960 12194 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.827922 12339 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10.
I20260709 13:03:02.878988 12290 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:02.950496  8367 raft_consensus.cc:1240] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:02.904840 12034 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.904541 12411 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.953601  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.956703  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.957062  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:02.957412  8360 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:02.957651  8358 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.907423 12184 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.960758  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.957257  8364 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
W20260709 13:03:02.757202  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 182154us
I20260709 13:03:02.820634  8287 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:02.878643 12219 consensus_queue.cc:1059] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:03:02.966010  8362 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:02.971312  8332 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:02.973760  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.975591  8358 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:02.986146  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.987159  8364 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:02.853089 12338 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:02.993721  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.828842 11992 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:02.904409 12010 consensus_queue.cc:1059] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:03:02.995738  8361 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:03:02.995949  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 191095us
I20260709 13:03:02.948997 12342 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.996236  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:02.992986  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:03.003823  8365 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:02.849821 12311 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 13:03:03.006503  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.008008  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.021361  8292 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:02.961483 12411 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:03.024297  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 205257us
I20260709 13:03:03.031195  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.032117  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.033141  8291 raft_consensus.cc:2393] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:03.034770  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.968165 12184 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.996368 12245 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:03:02.966478 12034 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.040962 12034 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:03.044948 11992 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:02.998802 12107 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:03.046540 12107 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.046967 12107 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.035985 12411 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.012308 12342 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.052330 12242 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:03.053270 12397 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.054193 12397 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.054713 12242 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.054675 12397 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:03.055270 12242 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.056082 12338 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:03.058095 12242 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:03.036121 12339 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:03.059293 12339 raft_consensus.cc:697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:03.060236 12339 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.064659 12408 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:03.064930  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:03.065253 12408 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:03.066125  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:03.066090 12408 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:03.067232 12408 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.009575  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.010733  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:02.956028 12290 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.011765  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:03.030570  8259 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:03.098765  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 68307.8us
I20260709 13:03:03.100103  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:03.101243  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:03.099102  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 967) took 1523 ms. Trace:
W20260709 13:03:03.074586  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.104665  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:03.105878 12414 consensus_queue.cc:1059] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:03.106881 12242 raft_consensus.cc:3055] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:03.107246 12242 raft_consensus.cc:740] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:03.108161 12242 consensus_queue.cc:260] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.109687 12242 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.116454  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.081080  8286 raft_consensus.cc:2410] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:03.074748 12311 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.095135 12381 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:03:03.097612  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:03.088994 12290 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:03.094089 12415 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:03.093000  8287 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:03.167826  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 284561us
I20260709 13:03:03.155615  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.102788  8891 rpcz_store.cc:276] 0709 13:03:01.575580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.590473 (+ 14893us) service_pool.cc:224] Handling call
0709 13:03:01.590829 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.631811 (+ 40982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.631841 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.632304 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.357015 (+724711us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b480002f058. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f01176aa1 00007f2f0116db37 00007f2f0116d9ca 00007f2f0126526f 00007f2f01264f37 00007f2f0127955c 00007f2f01279508 00007f2f01279488 00007f2f01279443 00007f2f012786ec 00007f2f001a2a96
0709 13:03:02.682400 (+325385us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b18003944e0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1 00007f2efc208a0f
0709 13:03:02.963981 (+281581us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:02.964025 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.964113 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.098868 (+134755us) raft_consensus.cc:1685] finished
0709 13:03:03.098890 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.099041 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43333,"raft.queue_time_us":40884,"raft.run_cpu_time_us":13079,"raft.run_wall_time_us":721947,"spinlock_wait_cycles":31298176,"thread_start_us":268475,"threads_started":1,"wal-append.queue_time_us":1423951}
I20260709 13:03:03.147861  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:03.029529 12398 log.cc:927] Time spent T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:03:03.135294  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 305409us
W20260709 13:03:03.174028  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.174819  8864 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:03.176194  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:03.177313  8864 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:03.074174 12416 log.cc:927] Time spent T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:03.179332  8365 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:03.180037 12336 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.180877 12336 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:03.181524 12336 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.138641  8293 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:03.140422  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:03.186144  8363 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 7.
I20260709 13:03:03.141149  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:03.027032 12194 raft_consensus.cc:3055] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:03.187713 12194 raft_consensus.cc:740] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:03.188752 12194 consensus_queue.cc:260] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.190946  8259 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:03.191928 11999 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:03.193480 11999 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:03.194585 11925 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:03.070052 12156 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.094699 12184 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.199435 12184 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:03.201061 12184 consensus_queue.cc:1059] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:03.169868  8288 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:03.170317 12412 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:03.202873 12412 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.205135 12412 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.170807  8291 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:03.029117  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:03.193857 11999 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.209589 11999 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:03.215754 12179 consensus_queue.cc:1059] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:03.218549 12336 raft_consensus.cc:3055] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:03.219015 12336 raft_consensus.cc:740] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:03.219914 12336 consensus_queue.cc:260] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.221249 12336 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:03.227124 11925 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:03.232219 11925 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:03.237896  8211 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:03.248435 11925 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:03.252756  8864 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:03.255460 12338 consensus_queue.cc:1048] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:03.130607 12142 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.134604 11992 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:03.139024 12126 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:03.261354 12139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.045s	sys 0.124s
W20260709 13:03:03.267073  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 111618us
I20260709 13:03:03.261009 12245 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.137897 12219 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:03.271327  8213 raft_consensus.cc:2410] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:03:03.272745  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.273319  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.286037  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:03.287106  8211 raft_consensus.cc:2410] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:03:03.266279 11925 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.298583  8284 raft_consensus.cc:1240] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:03.282583 12139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.046s	sys 0.125s
W20260709 13:03:03.301570  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 197380us
I20260709 13:03:03.305656  8184 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.135242 12307 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 13:03:03.307415  8212 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:03.147377 12311 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:03.284893 12142 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.279223 12401 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.314023  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 443577us
I20260709 13:03:03.268054 12357 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:03:03.263535 12424 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:03:03.138636 12228 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:03.309754  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 230220us
I20260709 13:03:03.361450  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:03.343130  8184 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:03.355118  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.358413  8211 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:03.370124  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:03.365154  8362 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:03.379689  8214 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:03.289724 12411 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.334996 12292 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:03.360412 12425 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:03.296980 12219 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.355656 12142 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:03.397883  8104 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.372s	user 0.010s	sys 0.074s
I20260709 13:03:03.401829  8212 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:03:03.402241  8212 pending_rounds.cc:85] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 9
I20260709 13:03:03.402449  8212 pending_rounds.cc:107] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:03:03.402678  8212 raft_consensus.cc:2889] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:03.402956  8212 pending_rounds.cc:107] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:03:03.403158  8212 raft_consensus.cc:2889] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:03.406881 12396 consensus_meta.cc:287] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.777s	user 0.006s	sys 0.006s
I20260709 13:03:03.387399 12242 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.392341 12357 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.360142 12401 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:03.376202 11999 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.392102 12425 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:03.450933 12411 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.451361 12425 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.452472 12425 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.448523  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:03.454293 12421 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:03:03.442924 12357 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.449555 12397 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.447703 12428 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.452392 12411 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:03.452746 12290 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.459618 12142 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:03.460897 11999 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:03.486230 12137 consensus_meta.cc:287] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.005s
I20260709 13:03:03.457021 12434 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:03.506714 12422 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:03:03.506997 12435 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.485599 12430 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:03.566172  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 203591us
I20260709 13:03:03.522058 11925 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:03.568177  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.487537 12397 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:03:03.393833 12292 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:03.558524 12336 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.568205  8183 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:03.558049 12435 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:03.522903 12219 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.559387 12430 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:03.530931 12411 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.599995  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.610471  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.493680 12428 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.569582 12311 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:03.623172  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.627591  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.600518 12435 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.630369  8890 raft_consensus.cc:1240] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:03.631597  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:03.607075 12434 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:03.654657  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.654958  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:03.655190  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.655678  8898 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 12: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:03.655859  8896 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:03.654711  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:03.641649  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 298781us
I20260709 13:03:03.658658  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:03.659523  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.660223  8897 raft_consensus.cc:2410] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:03:03.660135  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:03.661345  8889 raft_consensus.cc:2376] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9. Re-sending same reply.
I20260709 13:03:03.664160  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.664760  8894 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:03.601316 12336 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.675155  8212 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:03.677179  8287 raft_consensus.cc:1240] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:03.660323 12423 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:03.661432 12424 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:03.685712  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.682322  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:03.686581  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:03.688928  8217 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
W20260709 13:03:03.681941  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 408840us
I20260709 13:03:03.668644 12245 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:03.694336  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:03.684113 12342 consensus_meta.cc:287] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.005s
I20260709 13:03:03.699690  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:03.664364 12412 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:03.668807 12427 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:03.713339  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.712827  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:03.711944  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 439789us
I20260709 13:03:03.719349  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.719264  8258 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:03.693653 12424 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:03.695529 12401 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:03.697737 12415 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.738451  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.698935 12357 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:03.738452  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.742676  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:03.743229  8360 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.743788  8358 raft_consensus.cc:1240] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:03.690182 12228 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:03.739300  8894 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
W20260709 13:03:03.746243  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 67438.2us
I20260709 13:03:03.747045  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.749516  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:03.689788 12443 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:03:03.705364 12439 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:03:03.739388 12431 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:03:03.754302  8211 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:03:03.759996  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 101435us
I20260709 13:03:03.760025  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:03.761590  8362 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:03.761721  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.732055 12429 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.754833  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.749264  8889 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:03.744498 12437 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:03.756315  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:03.704726 11925 consensus_queue.cc:1059] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:03:03.764606  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.764962  8890 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.765391  8284 raft_consensus.cc:2368] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:03:03.765462  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.705123 12219 consensus_queue.cc:1059] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:03:03.762063  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.669080 12430 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.746793 12311 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.759138 12428 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:03.763559  8892 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:03:03.702374 12342 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.743911 12321 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:03.766810  8287 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:03.754016 12289 raft_consensus.cc:3055] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:03.775950  8863 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:03.791671  8863 leader_election.cc:400] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:03:03.792174  8863 leader_election.cc:403] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:03.773144 12245 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:03.764609 12437 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:03.770292 12357 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:03.770134 12311 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.769824 12231 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.766526 12434 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:03.784111 12289 raft_consensus.cc:740] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:03:03.784476 12290 consensus_queue.cc:1175] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4a50f39e2d8e4886a79849938f2272a6" responder_term: 9 status { last_received { term: 7 index: 7 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:03:03.800779  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 48494.4us
W20260709 13:03:03.784768 12426 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:03:03.802023  8183 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:03.782162 12428 consensus_queue.cc:1059] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:03:03.806160 12458 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:03:03.798295 12292 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:03.796388 12430 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.807307 12461 raft_consensus.cc:3055] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:03.808313 12440 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.803973 12321 consensus_queue.cc:1059] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:03:03.809134  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.809624 12228 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:03.812088 12357 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:03.800367 12411 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.798493 12448 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.804818 12311 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.813211 12231 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:03.798584 11925 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:03.821821 12342 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:03.823354  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:03.823964 12107 consensus_meta.cc:287] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.000s
I20260709 13:03:03.824301 12424 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.824843 12427 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.772163 12429 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.837051 12154 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:03.838775 12336 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:03.845996  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.802630 12437 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.881810 12435 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:03.891335 12289 consensus_queue.cc:260] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.897464 12427 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.901981 12427 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.902459 12435 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.901449 12154 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.903357 12289 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.784312  8104 maintenance_manager.cc:643] P 49ab8a0cd4ae4427b46500594085b384: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.466s	user 0.199s	sys 0.130s Metrics: {"bytes_written":29963,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":120637,"dirs.run_cpu_time_us":640,"dirs.run_wall_time_us":115927,"drs_written":1,"lbm_read_time_us":401,"lbm_reads_lt_1ms":4,"lbm_write_time_us":114562,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":306684,"threads_started":2,"update_count":21,"wal-append.queue_time_us":335047}
I20260709 13:03:03.857090  8360 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:03.873368  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:03.877092  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 75160.2us
I20260709 13:03:03.853171  8890 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:03.878141  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:03.882458  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2444) took 1060 ms. Trace:
W20260709 13:03:03.871269  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 121887us
I20260709 13:03:03.883771  8896 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:03.907546  8257 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:03.885397  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.878790 12462 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:03.886734  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.889524  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.914847  8894 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:03.910663 12126 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.877576 12461 raft_consensus.cc:740] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:03.881462 12440 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.879787 12428 raft_consensus.cc:3055] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:03.894014 12434 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.894850 12423 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:03.899595  8293 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
W20260709 13:03:03.852983  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.929642  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:03.930672  8290 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.901413 12464 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:03.910182  8864 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.908766  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:03.910758  8257 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:03.908146  8216 rpcz_store.cc:276] 0709 13:03:02.822457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.822698 (+   241us) service_pool.cc:224] Handling call
0709 13:03:02.830041 (+  7343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.949151 (+119110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.882202 (+933051us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b54003796d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:03.882387 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174991232}
I20260709 13:03:03.932555  8286 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:03.932722  8183 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:03.933272  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:03.933543  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:03:03.885926  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 227405us
I20260709 13:03:03.912545  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.890004  8284 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.914258 12435 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:03:03.915786  8898 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:03.901298 12231 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.923532  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.924269  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:03.928324 12428 raft_consensus.cc:740] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:03.938385  8287 raft_consensus.cc:2410] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:03:03.914500 12462 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:03.910730 12412 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.897311 12219 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:03.930928  8893 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:03.896572 12107 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.934322  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.915759 12452 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:03.979270  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.978763  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 68710.4us
I20260709 13:03:03.942353  8290 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:03.939958  8292 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:03.979177  8291 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:03.915512 12441 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:03.925623  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:03.981485  8285 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:03:03.953438  8184 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:03.914549 12336 consensus_queue.cc:1059] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:03:03.982932  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:03.985622  8894 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:03.962713  8332 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:03.988142  8893 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:03:03.988502  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:03:03.987267  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 76601.4us
I20260709 13:03:03.937536 12440 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:03.995061  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:03.900044 12357 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.939218 12428 consensus_queue.cc:260] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:03.998189 12162 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:03.982803 12412 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.000062 12439 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.987607  8105 maintenance_manager.cc:419] P 49ab8a0cd4ae4427b46500594085b384: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11029 bytes on disk
I20260709 13:03:03.951972 12458 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:03.949393 12228 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:04.012992  8284 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:03.991328 11925 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.952908 12435 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:03.934638 12234 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:03.985038 12245 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.934900 12423 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:04.133064  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 179767us
W20260709 13:03:04.155947  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 160462us
I20260709 13:03:03.951807 12292 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:03.983518 12452 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.982410 12342 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.159600  8289 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:04.000882  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:04.098905  8894 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:03:04.062252  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.985109 12179 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.989363 12320 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:03.997258  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:03.988287 12443 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.177s
I20260709 13:03:03.990551 12154 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:04.140100 12449 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.383s	user 0.001s	sys 0.004s
I20260709 13:03:03.955340 12462 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:04.169395  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:04.001392 12414 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:03.952732 12126 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:04.183317  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.434214  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.134120 12460 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:04.436851  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.162802 12440 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:04.163282 12458 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.163516 12228 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.775575  8286 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:03:03.989454 12457 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.456s
I20260709 13:03:03.985134 12321 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.183s
W20260709 13:03:04.475328  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 480494us
I20260709 13:03:04.171273 11999 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.284353 11925 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.477857  8104 maintenance_manager.cc:643] P 49ab8a0cd4ae4427b46500594085b384: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.309s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":253785,"lbm_reads_gt_100_ms":1,"lbm_reads_lt_1ms":3}
I20260709 13:03:04.162665 12439 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:04.499787 12468 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.512s	user 0.001s	sys 0.000s
I20260709 13:03:04.458127 12245 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:04.436638 12234 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.437870 12311 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:04.521412 12430 consensus_meta.cc:287] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.001s
W20260709 13:03:04.524258 12427 consensus_meta.cc:287] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.000s
I20260709 13:03:04.524955 12107 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:04.534852 12437 consensus_meta.cc:287] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.000s
W20260709 13:03:04.547065 12289 consensus_meta.cc:287] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
W20260709 13:03:04.569201 12219 consensus_meta.cc:287] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.004s
I20260709 13:03:03.982972 12448 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.178s
I20260709 13:03:03.936347 12464 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.763741 12473 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:03:04.714244 12465 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.757516 12480 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:04.719866 12034 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.720745 12467 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.719031 12452 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.729348 12179 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:04.760504 12320 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:04.784493  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:04.736346 12342 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.778378 12228 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:04.775071 12458 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:04.790974  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:04.773057 12414 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:04.804651 12245 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:04.772396 12460 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:04.899850  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.900045  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:04.901168  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:04.891362 12443 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:04.901775 12439 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:04.902833 12289 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.785319 11999 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.798645 12427 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.903584 12311 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:04.814508 12107 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.990491  8359 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:04.906836  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:04.894431 12219 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8.
I20260709 13:03:04.911142 11925 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:04.915489 12234 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:04.916508 12462 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.792272 12435 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:04.917168 12415 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.919204 12423 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:04.992373 12460 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:04.713192  8184 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:03:05.112707  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 399766us
I20260709 13:03:05.113601  8184 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:04.987622 12485 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:04.953521  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 800) took 1505 ms. Trace:
I20260709 13:03:04.954252  8897 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:04.955782 12179 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:04.964195  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 967267us
I20260709 13:03:04.989120  8360 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 7.
W20260709 13:03:04.988741  8864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.936031 12470 log.cc:927] Time spent T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.257s	user 0.002s	sys 0.008s
I20260709 13:03:04.924783 12483 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:04.816304 12437 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.145255  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.118757 12381 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:05.134334 12457 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:04.921259 12472 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:04.934048  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1943) took 2019 ms. Trace:
I20260709 13:03:04.997840 11999 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.120750  8364 rpcz_store.cc:276] 0709 13:03:03.448472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.456120 (+  7648us) service_pool.cc:224] Handling call
0709 13:03:03.456446 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.456797 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.456824 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.457275 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.672834 (+215559us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:03.672878 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.672952 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.000143 (+327191us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:03:04.935046 (+934903us) raft_consensus.cc:1685] finished
0709 13:03:04.935066 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.953446 (+ 18380us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":678,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":8265856,"thread_start_us":213787,"threads_started":1,"wal-append.queue_time_us":262555}
I20260709 13:03:04.990968 12289 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.954018 12034 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.114638 12194 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:05.140242  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.140996 12234 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:05.141424  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:05.217414  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 76096.5us
I20260709 13:03:04.992996 12443 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:04.953544 12320 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.949707 12465 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.146814  8258 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:03:05.223997  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 77271us
I20260709 13:03:05.147799 12010 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:04.935240 12473 consensus_queue.cc:1243] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:05.123083 12479 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:05.155995  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.155596  8361 rpcz_store.cc:276] 0709 13:03:02.914466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.914638 (+   172us) service_pool.cc:224] Handling call
0709 13:03:02.914994 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.997169 (+ 82175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.933806 (+1936637us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54001f7054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:04.933987 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183596800}
I20260709 13:03:05.157080 12485 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:05.135715 12440 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:05.139568 12430 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:05.138788 12480 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.158975  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.159591  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:04.988617 12467 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.000790 12439 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.139514 12448 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:05.214324  8863 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:05.115290 12415 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:04.999773 12107 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.249898  8863 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:05.147974 12475 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.232209  8898 raft_consensus.cc:2393] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:05.237080  8284 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:05.242527  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 993) took 1509 ms. Trace:
I20260709 13:03:05.213732 11999 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.237383  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.288719  8895 rpcz_store.cc:276] 0709 13:03:03.733050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.733217 (+   167us) service_pool.cc:224] Handling call
0709 13:03:03.746477 (+ 13260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.897848 (+151371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.897882 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.915054 (+ 17172us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.097193 (+182139us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:04.097231 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.097307 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.242288 (+1144981us) raft_consensus.cc:1685] finished
0709 13:03:05.242312 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.242471 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19275,"raft.queue_time_us":43556,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3674,"thread_start_us":313383,"threads_started":2,"wal-append.queue_time_us":250844}
I20260709 13:03:05.228561 12320 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:05.230139 12434 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.231251 12479 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.231681 12484 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:05.242268 12321 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.237715 12488 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.150622 12414 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.160497 12381 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.161000 12435 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:05.328531  8331 connection.cc:256] RPC call timeout handler was delayed by -1.0086282990000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 13:03:05.328944 12491 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.329195 12245 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:05.150408 12483 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:05.323277 12476 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:03:05.331575  8361 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:03:05.323069 12486 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:05.319527 12218 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:05.239291 12010 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.233830 12234 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.324954  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:05.321302  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 94410.3us
I20260709 13:03:05.292150 12487 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:05.345860  8361 pending_rounds.cc:85] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 6
I20260709 13:03:05.348945  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:05.349715  8259 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:05.215145 12472 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.360469  8366 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:05.348313  8257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.016s	sys 0.041s
W20260709 13:03:05.366019  8257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.016s	sys 0.042s
W20260709 13:03:05.352038  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.005s	sys 0.050s
I20260709 13:03:05.329777 12245 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.307701 12484 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.249346 12430 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.307955 12479 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.355126  8284 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 7.
I20260709 13:03:05.359404  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.360252  8361 pending_rounds.cc:107] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:03:05.330605 12489 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:05.307246 12494 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.348152  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.412338  8895 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:05.291862 12439 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.291657 12448 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.354092 12493 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:05.369045  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.369184  8331 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:03:05.348204 12424 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.010s	sys 0.021s
I20260709 13:03:05.379294 12490 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:05.392745  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:05.406035 12427 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.377345  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.280001 12480 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.299252 11999 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.401737  8362 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:05.417438 12498 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.401703  8361 raft_consensus.cc:2889] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:05.332056 12492 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:05.450727 12424 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.010s	sys 0.022s
W20260709 13:03:05.406426  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 45479.7us
I20260709 13:03:05.365278 12010 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.411314  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.359019 12218 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.375445 12357 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:05.499503 12357 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.500336 12483 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.500800 12511 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:05.308549 12434 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.501381 12511 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.401548 12457 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:05.297259 12475 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.505354 12475 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.327212 12488 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.507030 12430 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.507377 12488 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.327005 12321 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.505290 12511 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.509347 12321 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.370982 12477 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:05.421320  8896 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:05.509958 12477 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:05.422062  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:05.422761  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:05.366856  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.005s	sys 0.050s
I20260709 13:03:05.510406 12477 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:05.510777 12467 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.425899 12412 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:05.426613 12482 log.cc:927] Time spent T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:03:05.434103 12472 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.434428  8864 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:05.511512  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.435431 12245 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.423177  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60538 (request call id 2527) took 1499 ms. Trace:
I20260709 13:03:05.512812  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:05.513417 12415 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.514237  8897 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:05.515631 12439 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.359710  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.446594  8358 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:05.516732  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.517304  8358 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:05.375662  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.518905  8284 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:05.331185 12466 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:05.503773  8214 raft_consensus.cc:2410] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:05.519419 12466 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.403368 12484 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.462939  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:05.520231  8895 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.520679  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:05.466642 12490 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.519781 12466 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:05.522909 12490 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.523345 12498 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.524340  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:05.525066  8360 raft_consensus.cc:2393] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:05.371026 12311 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:03:05.242744 12485 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.473317  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:05.525866  8361 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:05.436717 12462 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.463848  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.526237 12465 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.436859 12423 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.526029 12311 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:05.527025 12423 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:05.527174 12311 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:05.527513 12423 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:05.477442  8366 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:03:05.528352 12423 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.528820  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:05.529484  8366 raft_consensus.cc:2393] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:05.419901 12443 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.530519 12311 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.530889 12443 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:05.531777 12485 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.360067 12487 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.446337 12464 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.532476 12487 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.534166 11999 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.534657 11999 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:05.486225 12289 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.457341 12154 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:03:05.487766 12448 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.437147 12494 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.379418 12440 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.489318 12179 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.587216  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.496264 12218 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.496842 12429 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.497864 12161 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.486404  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.515229 12457 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.520777 12427 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:05.521152  8285 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:05.517479 12107 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.512583  8292 rpcz_store.cc:276] 0709 13:03:03.923924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.924037 (+   113us) service_pool.cc:224] Handling call
0709 13:03:05.422974 (+1498937us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5400087fd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:05.423113 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3455744}
I20260709 13:03:05.611616  8210 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:03:05.612048  8210 pending_rounds.cc:85] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 8
I20260709 13:03:05.612254  8210 pending_rounds.cc:107] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:03:05.612473  8210 raft_consensus.cc:2889] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:05.478853  8332 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:05.531316  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:05.346423 12491 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.486578 12492 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:05.538151  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.511966  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 77658us
I20260709 13:03:05.578860  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.630061  8896 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:05.631131  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.573947  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.575356  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.573953  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.577540  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.512157  8213 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:05.560791  8361 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:05.490516  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:05.589349  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.526502 12462 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.538653  8895 raft_consensus.cc:2410] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:03:05.600880 12472 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.531702 12311 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:05.518826 12381 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.603327  8362 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:05.519675 12437 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.535774  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2531) took 1609 ms. Trace:
I20260709 13:03:05.535106 11999 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.643141  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:05.643205  8863 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.2:39859 timed out after 1.696s (SENT) [suppressed 5 similar messages]
I20260709 13:03:05.503211 12434 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.611025  8894 raft_consensus.cc:1240] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:05.625624  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 256604us
I20260709 13:03:05.631529  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:05.553005 12228 consensus_meta.cc:287] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.000s
I20260709 13:03:05.636019  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:05.647092  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.643277  8293 rpcz_store.cc:276] 0709 13:03:03.925931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.940329 (+ 14398us) service_pool.cc:224] Handling call
0709 13:03:03.940705 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:03.979535 (+ 38830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.979564 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:03.995833 (+ 16269us) log.cc:844] Serialized 52 byte log entry
0709 13:03:04.485386 (+489553us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:04.485431 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.485507 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.535555 (+1050048us) raft_consensus.cc:1685] finished
0709 13:03:05.535575 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.535719 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10093,"raft.queue_time_us":43201,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10498,"thread_start_us":320657,"threads_started":1,"wal-append.queue_time_us":817146}
I20260709 13:03:05.602497 12289 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.632587  8291 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:05.611344 12142 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.602680 12010 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.638963  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.647701  8285 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:05.525520 12498 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.582767  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:05.500864 12483 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:05.531826 12443 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:05.645776  8331 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:05.607407 12427 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.644920  8284 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:03:05.648169  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.670346  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.637274  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.670965  8363 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:05.672122  8896 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:05.501648 12357 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.418697 12489 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.610545 12435 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:05.670961  8213 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:05.623232 12448 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:03:05.656915  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.610543 12161 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.683602  8895 raft_consensus.cc:1240] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:05.647429 12464 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.688108 12464 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.668342 12289 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.692504 12500 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.673732 12427 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.693133 12500 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.687512  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.696364  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.700438 12034 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.685106  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.702366  8257 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:05.685832  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.702551  8293 raft_consensus.cc:2393] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:05.691090 12464 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:05.705063  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 59383.8us
W20260709 13:03:05.705242  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 226525us
I20260709 13:03:05.705796  8331 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:05.706790 12038 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.707316 12038 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.708101 12485 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:05.708496 12485 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.709853  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:05.710198  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:05.704208  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.705091  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.710748  8210 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:05.712980  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.712045  8359 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:03:05.579411 12461 consensus_queue.cc:260] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.713553  8363 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:05.667708 12443 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:05.643993 12462 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.708884 12485 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:05.707228 12439 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:05.706933 12510 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:05.717245  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:05.735267  8332 leader_election.cc:336] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929): Timed out: RequestConsensusVote RPC to 127.6.236.4:42929 timed out after 1.808s (SENT)
I20260709 13:03:05.704207 12034 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.708613 12491 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.737879  8332 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:05.740439  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:05.717643 12493 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:05.651535 12228 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.665777 12010 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.705803 12500 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.730677 12107 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:05.732061 12289 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.744642  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.766036  8363 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:05.747254 12489 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.736752  8898 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:05.750380  8213 raft_consensus.cc:2410] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:05.673216 12142 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.754380 12512 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:05.732234 12381 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:05.651033 12472 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.702057 12427 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.719512 12492 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.731307 12038 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.742987  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.790781  8293 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
W20260709 13:03:05.765215  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 55100.4us
I20260709 13:03:05.739710 12483 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:05.773051  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.773052  8896 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:03:05.772246 12292 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:05.756575 12461 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:05.792357  8896 pending_rounds.cc:85] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 8
I20260709 13:03:05.795217  8896 pending_rounds.cc:107] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:03:05.795485  8896 raft_consensus.cc:2889] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:05.749495 12034 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.791715  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.792398  8898 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:05.792483  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.796728  8293 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:05.797878  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:05.796110  8331 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:05.800557  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 157271us
I20260709 13:03:05.735886 12516 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:03:05.777195 12381 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.801889 12493 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.802786  8209 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:05.803867  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.777132 12107 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:03:05.811352 12454 log.cc:927] Time spent T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 2.048s	user 0.012s	sys 0.002s
W20260709 13:03:05.813686  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.815363  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.813697  8331 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:05.820264  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.822460  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.823045  8898 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:05.823859  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.824919  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:05.825394  8898 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.840272 12485 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:05.843710  8898 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:05.844779  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:05.850529  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.793916 12483 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.850831  8331 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:05.793388 12179 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.816330  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:05.853679  8331 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:05.865034 12107 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.776515 12474 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:03:05.872370  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.872985  8210 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:05.875576  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:05.815518 12381 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.874917  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.850358 12486 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:05.881245  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.774840 12443 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.882606  8367 raft_consensus.cc:2393] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:05.852787 12483 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:05.883378  8210 raft_consensus.cc:2393] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:05.799759 12292 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.874800 12491 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:05.868161 12512 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:05.884424 12517 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:05.874389 12439 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:05.889384  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:05.881011 12038 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:03:05.894932 12010 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:05.896687  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:05.804205 12466 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:05.897359  8210 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:05.882503 11999 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.872255 12218 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:03:05.887913 12458 consensus_meta.cc:287] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.895s	user 0.004s	sys 0.006s
I20260709 13:03:05.885437 12494 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.892273 12473 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:05.918315  8210 raft_consensus.cc:2468] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:05.890903 12439 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.930398  8895 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:05.902808 12228 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:05.980497  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:05.964872  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:06.047086  8358 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:06.047231  8210 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:05.890563 12529 consensus_queue.cc:1059] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:03:05.964663  8331 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:05.978907  8898 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:05.985460  8184 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:06.046443  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 170990us
I20260709 13:03:05.913851 11999 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.985911  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.048688  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.049791  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:05.959683 12452 consensus_meta.cc:287] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.964s	user 0.009s	sys 0.001s
W20260709 13:03:05.959990 12479 consensus_meta.cc:287] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.000s
W20260709 13:03:05.957003 12520 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:03:06.052050  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:05.995798 12234 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:05.998559 12496 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:03:06.053884  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 68327us
W20260709 13:03:06.054644  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 90122us
W20260709 13:03:06.047319 12477 consensus_meta.cc:287] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.536s	user 0.003s	sys 0.007s
I20260709 13:03:05.964677 12473 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.958670 12034 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:05.919937 12462 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:05.993074 12481 log.cc:927] Time spent T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.832s	user 0.001s	sys 0.009s
I20260709 13:03:05.960974 12439 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.960212 12494 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:03:05.966857 12454 log.cc:927] Time spent T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:05.917928 12458 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:06.050818 12194 consensus_meta.cc:287] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.001s
I20260709 13:03:06.046492 12427 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:06.047716 12154 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.062697  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.064136  8184 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.057085 12438 raft_consensus.cc:2804] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:06.065006  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.055368 12457 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.067380  8259 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:06.200163  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.056068 12472 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.067939 12473 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.046728 12487 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.057991 12452 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.209277  8891 raft_consensus.cc:2410] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:03:06.211511  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 147514us
I20260709 13:03:06.055068 11999 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.057371 12479 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:06.206116  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 141308us
I20260709 13:03:06.219946  8215 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:06.204716 12428 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:06.224062  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53342 (request call id 951) took 2989 ms. Trace:
I20260709 13:03:06.199877 12218 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:06.216008  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 148765us
I20260709 13:03:06.225878  8214 pending_rounds.cc:85] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 5
I20260709 13:03:06.219189 12512 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:06.226956  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.067659 12477 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.203394 12516 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:06.218757 12290 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:06.229395 12460 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.234385  8290 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 14: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:06.220728 12535 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:06.230139  8288 rpcz_store.cc:276] 0709 13:03:03.234821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.234974 (+   153us) service_pool.cc:224] Handling call
0709 13:03:03.235337 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:03.475496 (+240159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.475529 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:03.476113 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:03:03.691297 (+215184us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:03.716454 (+ 25157us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.716705 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.716781 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.818424 (+101643us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b18003759a0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9160522 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:03:05.793636 (+1975212us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:03:06.223841 (+430205us) raft_consensus.cc:1685] finished
0709 13:03:06.223862 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.224002 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535,"prepare.queue_time_us":13673,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":1338,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":13725,"spinlock_wait_cycles":34411648,"thread_start_us":408146,"threads_started":2,"wal-append.queue_time_us":269638}
I20260709 13:03:06.237746  8184 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.232695  8214 pending_rounds.cc:107] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 9.6
W20260709 13:03:06.232612 12528 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:03:06.239351  8218 raft_consensus.cc:1240] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:03:06.221093 12438 raft_consensus.cc:697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:06.202031 12494 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:06.231779 12531 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:03:06.238854  8292 raft_consensus.cc:2393] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 12: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:03:06.241655 12484 consensus_meta.cc:287] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.002s
I20260709 13:03:06.243589  8184 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.245558 12535 raft_consensus.cc:697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:06.254303  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.237264 12512 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:06.259366 12457 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:06.290097 12457 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:06.290475  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.291811  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.292881  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:06.292951 12494 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:06.294160  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1083) took 2311 ms. Trace:
I20260709 13:03:06.294262 12512 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.294894 12535 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.293931  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.299342  8288 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:06.300242  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.301307  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.235630 12466 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:06.258337  8286 raft_consensus.cc:2410] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:06.243636 12184 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:06.302310  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.215981 12154 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:06.303946  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 60440.5us
I20260709 13:03:06.242837  8214 raft_consensus.cc:2889] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.279428  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:06.308391 12477 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:06.310319  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 221629us
I20260709 13:03:06.236815 12218 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.294543  8893 rpcz_store.cc:276] 0709 13:03:03.945857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.994431 (+ 48574us) service_pool.cc:224] Handling call
0709 13:03:03.998033 (+  3602us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:04.097430 (+ 99397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.097462 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:04.158175 (+ 60713us) log.cc:844] Serialized 52 byte log entry
0709 13:03:04.792473 (+634298us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:04.792513 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.792574 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.814115 (+1021541us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:03:06.257003 (+442888us) raft_consensus.cc:1685] finished
0709 13:03:06.257029 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.257255 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104039,"raft.queue_time_us":99625,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":61258,"spinlock_wait_cycles":138885888,"thread_start_us":334694,"threads_started":1,"wal-append.queue_time_us":833652}
I20260709 13:03:06.312917  8184 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:06.287287 12438 consensus_queue.cc:237] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.314106  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:06.314965 12311 consensus_meta.cc:287] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.000s
W20260709 13:03:06.315972 12320 consensus_meta.cc:287] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 1.006s	user 0.008s	sys 0.001s
I20260709 13:03:06.290531 12457 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.253221 12460 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:06.254554 12525 log.cc:927] Time spent T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:03:06.328913  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.329409  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.340817  8287 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:06.332402 12473 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.343354  8358 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:06.333278  8890 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:06.242357 12516 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.345963  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:06.346692  8893 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:06.318943 12474 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:06.254917 12290 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:06.327476 12483 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.311954 12472 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:06.342021  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:06.341722  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.354574  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.355728  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.356266  8287 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:06.357060  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.341694  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.359839  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.312170 12184 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.334980  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:06.339038 12528 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:06.322695 12505 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.360404  8361 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:06.363173  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:06.370401  8893 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 7.
I20260709 13:03:06.367512  8288 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:03:06.312075 12484 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.352309 12474 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:06.373778  8288 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:06.374981  8363 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:06.342303 12320 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.379964  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:06.362000 12494 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:06.380558  8893 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.360003 12472 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:06.369102 12184 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.383061  8366 raft_consensus.cc:2368] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:06.352582 12381 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.384799  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.378762 12474 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.387657  8217 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:06.394490 12381 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.383104 12494 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:06.401557 12539 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:03:06.383507 12458 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.383898 12472 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.407855  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.406045 12494 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.416043 12483 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:06.385661 12423 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:03:06.407843 12452 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.408625 12107 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:06.414470 12479 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.414387 12487 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.441308  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.442644 12307 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:06.439968 12107 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.444233 12307 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.444633 12307 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.445829 12107 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.446439 12473 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:06.446782 12546 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:06.447190 12546 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:06.447629  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:06.442957 12425 raft_consensus.cc:3055] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:06.443325 12484 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:06.450608 12450 log.cc:927] Time spent T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 2.692s	user 0.009s	sys 0.009s
I20260709 13:03:06.452090  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:06.456804  8895 raft_consensus.cc:2410] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:06.406637 12290 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.452699 12154 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.444026  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 1003) took 1300 ms. Trace:
I20260709 13:03:06.459107  8897 rpcz_store.cc:276] 0709 13:03:05.144023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.377076 (+233053us) service_pool.cc:224] Handling call
0709 13:03:06.443851 (+1066775us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b5400229f54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.443954 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129021312}
I20260709 13:03:06.447947 12546 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.455284  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.411775 12505 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:03:06.462203  8897 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:06.460422  8359 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:06.454768 12320 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:06.464203  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:06.464821  8895 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:06.450520 12516 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.411166 12512 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.469990  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:06.449746 12425 raft_consensus.cc:740] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:03:06.478464 12536 log.cc:927] Time spent T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.257s	user 0.000s	sys 0.002s
I20260709 13:03:06.480562  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2463) took 1087 ms. Trace:
I20260709 13:03:06.480937  8217 rpcz_store.cc:276] 0709 13:03:05.393105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.463634 (+ 70529us) service_pool.cc:224] Handling call
0709 13:03:06.480379 (+1016745us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400401d54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.480506 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976452992}
W20260709 13:03:06.483071 12543 log.cc:927] Time spent T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:06.489028  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.482455  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.468269 12472 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.491523  8361 raft_consensus.cc:2393] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 13: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:06.494064  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.494680  8361 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:06.495460  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.495970  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.495957  8361 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.475370 12546 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:06.501158 12541 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:03:06.503990  8183 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.517519 12290 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:06.502272 12320 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:03:06.496855 12425 consensus_queue.cc:260] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.523963 12425 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.506659 12479 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:06.530933 12479 raft_consensus.cc:3055] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:06.500197 12505 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.525997  8893 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:06.500216 12154 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:06.539680 12439 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.543265 12512 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:06.549829  8288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:45764
I20260709 13:03:06.550455  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 939) took 1406 ms. Trace:
I20260709 13:03:06.549850 12161 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.554708  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1954) took 1222 ms. Trace:
I20260709 13:03:06.555233  8361 raft_consensus.cc:2410] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:03:06.556124  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.559733 12184 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.542105 12154 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.562525 12154 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.553886  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 998) took 1767 ms. Trace:
I20260709 13:03:06.557183  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.555092  8364 rpcz_store.cc:276] 0709 13:03:05.331875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.332011 (+   136us) service_pool.cc:224] Handling call
0709 13:03:05.332284 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.666284 (+334000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.666317 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.672971 (+  6654us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.754764 (+ 81793us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:05.754798 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.554382 (+799584us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54004619d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:06.554426 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.554471 (+    45us) raft_consensus.cc:1685] finished
0709 13:03:06.554484 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.554654 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54237,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":278542080,"thread_start_us":213237,"threads_started":2,"wal-append.queue_time_us":165047}
I20260709 13:03:06.569684  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.570291  8364 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.572713  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.573297  8367 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:06.566941  8894 rpcz_store.cc:276] 0709 13:03:04.786827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.987628 (+200801us) service_pool.cc:224] Handling call
0709 13:03:05.000841 (+ 13213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.644285 (+643444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.553653 (+909368us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54005fee54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:06.553824 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403302144}
I20260709 13:03:06.567173  8218 rpcz_store.cc:276] 0709 13:03:05.144275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.144394 (+   119us) service_pool.cc:224] Handling call
0709 13:03:05.144706 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.254541 (+1109835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.550229 (+295688us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400079254. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:06.550399 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2517822848}
I20260709 13:03:06.574146  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.574335  8259 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.561856 12184 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.567004  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2464) took 1173 ms. Trace:
I20260709 13:03:06.579133  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:06.579573  8215 rpcz_store.cc:276] 0709 13:03:05.393326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.518376 (+125050us) service_pool.cc:224] Handling call
0709 13:03:05.518627 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.229773 (+711146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.566752 (+336979us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b5400057dd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:06.566941 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613072128}
I20260709 13:03:06.532953 12479 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:06.531234 12474 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.580850  8365 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 13: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:06.581883  8364 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:06.567138  8361 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.583791  8367 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:06.584041  8259 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.578558 12161 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:06.586150  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1962) took 1217 ms. Trace:
I20260709 13:03:06.586995 12495 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:06.586580  8367 rpcz_store.cc:276] 0709 13:03:05.368874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.583366 (+1214492us) service_pool.cc:224] Handling call
0709 13:03:06.583628 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.585643 (+  2015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.586098 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.589998  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 811) took 1157 ms. Trace:
I20260709 13:03:06.590672  8367 rpcz_store.cc:276] 0709 13:03:05.432911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.588756 (+1155845us) service_pool.cc:224] Handling call
0709 13:03:06.589260 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.589427 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.589451 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.589738 (+   287us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:06.589782 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.589834 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.589934 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.585774 12161 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.588773 12495 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:06.577943 12457 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.622219  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 809) took 1189 ms. Trace:
I20260709 13:03:06.634217  8364 rpcz_store.cc:276] 0709 13:03:05.432402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.586639 (+1154237us) service_pool.cc:224] Handling call
0709 13:03:06.621584 (+ 34945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.621815 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.621841 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.621887 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:06.621926 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.621982 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.622147 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.637744  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2378) took 1197 ms. Trace:
I20260709 13:03:06.638243  8364 rpcz_store.cc:276] 0709 13:03:05.440240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.636870 (+1196630us) service_pool.cc:224] Handling call
0709 13:03:06.637212 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.637401 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.637429 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.637482 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:06.637515 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.637569 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.637685 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.639879  8364 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:03:06.595876 12479 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.641055  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2379) took 1200 ms. Trace:
W20260709 13:03:06.595957  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 92028.9us
I20260709 13:03:06.629146  8361 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
W20260709 13:03:06.642354  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 55713.6us
I20260709 13:03:06.643497  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.644619 12338 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:06.645097 12338 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:06.645916 12338 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.596069 12161 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.641458  8364 rpcz_store.cc:276] 0709 13:03:05.440482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.639254 (+1198772us) service_pool.cc:224] Handling call
0709 13:03:06.639622 (+   368us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:06.640770 (+  1148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.641003 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.590188 12473 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:03:06.650812  8183 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:06.649991  8332 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:06.636312 12472 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.651605  8364 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:03:06.654242 12517 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:06.655923 12517 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:06.657636  8332 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:06.658160 12484 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:06.659478  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.659610 12457 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.660660 12457 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:06.660851 12484 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:06.661806  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2380) took 1220 ms. Trace:
I20260709 13:03:06.641739 12479 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.661989  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.662499  8183 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:06.662192  8364 rpcz_store.cc:276] 0709 13:03:05.441043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.650966 (+1209923us) service_pool.cc:224] Handling call
0709 13:03:06.651346 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:06.653977 (+  2631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.661738 (+  7761us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:06.661172 12548 log.cc:927] Time spent T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:03:06.650305 12438 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:06.658414 12517 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.666257  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.653602 12516 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:06.674027  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.679311 12161 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.681401 12161 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.663236 12484 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.674376 12438 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.674850 12474 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:06.674060  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.685366  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:06.687057 12517 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:06.688746  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.689527 12516 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:06.689504 12142 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.692519 12438 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.692710 12292 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.661053 12495 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.662817 12307 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.694746  8288 raft_consensus.cc:606] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:06.695112  8288 raft_consensus.cc:614] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:06.695890 12307 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.696638 12320 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:06.697216 12320 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:06.697882  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:06.698419 12458 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:06.699287  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:06.699838  8288 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.700520  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 965) took 1126 ms. Trace:
I20260709 13:03:06.700618  8293 raft_consensus.cc:1240] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:06.700917  8292 rpcz_store.cc:276] 0709 13:03:05.574526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.631280 (+ 56754us) service_pool.cc:224] Handling call
0709 13:03:06.700345 (+1069065us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400401354. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.700472 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365530496}
I20260709 13:03:06.699182 12460 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:06.701987  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:06.699868  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 961) took 1165 ms. Trace:
I20260709 13:03:06.703488  8290 rpcz_store.cc:276] 0709 13:03:05.534928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.540348 (+  5420us) service_pool.cc:224] Handling call
0709 13:03:06.699694 (+1159346us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400400e54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.699813 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383876992}
I20260709 13:03:06.703789  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2374) took 1270 ms. Trace:
I20260709 13:03:06.703037  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2543) took 1115 ms. Trace:
I20260709 13:03:06.704519  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.705209  8292 raft_consensus.cc:3060] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.704523  8363 rpcz_store.cc:276] 0709 13:03:05.433618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.872105 (+438487us) service_pool.cc:224] Handling call
0709 13:03:06.703624 (+831519us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54000c6554. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.703739 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154670848}
I20260709 13:03:06.705988 12038 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:06.706403 12038 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:06.704860  8293 rpcz_store.cc:276] 0709 13:03:05.587809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.810297 (+222488us) service_pool.cc:224] Handling call
0709 13:03:06.700458 (+890161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.701009 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.702865 (+  1856us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400401350. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.702987 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047100672}
I20260709 13:03:06.692720  8361 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [8.10-10.11]
I20260709 13:03:06.706619  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.708036  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:06.708138  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2381) took 1266 ms. Trace:
I20260709 13:03:06.709748  8361 rpcz_store.cc:276] 0709 13:03:05.441421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.664133 (+1222712us) service_pool.cc:224] Handling call
0709 13:03:06.692487 (+ 28354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:06.707881 (+ 15394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.708087 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.710821  8332 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.712239  8332 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.665813 12483 raft_consensus.cc:2764] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:06.666491 12457 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:06.729290  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.682415 12484 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.726601 12401 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.707175 12038 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.732363 12292 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:06.734234 12537 log.cc:927] Time spent T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.505s	user 0.003s	sys 0.000s
I20260709 13:03:06.735117  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.752764  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.753320  8290 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:06.753713  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.726274 12397 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:03:06.685246 12430 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:06.734575 12458 consensus_queue.cc:1059] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:03:06.741590 11999 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:06.743476 12502 log.cc:927] Time spent T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.024s	user 0.005s	sys 0.001s
I20260709 13:03:06.744814 12154 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:06.698212 12462 consensus_queue.cc:1059] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:03:06.685462 12184 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:06.746832  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1908) took 1105 ms. Trace:
I20260709 13:03:06.747613  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60538 (request call id 2545) took 1146 ms. Trace:
I20260709 13:03:06.748399 12439 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:06.749390  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.748860 12554 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:03:06.762529  8286 rpcz_store.cc:276] 0709 13:03:05.601449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.675064 (+ 73615us) service_pool.cc:224] Handling call
0709 13:03:06.747453 (+1072389us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400044554. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.747565 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276604672}
I20260709 13:03:06.762369 12184 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:06.762415  8213 rpcz_store.cc:276] 0709 13:03:05.641489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.696089 (+ 54600us) service_pool.cc:224] Handling call
0709 13:03:06.746611 (+1050522us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b540007a654. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.746750 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122270080}
I20260709 13:03:06.764349 12184 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.737735  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.737682  8288 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:06.754529  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.755064  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2373) took 1321 ms. Trace:
I20260709 13:03:06.755803 12430 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:06.765808  8359 rpcz_store.cc:276] 0709 13:03:05.433380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.722836 (+289456us) service_pool.cc:224] Handling call
0709 13:03:06.754957 (+1032121us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54001801d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:06.755026 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375044864}
I20260709 13:03:06.686987 12494 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.768851  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:06.774602  8361 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:06.752395 12438 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:06.762522 12462 raft_consensus.cc:3055] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:06.779408 12462 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:06.787025 12462 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.788220 12462 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.788513 12485 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:06.790961  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1895) took 1415 ms. Trace:
I20260709 13:03:06.791518  8216 rpcz_store.cc:276] 0709 13:03:05.375850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.376009 (+   159us) service_pool.cc:224] Handling call
0709 13:03:05.376311 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.719525 (+343214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.719556 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.719598 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:05.719627 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.790636 (+1071009us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400194954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:06.790688 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.790874 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789140736}
I20260709 13:03:06.763687 12554 raft_consensus.cc:3055] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:06.773389 12430 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.767311 12439 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.714151 12320 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:06.797677  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.797369  8361 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:06.779624 12038 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.768265 12505 consensus_queue.cc:1059] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:06.808611  8292 raft_consensus.cc:2468] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:06.795336 12554 raft_consensus.cc:740] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:03:06.813460 12523 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.896s	user 0.003s	sys 0.001s
I20260709 13:03:06.827273  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.828116  8288 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 14: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:06.828613  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.828593  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:06.834331  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:06.835788  8332 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.763716 12457 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.842427  8292 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:06.844585  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:06.853016  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:06.852476  8286 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:06.853850  8290 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 8: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:06.854538  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:06.855899  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:06.864912 12559 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:03:06.865100 12401 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.851898 12423 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.879000  8288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:45764
W20260709 13:03:06.879475  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.837141 12290 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:06.849596 12292 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:06.900837 12342 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:06.859115 12107 raft_consensus.cc:2804] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:06.879750  8288 raft_consensus.cc:606] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:06.917956 12292 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.918519 12485 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:06.930409 12464 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:06.940210 12562 log.cc:927] Time spent T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:03:06.935433 12292 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.939630 12107 raft_consensus.cc:697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:06.987035  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:06.989593  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1965) took 1120 ms. Trace:
I20260709 13:03:06.946768 12480 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:06.987267  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 1.00172e+06us
I20260709 13:03:06.989996  8364 rpcz_store.cc:276] 0709 13:03:05.868984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.670875 (+801891us) service_pool.cc:224] Handling call
0709 13:03:06.671103 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.671284 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:06.862798 (+191514us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.987437 (+124639us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.989282 (+  1845us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.989331 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:06.989375 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.989435 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.989542 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1621,"prepare.queue_time_us":95675,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2457,"thread_start_us":258109,"threads_started":2}
I20260709 13:03:06.884552 12554 consensus_queue.cc:260] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.993806  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:06.946923 12485 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:06.991248 12486 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.002560  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2536) took 1485 ms. Trace:
I20260709 13:03:06.992735 12494 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:06.992331 12440 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:06.992667 12425 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:06.988759 12442 consensus_queue.cc:1059] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:03:06.994791 12154 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:07.003912 12564 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:03:07.002947  8289 rpcz_store.cc:276] 0709 13:03:05.517111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.538161 (+ 21050us) service_pool.cc:224] Handling call
0709 13:03:05.538513 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:05.588090 (+ 49577us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:05.637708 (+ 49618us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.767199 (+129491us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:06.325367 (+558168us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b2c00084bd8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efab46a11 00007f2efab56372 00007f2efc288a01 00007f2efc24d43a 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2
0709 13:03:06.325967 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 13:03:06.326137 (+   170us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:06.326336 (+   199us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.341076 (+ 14740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.341144 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.789620 (+448476us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:03:07.002357 (+212737us) raft_consensus.cc:1685] finished
0709 13:03:07.002377 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.002504 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64200,"prepare.queue_time_us":142865,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":2704,"raft.queue_time_us":65146,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":15686,"spinlock_wait_cycles":16890752,"thread_start_us":124356,"threads_started":2,"wal-append.queue_time_us":242714}
W20260709 13:03:07.005434 12563 log.cc:927] Time spent T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:03:07.009492  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2376) took 1575 ms. Trace:
I20260709 13:03:07.041185  8367 rpcz_store.cc:276] 0709 13:03:05.437150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.592679 (+1155529us) service_pool.cc:224] Handling call
0709 13:03:06.593006 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.593343 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.593371 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.635389 (+ 42018us) log.cc:844] Serialized 26 byte log entry
0709 13:03:06.860062 (+224673us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:06.860100 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.860161 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:07.009300 (+149139us) raft_consensus.cc:1685] finished
0709 13:03:07.009318 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.009437 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":39941,"spinlock_wait_cycles":2816,"thread_start_us":219615,"threads_started":1,"wal-append.queue_time_us":294482}
I20260709 13:03:07.042953  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:07.043557  8367 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.044581 12154 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.044379  8113 catalog_manager.cc:5697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 8, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 8 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.045042 12154 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:07.010092 12565 log.cc:927] Time spent T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:03:07.010865  8361 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:06.993920 12464 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.047912  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:07.048467  8361 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.048763 12464 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:07.010447 12107 consensus_queue.cc:237] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.015933  8362 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:07.018263  8890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43622 (request call id 1086) took 1443 ms (client timeout 1604 ms). Trace:
I20260709 13:03:07.018534  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42830 (request call id 2389) took 1438 ms. Trace:
I20260709 13:03:07.024773 12485 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.025493  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 997) took 2243 ms. Trace:
W20260709 13:03:07.048997  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.026115  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:07.051900  8365 rpcz_store.cc:276] 0709 13:03:05.580520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.199797 (+619277us) service_pool.cc:224] Handling call
0709 13:03:07.018351 (+818554us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400180954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:07.018478 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840153856}
I20260709 13:03:07.053031  8285 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.027463 12218 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.028797  8363 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:07.055732  8365 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:07.029842  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.033310  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:07.034335 12442 raft_consensus.cc:3055] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:07.036073  8291 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:07.036924 12423 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.038616 12184 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.013543 12440 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:07.039666 12425 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:07.065266  8361 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:07.068339  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.029207  8216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:03:07.069165  8216 raft_consensus.cc:606] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.069523  8216 raft_consensus.cc:614] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:07.051414  8890 rpcz_store.cc:269] 0709 13:03:05.575019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.577320 (+  2301us) service_pool.cc:224] Handling call
0709 13:03:07.018109 (+1440789us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54005d39d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:07.018209 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610784512}
W20260709 13:03:07.057462  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.071055  8361 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:07.060114  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:07.061354  8891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1341) took 3429 ms (client timeout 1808 ms). Trace:
I20260709 13:03:07.047200 12154 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.063297  8365 raft_consensus.cc:1240] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:03:07.072162  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:07.077044  8891 rpcz_store.cc:269] 0709 13:03:03.622580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.622904 (+   324us) service_pool.cc:224] Handling call
0709 13:03:07.051508 (+3428604us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b540075dd54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:07.051633 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5947418880}
I20260709 13:03:07.077967  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.078313  8209 raft_consensus.cc:2393] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:07.059957  8367 raft_consensus.cc:2468] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:07.064893  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.079334  8217 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:07.080317  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.075150  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.068048  8259 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:07.075629  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.075268  8218 raft_consensus.cc:1240] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:07.078500  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.084060  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.087953  8285 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:07.089404  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:07.052680  8892 rpcz_store.cc:276] 0709 13:03:04.782286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.895734 (+113448us) service_pool.cc:224] Handling call
0709 13:03:04.896038 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.986357 (+ 90319us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:05.352644 (+366287us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.637017 (+284373us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.904571 (+1267554us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18003e3500. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef90dac0a 00007f2f0281a219 00007f2ef9162a40 00007f2ef915d4e4 00007f2ef915d455 00007f2efc245060 00007f2efc257716 00007f2efc268287 00007f2efc268208
0709 13:03:06.909275 (+  4704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.909331 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:06.909385 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.025271 (+115886us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b54005b54d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:07.025320 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.025435 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29962,"prepare.queue_time_us":471965,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":5583,"raft.queue_time_us":1329778,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":118511,"spinlock_wait_cycles":210507392,"thread_start_us":634025,"threads_started":3,"wal-append.queue_time_us":252347,"wal-append.run_cpu_time_us":2789,"wal-append.run_wall_time_us":1201455}
I20260709 13:03:07.092924  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.093436  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.094585  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.093634  8217 raft_consensus.cc:2368] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10.
I20260709 13:03:07.099370  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.100462  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.101675  8217 raft_consensus.cc:2368] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12.
I20260709 13:03:07.103596  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.108198  8217 raft_consensus.cc:1240] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:07.122382  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.061393 12442 raft_consensus.cc:740] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:07.129235  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.075398 12440 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.125864  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.125994  8259 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:07.128198  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.028916 12484 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.135349  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.131934  8218 raft_consensus.cc:2410] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:07.140383  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.131718  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.134799  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1968) took 1265 ms. Trace:
I20260709 13:03:07.143491  8213 raft_consensus.cc:2410] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:07.143882  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.090912 12423 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.140255  8217 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:07.063805 12231 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:03:07.143116  8358 rpcz_store.cc:276] 0709 13:03:05.869668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.772770 (+903102us) service_pool.cc:224] Handling call
0709 13:03:06.773079 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.773270 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:06.796382 (+ 23112us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.133962 (+337580us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.134231 (+   269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.134480 (+   249us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:07.134553 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.134626 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.134745 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41588,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":7733,"raft.queue_time_us":196,"spinlock_wait_cycles":44937856,"thread_start_us":336942,"threads_started":1}
I20260709 13:03:07.160269  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.065912 12311 consensus_queue.cc:1059] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:03:07.092954 12154 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:07.164634  8217 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:07.165915  8214 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:07.170855  8257 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.090763 12480 consensus_queue.cc:1059] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:03:07.178329  8331 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:07.130261 12495 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:07.175410  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.175755  8362 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:07.176479  8360 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 15: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:07.181154  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.181954  8218 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:07.119666 12494 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:03:07.132285 12571 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:07.185252  8213 raft_consensus.cc:1240] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:07.160569 12156 raft_consensus.cc:2804] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:07.190843  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 101519us
I20260709 13:03:07.190856  8217 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:07.175282 12038 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.197173  8209 raft_consensus.cc:2393] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:07.181102 12438 raft_consensus.cc:3055] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:07.163936 12307 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:03:07.207998  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.192829 12462 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:07.190049 12437 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:07.196240 12570 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 13:03:07.193243 12218 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.214278  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.216495  8218 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 12: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:07.190451 12311 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:07.219669 12462 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:07.220747  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:07.221668  8213 raft_consensus.cc:2410] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:07.198972 12495 raft_consensus.cc:697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:07.223784 12495 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.195672 12038 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:03:07.226924  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 48712.9us
I20260709 13:03:07.177680 12154 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.197994 12430 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.196415 12425 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.200614 12156 raft_consensus.cc:697] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:07.230883 12311 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:07.231503 12156 consensus_queue.cc:237] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.232074 12292 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.233088 12038 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.207152 12438 raft_consensus.cc:740] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:07.234337 12038 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.231353 12311 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:07.235621 12311 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.236845 12311 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.237911 12154 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.239951 12438 consensus_queue.cc:260] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.241155 12438 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.220659 12462 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.246572 12484 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.250497 12292 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.251600 12440 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.252027 12484 raft_consensus.cc:493] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.252761 12430 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.253171  8215 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
W20260709 13:03:07.255775  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 85010.6us
I20260709 13:03:07.257457  8215 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:07.258724  8257 leader_election.cc:400] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10.
I20260709 13:03:07.259102  8257 leader_election.cc:403] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:03:07.260447  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:07.261044  8367 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:07.254276 12484 raft_consensus.cc:515] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.272203  8259 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:07.191394 12442 consensus_queue.cc:260] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.292774  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.293551 12437 consensus_queue.cc:1059] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:07.271512 12038 raft_consensus.cc:3060] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.262841 12292 consensus_queue.cc:1059] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:03:07.297358 12307 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:07.314442 12307 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:07.314910 12307 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.262713 12161 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:03:07.271329 12517 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:03:07.320598 12484 leader_election.cc:290] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.299963 12437 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.322615 12440 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:07.326361 12292 consensus_queue.cc:1243] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:07.327090 12292 raft_consensus.cc:3055] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:07.327461 12292 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:07.328351 12292 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.329586 12292 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:07.333937  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 275877us
I20260709 13:03:07.302255 12442 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.334895  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.339401 12184 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:07.358498 12472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.005s	sys 0.009s
I20260709 13:03:07.355319 12434 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:07.371101 12472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.006s	sys 0.009s
W20260709 13:03:07.387065  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.390407 12126 raft_consensus.cc:3055] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:07.390859 12126 raft_consensus.cc:740] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:07.391661 12126 consensus_queue.cc:260] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.392932 12126 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.395805 12038 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10.
W20260709 13:03:07.400705  8366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 1967) took 1531 ms (client timeout 1801 ms). Trace:
W20260709 13:03:07.401206  8366 rpcz_store.cc:269] 0709 13:03:05.869462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.982417 (+112955us) service_pool.cc:224] Handling call
0709 13:03:07.400486 (+1418069us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54000acdd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:07.400638 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759084800}
I20260709 13:03:07.402383  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:07.403120  8366 raft_consensus.cc:2368] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
W20260709 13:03:07.412714  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.413714  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:07.415357  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1978) took 1040 ms. Trace:
I20260709 13:03:07.415833  8363 rpcz_store.cc:276] 0709 13:03:06.374730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.829771 (+455041us) service_pool.cc:224] Handling call
0709 13:03:07.028506 (+198735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.057162 (+ 28656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.415092 (+357930us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400180950. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:07.415281 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456336768}
I20260709 13:03:07.419768  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1980) took 1040 ms. Trace:
I20260709 13:03:07.420222  8364 rpcz_store.cc:276] 0709 13:03:06.379445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.997304 (+617859us) service_pool.cc:224] Handling call
0709 13:03:06.997558 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.042270 (+ 44712us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:07.064176 (+ 21906us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.189237 (+125061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.189296 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:07.189351 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.419479 (+230128us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54000ad2d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:07.419536 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.419699 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7709,"prepare.queue_time_us":27992,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":9406,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":4474,"spinlock_wait_cycles":83115904,"thread_start_us":116946,"threads_started":1,"wal-append.queue_time_us":146008}
I20260709 13:03:07.417261 12307 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.432667  8211 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:03:07.433158  8211 pending_rounds.cc:85] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 6
I20260709 13:03:07.433413  8211 pending_rounds.cc:107] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:03:07.433624  8211 raft_consensus.cc:2889] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.435137  8331 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:07.435606  8366 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:07.446851  8259 leader_election.cc:400] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
W20260709 13:03:07.447013  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.447252  8259 leader_election.cc:403] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:07.449021  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:07.450428  8364 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: [8.10-10.11]
I20260709 13:03:07.453608  8365 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:07.439797 12516 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.457268  8362 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:07.444828 12414 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:07.443053 12156 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:07.449430 12483 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:03:07.454882 12038 consensus_queue.cc:1059] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:03:07.459438 12588 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:07.438413 12437 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:03:07.452816 12583 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:07.464371 12435 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.464859 12435 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.465013 12546 consensus_queue.cc:1059] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:07.462881 12494 raft_consensus.cc:3055] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:07.478223 12184 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:07.479681 12505 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:07.484959  8285 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:07.486169  8284 raft_consensus.cc:1240] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:07.466677 12156 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.485872  8215 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:07.487721  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:07.485113  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 1971) took 1168 ms. Trace:
I20260709 13:03:07.492353  8359 rpcz_store.cc:276] 0709 13:03:06.316375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.775398 (+459023us) service_pool.cc:224] Handling call
0709 13:03:06.775773 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.808259 (+ 32486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.808297 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.809720 (+  1423us) log.cc:844] Serialized 26 byte log entry
0709 13:03:06.921886 (+112166us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:06.928459 (+  6573us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.928714 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.293170 (+364456us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800458020. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9160522 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:03:07.484826 (+191656us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b54001f7054. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:07.484880 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:07.484923 (+    43us) raft_consensus.cc:1685] finished
0709 13:03:07.484937 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.485057 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7919,"prepare.queue_time_us":7817,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":3126,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":9395,"spinlock_wait_cycles":77189120,"thread_start_us":111887,"threads_started":1,"wal-append.queue_time_us":189605}
I20260709 13:03:07.467664 12414 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:07.471608 12494 raft_consensus.cc:740] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:07.503633 12494 consensus_queue.cc:260] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.469735 12554 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.505118 12494 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.504230 12156 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.509748  8365 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:07.503547 12414 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.515766  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.516583  8209 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:07.519055  8257 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:07.504400 12505 raft_consensus.cc:3055] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:07.543637  8209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:03:07.544160  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:07.545035  8287 raft_consensus.cc:2393] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 12: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:07.544277  8209 raft_consensus.cc:606] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.546900  8209 raft_consensus.cc:614] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:07.547240  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:07.547828  8360 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.553227  8209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:03:07.553817  8209 raft_consensus.cc:606] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.558986 12435 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.546283 12480 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.566685 12480 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:07.567062 12480 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:07.568043  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.541450 12546 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:07.540504 12397 consensus_queue.cc:1059] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:03:07.574708 12397 consensus_queue.cc:1243] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:07.511945 12473 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:03:07.579154 12473 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:07.579550 12473 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:07.580385 12473 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.581599 12473 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:07.588932  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.594234  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.594967  8257 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:07.597214 12338 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.597638 12338 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:07.597988 12338 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.513293 12126 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:03:07.606290 12443 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.606809 12142 raft_consensus.cc:3055] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.540525 12505 raft_consensus.cc:740] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:07.538491 12424 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:03:07.619046  8360 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:07.621908  8259 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:07.607251 12142 raft_consensus.cc:740] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:07.634851  8287 raft_consensus.cc:1275] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:07.609123 12546 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:07.639858  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:07.640467  8287 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.646283  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:07.647126  8293 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 15: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:07.651422  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:07.652346  8284 raft_consensus.cc:2410] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:03:07.633278 12437 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:07.661357 12597 log.cc:927] Time spent T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:03:07.663278 12142 consensus_queue.cc:260] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.664466 12142 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.665480  8287 raft_consensus.cc:2468] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:07.666404 12517 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:07.667498 12517 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:03:07.667829 12596 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:07.668470 12517 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.673846  8113 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 6 to 7, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 7 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:07.680912 12512 consensus_queue.cc:1048] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:07.649832 12505 consensus_queue.cc:260] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.647570 12307 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:07.685838  8366 raft_consensus.cc:1240] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:07.687422 12434 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.676621  8113 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 6 to 7, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 7 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:07.690114  8358 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:07.691826 12338 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.648526 12546 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:07.680958  8332 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:07.649299 12184 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:03:07.700860 12434 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:07.701505 12434 consensus_queue.cc:1243] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:07.704149  8361 pending_rounds.cc:85] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 6
I20260709 13:03:07.704443  8361 pending_rounds.cc:107] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:03:07.704700  8361 raft_consensus.cc:2889] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.716325  8358 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:07.719991  8112 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35680 (request call id 399) took 16193 ms (client timeout 15000 ms). Trace:
I20260709 13:03:07.669905 12517 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:07.752617  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 45043.5us
I20260709 13:03:07.754259  8366 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:07.700502 12485 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:07.756052  8291 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:07.758015  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 1.94226e+06us
I20260709 13:03:07.784468  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:07.785594  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:07.786264  8285 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.789214  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:07.718179 12590 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:03:07.777269  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.794806  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:07.795388  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 1.22507e+06us
I20260709 13:03:07.798784  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:07.799405  8891 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:07.801546  8285 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:07.802408  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:07.802964  8890 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.806370  8896 raft_consensus.cc:1240] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:07.807662  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:07.808367  8891 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:07.810410  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:07.811889  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:07.790441  8113 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 3 to 7, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 7 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:07.823367  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 49029.5us
I20260709 13:03:07.816567  8895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 1012) took 1968 ms. Trace:
I20260709 13:03:07.827536  8892 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:03:07.720544  8112 rpcz_store.cc:269] 0709 13:02:51.517819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.518000 (+   181us) service_pool.cc:224] Handling call
0709 13:03:07.711040 (+16193040us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:00.576071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:00.670868 (+ 94797us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:00.677563 (+  6695us) write_op.cc:435] Acquired schema lock
0709 13:03:00.677593 (+    30us) tablet.cc:662] Decoding operations
0709 13:03:00.679248 (+  1655us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:00.679339 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:00.679366 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:03:00.680827 (+  1461us) tablet.cc:701] Row locks acquired
0709 13:03:00.680876 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:03:00.681082 (+   206us) write_op.cc:270] Start()
0709 13:03:00.681214 (+   132us) write_op.cc:276] Timestamp: P: 1783602180680998 usec, L: 0
0709 13:03:00.681247 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:03:00.682014 (+   767us) log.cc:844] Serialized 8106 byte log entry
0709 13:03:01.582709 (+900695us) op_driver.cc:464] REPLICATION: finished
0709 13:03:01.839404 (+256695us) write_op.cc:301] APPLY: starting
0709 13:03:01.839542 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:01.844507 (+  4965us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:01.844643 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:01.963795 (+119152us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:01.964266 (+   471us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=42
0709 13:03:01.964330 (+    64us) write_op.cc:312] APPLY: finished
0709 13:03:01.964818 (+   488us) log.cc:844] Serialized 145 byte log entry
0709 13:03:01.965027 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:01.965222 (+   195us) write_op.cc:454] Released schema lock
0709 13:03:01.965297 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:01.965756 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:01.965787 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":326480,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":231218,"apply.run_cpu_time_us":5859,"apply.run_wall_time_us":130220,"num_ops":21,"prepare.queue_time_us":69834,"prepare.run_cpu_time_us":60425,"prepare.run_wall_time_us":423141,"raft.queue_time_us":198897,"raft.run_cpu_time_us":21964,"raft.run_wall_time_us":215190,"replication_time_us":860774,"thread_start_us":469309,"threads_started":4,"wal-append.queue_time_us":259958,"wal-append.run_cpu_time_us":16184,"wal-append.run_wall_time_us":1961766}]]}
I20260709 13:03:07.824924  8895 rpcz_store.cc:276] 0709 13:03:05.847968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.467704 (+619736us) service_pool.cc:224] Handling call
0709 13:03:06.467914 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.468074 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:06.587625 (+119551us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.816205 (+1228580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.816262 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:07.816309 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.816388 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.816510 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1166589,"prepare.queue_time_us":50585,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":179500,"threads_started":2,"wal-append.queue_time_us":81951,"wal-append.run_cpu_time_us":1179,"wal-append.run_wall_time_us":1082393}
I20260709 13:03:07.827262  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:07.830513  8290 raft_consensus.cc:2376] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14. Re-sending same reply.
I20260709 13:03:07.830652  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:07.831276  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:07.831189  8893 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.831854  8286 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.839068  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:07.780601 12466 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.843701  8892 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:03:07.849481  8892 pending_rounds.cc:85] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 8
I20260709 13:03:07.849761  8892 pending_rounds.cc:107] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:03:07.844779  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:07.795738 12397 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:03:07.852029  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.822824 12572 log.cc:927] Time spent T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:03:07.855906  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.851536  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 858027us
I20260709 13:03:07.779932 12437 raft_consensus.cc:697] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:07.849997  8892 raft_consensus.cc:2889] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.864436  8890 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:03:07.866240  8893 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:07.872154  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:07.822517 12485 raft_consensus.cc:697] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:07.874161  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:07.874806  8113 catalog_manager.cc:5697] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:07.829093 12336 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:07.884480  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.889739  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:07.891309  8863 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:07.892594  8863 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:07.893301  8863 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:07.894227 12428 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:07.894814 12338 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:07.894731 12428 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.848978 12466 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:07.888921  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.894448  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:07.873240 12464 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:07.899417  8213 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:07.845767 12307 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:03:07.950834  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:07.951634  8894 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:07.914343 12411 raft_consensus.cc:2804] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:07.914317 12466 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.852049 12397 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:08.007489  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.008044 12397 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:08.008656  8366 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 13: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:08.012322  8361 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:07.917137  8895 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.899115  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.014453  8892 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.900128  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.015605  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.016165  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.016760  8894 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.017180  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:07.959653 12411 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.018375 12411 raft_consensus.cc:3060] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:08.019790 12397 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.898375 12336 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.021781 12336 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.026337  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.027210  8897 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:08.028149  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.029685  8897 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:07.969635 12600 log.cc:927] Time spent T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:07.970538 12485 consensus_queue.cc:237] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.881943 12474 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:03:08.034322  8286 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:07.977360  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:08.028667 12480 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.035712  8291 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:08.037127 12480 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:07.979004  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.979846  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 122858us
W20260709 13:03:07.979794  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 82733.8us
I20260709 13:03:07.905699  8113 catalog_manager.cc:5697] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 4, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 4 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:08.042491 12411 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.918097 12594 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.043496 11925 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.043640 12594 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:08.044031 11925 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.953125 12460 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:08.044235  8113 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 5 to 8, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 8 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:07.957743 12414 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:03:07.956801 12428 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:07.953457 12429 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.991991 12437 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:07.903942 12292 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:03:07.989989  8216 raft_consensus.cc:2410] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:03:07.923857 12464 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.998596  8292 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:07.999243  8289 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:08.049206  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.049437  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:07.902740  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.006966 12461 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:07.915750  8210 raft_consensus.cc:2410] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:03:07.968775 12505 raft_consensus.cc:3060] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.060702  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:07.981914 12601 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:03:08.044888 12460 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.990442 12546 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.050294  8365 raft_consensus.cc:2410] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:08.050554  8890 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:08.051131  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.074620  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:08.075155  8366 raft_consensus.cc:3060] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.052516  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.076771  8360 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:08.077612  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:08.053452  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.045732  8113 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:08.079986  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.054636  8361 raft_consensus.cc:1240] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 11. Ops: []
I20260709 13:03:08.055207  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:08.056689  8895 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:07.999847 12466 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.085238  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.085737  8892 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:08.086345  8210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1915) took 1013 ms. Trace:
I20260709 13:03:08.086764  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.087798  8361 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.090482  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.093258  8892 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:08.057556  8894 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:08.058344  8897 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.103251  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.103497  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.104370  8897 raft_consensus.cc:2393] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:08.042933  8863 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:08.064643  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.071775  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:08.106437  8364 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 15: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:08.081689  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.105343  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.107182  8895 raft_consensus.cc:2393] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 12: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:03:08.105989  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 63134.4us
I20260709 13:03:08.107718  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.086696  8210 rpcz_store.cc:276] 0709 13:03:07.073140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.077765 (+  4625us) service_pool.cc:224] Handling call
0709 13:03:08.086151 (+1008386us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54002a7954. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:08.086287 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925470592}
I20260709 13:03:08.108062  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.109064  8895 raft_consensus.cc:2368] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:08.109880  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.110497  8895 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:08.104084  8894 raft_consensus.cc:2393] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:08.108973  8897 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:08.113161  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.113528  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.138356  8897 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.112618  8863 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:08.114040  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.112205  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.115305  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.111269  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.116554  8862 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:08.105435 12443 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:08.122468  8364 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:08.122814 12493 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:08.071579 12336 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.073089 11925 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.127322 12435 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:08.128125  8898 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:08.129642 12466 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:08.114858 12554 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:03:08.130503 12010 consensus_queue.cc:1059] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:08.130678 12494 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.132858 12594 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.133796  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:08.143395  8890 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:03:08.145922  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.061667 12429 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.061944 12464 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.147934  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.173672  8892 raft_consensus.cc:2368] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:08.174554  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.148582  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.072242 12228 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.153015  8362 raft_consensus.cc:2410] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:03:08.154434 12508 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.152050 12428 raft_consensus.cc:2804] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:08.152205 12483 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:03:08.158200  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.158388 12473 consensus_meta.cc:287] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.004s
I20260709 13:03:08.084682 12461 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.084748 12460 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.150830  8113 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.171197  8862 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:08.172660  8289 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:08.172873  8361 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:08.190824  8183 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:08.193011  8862 leader_election.cc:400] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12.
I20260709 13:03:08.193372  8862 leader_election.cc:403] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:08.199769  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:08.200121 12440 raft_consensus.cc:3055] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:08.200554 12440 raft_consensus.cc:740] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:08.201330  8862 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:08.201728 12475 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12.
I20260709 13:03:08.176662  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.147567 12414 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.202440 12414 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:08.205014 12414 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:08.206673  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:08.207427 12517 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:08.207849 12517 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:08.179715  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.147802 12443 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:08.209367 12443 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.152179 12493 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.187682  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.210283 12493 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.210543  8898 raft_consensus.cc:2368] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10.
I20260709 13:03:08.211385  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.177820 11925 consensus_queue.cc:1059] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:03:08.211766 12594 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.191824 12428 raft_consensus.cc:697] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:08.212272 12594 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.212713 12428 consensus_queue.cc:237] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.181143 12508 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.178326 12429 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.214255 12508 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.183202 12228 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.194589 12010 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.194911 12461 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:08.195289 12423 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:08.223402  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.177585 12494 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.168185 12434 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:08.216041  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.225936  8892 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:08.244596  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.252370  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.268368  8892 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:08.148046  8366 raft_consensus.cc:2468] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:08.223673 12423 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.215147  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:08.279412  8292 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:08.168503 12336 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.235682 12228 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:08.236980  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:08.292483  8288 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:08.239071  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.296087  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:08.296885  8366 raft_consensus.cc:2393] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
W20260709 13:03:08.303053  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.219604  8897 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:08.189581  8113 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.257346  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:08.266799  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:08.307302  8210 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.222646  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:08.275123  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 417710us
I20260709 13:03:08.280805  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:08.319181  8890 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:08.278332  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:08.189771 12483 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.333180  8213 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:08.281862 12423 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.278650 12107 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:08.346432  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 145205us
I20260709 13:03:08.350678  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:08.330749 12228 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:08.354423  8291 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:08.356084  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:08.357944  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:08.365204  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:08.366042  8286 raft_consensus.cc:2368] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12.
I20260709 13:03:08.374415  8332 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:08.201361 12440 consensus_queue.cc:260] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.294900 12594 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:08.381520  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:08.390479  8209 raft_consensus.cc:2393] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:08.326107 12438 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:08.391678  8288 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:08.392311  8863 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:08.387382  8210 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:08.387465  8864 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:08.332530 12512 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:08.437282  8211 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:08.437704  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 50354.9us
I20260709 13:03:08.442263  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:08.442452  8864 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:08.438004  8217 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:03:08.443841  8217 pending_rounds.cc:85] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 9
I20260709 13:03:08.444101  8217 pending_rounds.cc:107] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:03:08.444345  8217 raft_consensus.cc:2889] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:08.438695  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:08.439365  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.445829  8898 raft_consensus.cc:2376] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11. Re-sending same reply.
I20260709 13:03:08.353051 12473 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:08.379310 12228 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.391523 12411 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.294062 12517 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:08.351842 12219 consensus_queue.cc:1059] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:03:08.462062  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.451654 11925 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:08.468259 11925 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:08.468779 11925 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:08.452831 12228 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.457099 12473 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:08.389613 12107 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:08.449725 11999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.011s	sys 0.022s
W20260709 13:03:08.453980 12610 log.cc:927] Time spent T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:08.443439 12475 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:08.522169  8889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.017s	sys 0.039s
I20260709 13:03:08.444423 12292 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:03:08.458317 12414 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.479609 12494 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:08.558266  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410fe3c36e834265b4c3b139e453a76e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.448830 12512 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:08.485340  8896 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.020s
W20260709 13:03:08.568188  8896 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.000s	sys 0.023s
W20260709 13:03:08.484957  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 119593us
I20260709 13:03:08.445538 12438 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.532860  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.517799 12411 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:08.532866  8287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.036s	sys 0.052s
W20260709 13:03:08.574728  8287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.036s	sys 0.052s
W20260709 13:03:08.543753  8889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.017s	sys 0.039s
I20260709 13:03:08.546420  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:08.566547 12461 raft_consensus.cc:3055] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:08.534294  8291 raft_consensus.cc:1275] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:08.512583 12554 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.559702  8890 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
W20260709 13:03:08.478271  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 130901us
I20260709 13:03:08.562215  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:08.564836 12466 raft_consensus.cc:3055] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:08.564992  8286 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:08.515749 11925 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:08.516054 11999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.011s	sys 0.023s
I20260709 13:03:08.570302  8898 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:08.484654 12464 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.558444 12460 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:08.572746 12397 consensus_meta.cc:287] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:03:08.574247 12438 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:08.578792  8288 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:08.589730  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:08.601583  8211 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:08.574623 12411 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.557458 12219 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:03:08.577726 12461 raft_consensus.cc:740] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:08.617022  8890 raft_consensus.cc:1240] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:08.612481 12440 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.580790 12554 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.614450  8895 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 14: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:08.613745  8862 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:08.615836 12464 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.579393 12517 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.569589 12475 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.619899  8892 raft_consensus.cc:2393] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 13: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:08.579852 12466 raft_consensus.cc:740] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:03:08.624184 12401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.009s	sys 0.030s
I20260709 13:03:08.608734 12411 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.630062  8895 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:08.621840  8890 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:08.636289 12466 consensus_queue.cc:260] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:08.643590 12466 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:08.647368  8895 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:08.648502  8890 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:08.649645  8895 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:08.581643  8257 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:03:08.632833 12401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.009s	sys 0.030s
W20260709 13:03:08.634825 12338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.007s	sys 0.014s
I20260709 13:03:08.634503  8898 raft_consensus.cc:1240] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:03:08.653964  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 72407.9us
I20260709 13:03:08.641125 12336 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:08.634351  8893 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.005s	sys 0.016s
W20260709 13:03:08.676429  8893 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.005s	sys 0.017s
W20260709 13:03:08.678165  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.657167 12338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.007s	sys 0.014s
I20260709 13:03:08.638916 12464 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:08.667409 12184 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.007s	sys 0.011s
I20260709 13:03:08.654038 12473 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.657685 12038 raft_consensus.cc:2804] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:08.655875 12483 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:08.693344  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:08.694146  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:08.715286  8288 raft_consensus.cc:2393] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:03:08.699990  8215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.015s	sys 0.028s
I20260709 13:03:08.714586  8217 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
W20260709 13:03:08.674784 12425 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.011s	sys 0.009s
W20260709 13:03:08.700297  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.004s	sys 0.047s
W20260709 13:03:08.655043 12485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.020s	sys 0.042s
W20260709 13:03:08.709739  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.719295  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:03:08.672480 12412 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.010s	sys 0.031s
W20260709 13:03:08.717410  8215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.015s	sys 0.028s
I20260709 13:03:08.636319 12461 consensus_queue.cc:260] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:08.690104 12184 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.008s	sys 0.012s
W20260709 13:03:08.743155 12425 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.012s	sys 0.010s
W20260709 13:03:08.687705 12472 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.002s	sys 0.020s
I20260709 13:03:08.717643 12107 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:08.744517  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.005s	sys 0.047s
W20260709 13:03:08.743641 12485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.021s	sys 0.048s
W20260709 13:03:08.747327 12412 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.010s	sys 0.032s
I20260709 13:03:08.681751 12219 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 13:03:08.700657 12437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.024s	sys 0.023s
I20260709 13:03:08.748548 12336 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:08.760668 12472 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.003s	sys 0.020s
I20260709 13:03:08.716351 12464 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:08.776914  8289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.005s	sys 0.024s
I20260709 13:03:08.717783 12228 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:08.778916  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 59731.7us
W20260709 13:03:08.780601  8289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.006s	sys 0.024s
W20260709 13:03:08.793736  8359 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.001s	sys 0.039s
W20260709 13:03:08.794211  8359 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.001s	sys 0.039s
I20260709 13:03:08.763428 12512 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:08.773022 12437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.025s	sys 0.023s
I20260709 13:03:08.765146 12038 raft_consensus.cc:697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:08.907557  8292 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.772079 12336 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.809193 12460 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.876856 12461 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:08.865785 12107 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:08.878302 12154 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:08.939050  8183 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.008s	sys 0.020s
W20260709 13:03:09.077453  8183 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.008s	sys 0.020s
W20260709 13:03:09.078148  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 760072us
W20260709 13:03:09.074759  8864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.002s	sys 0.026s
W20260709 13:03:09.078945  8864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.002s	sys 0.026s
W20260709 13:03:09.081310  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 639086us
I20260709 13:03:09.082928  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:09.083613  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.034s	sys 0.033s
W20260709 13:03:09.084160  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.034s	sys 0.033s
I20260709 13:03:08.956215 12107 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:09.073755  8331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.011s	sys 0.014s
W20260709 13:03:09.089744  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 715635us
W20260709 13:03:09.091563  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.092541 12107 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:09.093029  8333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.010s	sys 0.015s
I20260709 13:03:09.093215 12107 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:09.094188  8331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.011s	sys 0.014s
W20260709 13:03:09.094664  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 758031us
I20260709 13:03:09.094455 12107 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.097486 12107 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:09.000626  8861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.022s
I20260709 13:03:09.098356 12010 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:09.098968  8863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.012s	sys 0.008s
W20260709 13:03:09.099391  8863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.012s	sys 0.008s
W20260709 13:03:09.101488  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 709419us
W20260709 13:03:08.964351  8891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.023s	sys 0.006s
W20260709 13:03:09.102562  8891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.023s	sys 0.006s
I20260709 13:03:09.103997  8892 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:09.104152  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:09.105022  8895 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:09.106830  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:09.071646  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 2485) took 1019 ms. Trace:
I20260709 13:03:08.979169 12038 consensus_queue.cc:237] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.108837  8215 rpcz_store.cc:276] 0709 13:03:08.051638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.051752 (+   114us) service_pool.cc:224] Handling call
0709 13:03:08.052025 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.052333 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.052360 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.052798 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:03:08.747780 (+694982us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:08.747824 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.747956 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.070867 (+322911us) raft_consensus.cc:1685] finished
0709 13:03:09.070948 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.071364 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10939,"raft.queue_time_us":846,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":26218,"thread_start_us":694671,"threads_started":1,"wal-append.queue_time_us":909127}
W20260709 13:03:09.109513  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.112862  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.115473  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:09.116050  8864 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.118203 12107 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.119732 12107 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.120901  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.123262  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:08.953018 12154 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:09.124132 12154 raft_consensus.cc:3060] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:09.074687  8113 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.007s	sys 0.014s
W20260709 13:03:09.126734  8113 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.008s	sys 0.015s
W20260709 13:03:09.074692  8896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.021s	sys 0.036s
W20260709 13:03:09.128546  8896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.021s	sys 0.036s
I20260709 13:03:09.108954 12010 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:03:09.093472  8333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.010s	sys 0.015s
I20260709 13:03:09.132202  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:09.133134  8361 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:08.935874 12336 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.134428 11925 consensus_queue.cc:1059] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:09.135357 12219 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.971001 12228 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:09.098701  8861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.022s
I20260709 13:03:09.139526 12292 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.140527 12292 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.142333 12219 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.143332 12219 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:09.145095  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.073294  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:08.977006 12411 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.147143  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:09.147549 12219 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.148102  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:09.029040 12495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.002s	sys 0.015s
W20260709 13:03:09.149869 12495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.002s	sys 0.016s
I20260709 13:03:08.876374 12434 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.153347 12292 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.154410 12434 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:09.156461 12505 consensus_meta.cc:287] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 1.072s	user 0.011s	sys 0.000s
I20260709 13:03:09.157850  8216 raft_consensus.cc:1275] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:03:09.158311  8216 pending_rounds.cc:85] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 6
I20260709 13:03:09.158598  8216 pending_rounds.cc:107] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:03:09.158888  8216 raft_consensus.cc:2889] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:09.159551  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.160269  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:08.961432 12429 consensus_meta.cc:287] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.747s	user 0.007s	sys 0.000s
I20260709 13:03:09.161372  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1117) took 1272 ms. Trace:
I20260709 13:03:09.162246 12429 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:08.997833 12453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.008s	sys 0.018s
W20260709 13:03:09.163792 12453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.008s	sys 0.018s
I20260709 13:03:09.015010 12464 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:08.942292 12475 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:08.950901 12480 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.135748 11925 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:08.982055 12493 consensus_meta.cc:287] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.771s	user 0.005s	sys 0.005s
I20260709 13:03:09.165807 12401 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:08.941344 12494 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:09.167273 12414 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:08.940213 12554 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.168087 12414 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:08.992625 12428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.001s	sys 0.029s
W20260709 13:03:09.170047 12428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.002s	sys 0.029s
I20260709 13:03:09.170420 12438 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:09.170938 12480 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.171615  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:08.977155 12443 consensus_meta.cc:287] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.767s	user 0.007s	sys 0.001s
I20260709 13:03:09.172375 12483 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.172711 12443 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.173535 12453 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:09.174343 12228 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.167927 12494 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.175014 12228 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.149345 12342 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.171334 12438 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.162735 11999 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.160796  8210 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:03:08.987198 12618 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:03:09.173802 12480 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:09.295394  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 172450us
I20260709 13:03:09.296480  8864 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.299435  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.248665 12107 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.144968  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:09.300598  8892 raft_consensus.cc:2376] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14. Re-sending same reply.
I20260709 13:03:09.256577  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:09.250030  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 104250us
I20260709 13:03:09.302489 12219 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:09.259387 12594 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.304983 12594 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.305485 12594 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.306118  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.300241 12622 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.307530 12453 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.309013  8895 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:09.310175  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:09.310954 12554 raft_consensus.cc:493] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.311719 12554 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.166762 12401 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.310871  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.314309 11999 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.315243 12622 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.315920 12401 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.174021 12483 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.317232  8864 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.301939  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:09.265522 12429 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:09.161917  8896 rpcz_store.cc:276] 0709 13:03:07.889097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.889605 (+   508us) service_pool.cc:224] Handling call
0709 13:03:07.889831 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.890020 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:08.568584 (+678564us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.129623 (+561039us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.129935 (+   312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:09.129994 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:09.146579 (+ 16585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.161033 (+ 14454us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.161279 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":753243,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":13766,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":224,"thread_start_us":1238197,"threads_started":2}
I20260709 13:03:09.173676 12434 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.178400  8863 leader_election.cc:400] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12.
I20260709 13:03:09.321743  8863 leader_election.cc:403] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:03:09.278851 12292 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.280290  8890 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:09.178643 12438 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.176440 12460 raft_consensus.cc:3055] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:09.175413 12443 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.176772 12494 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.288332  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1105) took 1481 ms. Trace:
W20260709 13:03:09.277796 12423 consensus_meta.cc:287] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.889s	user 0.011s	sys 0.006s
I20260709 13:03:09.310526 12010 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:03:09.318878  8892 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:09.293241  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:09.324858  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 72646.6us
I20260709 13:03:09.332275  8217 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:09.332863 12292 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.342314  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.175936 12485 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:09.166913 12493 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.317611 11999 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.333947  8891 rpcz_store.cc:276] 0709 13:03:07.809381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.823307 (+ 13926us) service_pool.cc:224] Handling call
0709 13:03:07.823616 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.823941 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:08.293541 (+469600us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.103735 (+810194us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.103972 (+   237us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.104640 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.104763 (+   123us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:09.104808 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.104940 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.281693 (+176753us) raft_consensus.cc:1685] finished
0709 13:03:09.281714 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.288263 (+  6549us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96201,"prepare.queue_time_us":975435,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":34271,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":11259,"thread_start_us":1131045,"threads_started":2,"wal-append.queue_time_us":707384}
I20260709 13:03:09.355659  8215 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:03:09.356976  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 132597us
I20260709 13:03:09.359493  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:09.361183  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:09.362838  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:09.363611 12411 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:09.367966 12508 consensus_meta.cc:287] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 1.153s	user 0.005s	sys 0.012s
I20260709 13:03:09.368432 12508 raft_consensus.cc:515] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.371850  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2570) took 1666 ms. Trace:
I20260709 13:03:09.372347  8287 rpcz_store.cc:276] 0709 13:03:07.705798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.705925 (+   127us) service_pool.cc:224] Handling call
0709 13:03:07.706311 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.752534 (+ 46223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.752567 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.753043 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.858282 (+105239us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b18003a60c0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded0d1 00007f2efc208a0f
0709 13:03:08.575111 (+716829us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:08.575148 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.575208 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.371315 (+796107us) raft_consensus.cc:1685] finished
0709 13:03:09.371359 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.371654 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65499,"raft.queue_time_us":48804,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":17259,"spinlock_wait_cycles":30138624,"thread_start_us":716657,"threads_started":1,"wal-append.queue_time_us":1015763}
I20260709 13:03:09.379419  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:09.380141  8209 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.384617  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:09.344758 12453 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:09.393361  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 50660.7us
I20260709 13:03:09.398939  8363 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:09.334898 12460 raft_consensus.cc:740] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:09.407383 12622 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:09.431563  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.446846  8209 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:09.442587  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.419535 12554 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:09.449921  8259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.007s	sys 0.023s
I20260709 13:03:09.350224 12423 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.390547 12107 consensus_queue.cc:1048] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 13:03:09.459187  8259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.008s	sys 0.023s
I20260709 13:03:09.314410 12336 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.453563  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.456729  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:09.447461 12508 leader_election.cc:290] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:09.465312  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.452872  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:09.468789  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:09.469630  8894 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 15: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:09.470134  8217 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:03:09.471408  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.472340  8214 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:09.472494 12228 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:09.472879 12517 consensus_meta.cc:287] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.007s
W20260709 13:03:09.476511 12440 consensus_meta.cc:287] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.853s	user 0.003s	sys 0.013s
W20260709 13:03:09.477402  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 299388us
I20260709 13:03:09.455999 12443 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.488611  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:09.489516  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 172432us
I20260709 13:03:09.463503 12414 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:09.432163 12485 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.483177  8257 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:09.491374  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.488193  8331 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:09.499531  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.459988 12154 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.503574  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:09.506626  8214 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.506796  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:09.506632  8215 raft_consensus.cc:2410] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:09.510638 12512 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:09.510989 12643 consensus_queue.cc:1059] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:03:09.511463 12412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.018s
W20260709 13:03:09.511899 12412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.007s	sys 0.018s
I20260709 13:03:09.512148  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:09.512509 12443 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.514703 12443 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.490888 11999 consensus_queue.cc:1048] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:03:09.517330 12594 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.512877  8365 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
W20260709 13:03:09.518362 12615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.055s	sys 0.024s
W20260709 13:03:09.522013 12615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.056s	sys 0.025s
I20260709 13:03:09.518301  8862 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:09.510340  8216 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:09.518312  8893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1116) took 1629 ms. Trace:
I20260709 13:03:09.524596  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:09.525575  8890 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 14: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:09.526484  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:09.527164  8896 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.527221 12440 raft_consensus.cc:2804] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:09.491065 12483 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:09.529081 12440 raft_consensus.cc:697] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:09.529894 12638 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.530390 12638 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.530247 12440 consensus_queue.cc:237] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.530774 12638 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.531788 12493 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:09.532660  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.528505 12292 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:09.534711  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:09.522990  8893 rpcz_store.cc:276] 0709 13:03:07.888820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.888922 (+   102us) service_pool.cc:224] Handling call
0709 13:03:07.889193 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.979473 (+ 90280us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:08.676972 (+697499us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.087553 (+410581us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.087872 (+   319us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.088979 (+  1107us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.089181 (+   202us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:09.089407 (+   226us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.089656 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.098044 (+  8388us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.517944 (+419900us) raft_consensus.cc:1685] finished
0709 13:03:09.517964 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.518145 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103301,"prepare.queue_time_us":1002096,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":108,"raft.queue_time_us":156046,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":11241,"thread_start_us":1103481,"threads_started":2,"wal-append.queue_time_us":801788}
I20260709 13:03:09.505257 12462 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.522693  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 109572us
I20260709 13:03:09.526439  8889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1109) took 1713 ms. Trace:
W20260709 13:03:09.539688  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 56605.6us
W20260709 13:03:09.544360  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 47270us
I20260709 13:03:09.546859  8359 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
W20260709 13:03:09.559317  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.555958  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.505475 12401 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:09.540745  8889 rpcz_store.cc:276] 0709 13:03:07.812946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.813050 (+   104us) service_pool.cc:224] Handling call
0709 13:03:07.813382 (+   332us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:08.575544 (+762162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.575570 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:08.576189 (+   619us) log.cc:844] Serialized 78 byte log entry
0709 13:03:09.075518 (+499329us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:09.075614 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.075764 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.526089 (+450325us) raft_consensus.cc:1685] finished
0709 13:03:09.526108 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.526278 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133888,"raft.queue_time_us":135048,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3476,"thread_start_us":1173132,"threads_started":2,"wal-append.queue_time_us":924953}
I20260709 13:03:09.574968  8210 raft_consensus.cc:2410] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:09.582109  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:09.583134  8364 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 13: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:09.584022  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:09.584977 12656 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:09.585453 12656 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.585824 12656 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:09.577656 12425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.020s	sys 0.058s
I20260709 13:03:09.587904 12485 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:09.605934  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:09.606628  8287 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:09.606794 12425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.020s	sys 0.059s
I20260709 13:03:09.607077  8214 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
W20260709 13:03:09.591071  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.004s	sys 0.027s
W20260709 13:03:09.608078  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.004s	sys 0.027s
W20260709 13:03:09.555001 12472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.024s	sys 0.050s
I20260709 13:03:09.610580  8332 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:09.611781 12485 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.612233 12485 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:09.612658 12485 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.612922 12336 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.612183  8332 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:09.614372 12423 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.578286  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:09.615576  8286 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:09.616580 12401 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.618013 12666 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.619177  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:09.620018 12666 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.621169  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:09.562270 12184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.015s	sys 0.016s
W20260709 13:03:09.574692 12620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.034s
I20260709 13:03:09.576778 12494 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.605057  8183 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.523387 12460 consensus_queue.cc:260] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.588318 12462 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.579432  8863 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:09.603435 12594 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.640463  8896 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:09.642328  8184 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:09.644164 12620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.006s	sys 0.035s
W20260709 13:03:09.656889  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 99170us
I20260709 13:03:09.557612 12643 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:03:09.661685  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:09.666777  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.644441 12184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.015s	sys 0.016s
W20260709 13:03:09.667724  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 47660.5us
I20260709 13:03:09.640242 12494 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:09.660208 12414 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.657575 12493 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:09.675400 12494 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.682386  8287 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:09.668074 12460 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.667724 12336 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:09.666016 12107 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.698825  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.698989 12107 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.700078 12640 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.700500 12640 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:09.700826 12640 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.701323 12107 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:09.678768  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:09.702404  8365 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.704806 12453 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12.
I20260709 13:03:09.670362 12472 raft_consensus.cc:2764] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:03:09.667603 12423 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:09.689384  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:09.665647 12615 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.694475  8364 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
W20260709 13:03:09.715749  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 110839us
I20260709 13:03:09.717902  8365 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:09.726282 12615 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.727137  8183 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.728909  8183 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.729887 12425 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:09.731465 12425 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.732173 12425 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:09.733837  8183 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.734742 12228 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:09.735231 12462 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.735236 12228 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:09.738009 12228 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.746662  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:09.743081  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 122027us
I20260709 13:03:09.755146  8184 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:09.756000  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:09.756680 12425 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:09.757218 12425 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:09.758149 12425 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.762519 12154 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.762607  8183 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.763865 12614 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:09.764138  8183 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:09.766160  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 256219us
I20260709 13:03:09.766387 12554 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:09.767951 12672 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:09.768334 12554 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:09.768936 12554 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:09.756160 12423 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:09.770646 12423 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.771077 12423 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:09.774597 12554 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.775718  8209 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:03:09.723021  8258 connection.cc:256] RPC call timeout handler was delayed by -1.6465785990000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 13:03:09.777660 12615 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.739208 12453 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.786369  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:09.764590 12614 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.787842  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.789362  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:03:09.783685  8258 connection.cc:256] RPC call timeout handler was delayed by -1.6332221449999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
I20260709 13:03:09.808799  8331 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:09.810068  8363 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.815353  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:09.795979 12493 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:09.783109 12672 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:03:09.819273  8258 connection.cc:256] RPC call timeout handler was delayed by -1.4541082590000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:03:09.821723  8258 connection.cc:256] RPC call timeout handler was delayed by -1.3170094810000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 13:03:09.818666  8210 raft_consensus.cc:2468] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:09.823326  8365 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
W20260709 13:03:09.822113  8258 connection.cc:256] RPC call timeout handler was delayed by -1.1706749630000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22519999999999998s for a response
I20260709 13:03:09.822849 12646 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.826500 12646 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.826880 12646 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.795881 12453 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.831596 12665 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.832297 12665 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:09.835119  8331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.836570  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 80664.7us
I20260709 13:03:09.840057 11999 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:09.840751 11999 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.842519  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:09.843107 11999 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.843267  8291 raft_consensus.cc:3060] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:03:09.842744 12650 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.118s	user 0.002s	sys 0.001s
I20260709 13:03:09.848363  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:09.850929 12423 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.852202  8214 raft_consensus.cc:2393] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 14: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:09.852417  8289 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 15: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:09.852624  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.853485  8215 raft_consensus.cc:2410] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:09.809798 12615 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:09.853933  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:09.821880 12443 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.849001  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.863232  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:09.865599  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 79335.3us
I20260709 13:03:09.819778 12672 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:09.848711  8257 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:09.871776  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:09.874545  8258 connection.cc:256] RPC call timeout handler was delayed by -1.0565792709999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:03:09.874997  8258 connection.cc:256] RPC call timeout handler was delayed by -1.037620473000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 13:03:09.881232  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:09.864436 12443 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.889920  8210 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
W20260709 13:03:09.890144  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 65758.1us
W20260709 13:03:09.888144  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 98263.6us
I20260709 13:03:09.876873 12412 raft_consensus.cc:3055] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:09.895071 12412 raft_consensus.cc:740] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:09.898528 12412 consensus_queue.cc:260] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.899133 12414 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:09.893234 12443 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.899607 12414 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.902979 12038 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.903690 12038 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.906224  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 961) took 1207 ms. Trace:
I20260709 13:03:09.885771 12662 raft_consensus.cc:2804] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:09.907341 12669 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:09.910236 12397 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.910730 12397 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.910982  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.911950 12638 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.914140  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:09.915282 12423 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.917177  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:09.919481 12615 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.920398 12495 consensus_queue.cc:1059] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:09.920666  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:09.921587 12495 raft_consensus.cc:3055] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:09.921587 12662 raft_consensus.cc:697] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:09.922281 12460 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:09.889091 12665 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.922972 12662 consensus_queue.cc:237] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:09.923555 12495 raft_consensus.cc:740] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:09.924767 12412 raft_consensus.cc:3060] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.912400  8897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1375) took 1996 ms. Trace:
I20260709 13:03:09.924681 12495 consensus_queue.cc:260] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.911087 12397 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.934021  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:09.926153  8258 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:09.937129  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:09.939725  8214 raft_consensus.cc:3060] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.955833  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:09.922950 12665 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.906661  8211 rpcz_store.cc:276] 0709 13:03:08.672256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.672413 (+   157us) service_pool.cc:224] Handling call
0709 13:03:08.672759 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.673134 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:08.673163 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.673631 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.071360 (+397729us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:09.071482 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.071632 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.864646 (+793014us) raft_consensus.cc:1685] finished
0709 13:03:09.864670 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.879858 (+ 15188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1007,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6020,"thread_start_us":397075,"threads_started":1,"wal-append.queue_time_us":1095204}
I20260709 13:03:09.911100 12038 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:09.915230 12638 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:09.934780 12495 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.933279 12656 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:09.974795  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48836.5us
W20260709 13:03:09.979002  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 58506.6us
I20260709 13:03:09.934489 12425 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:09.926694  8897 rpcz_store.cc:276] 0709 13:03:07.916883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.568372 (+651489us) service_pool.cc:224] Handling call
0709 13:03:08.568672 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:08.575725 (+  7053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.575755 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:08.576189 (+   434us) log.cc:844] Serialized 52 byte log entry
0709 13:03:09.105835 (+529646us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:09.133680 (+ 27845us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.133942 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.134044 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.841999 (+707955us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:03:09.911969 (+ 69970us) raft_consensus.cc:1685] finished
0709 13:03:09.912069 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.912246 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126871,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":112414,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":27430,"spinlock_wait_cycles":48164608,"thread_start_us":498077,"threads_started":1,"wal-append.queue_time_us":1075352}
I20260709 13:03:09.982750  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:09.982605 12665 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:09.983815  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:09.964990 12505 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:09.984864 12647 log.cc:927] Time spent T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
W20260709 13:03:09.985853 12668 log.cc:927] Time spent T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.291s	user 0.003s	sys 0.000s
W20260709 13:03:09.988384  8894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43628 (request call id 1381) took 1882 ms (client timeout 2235 ms). Trace:
I20260709 13:03:09.996526  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:09.977806  8291 raft_consensus.cc:2468] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
W20260709 13:03:09.992329  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.979741  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:09.997244  8893 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:09.996479  8331 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:09.984220  8288 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:10.027635  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:10.007244  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.023200  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.020188  8896 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:10.094558  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.010779  8363 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:10.093686  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.083563  8258 leader_election.cc:400] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:10.014976  8286 raft_consensus.cc:1240] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:10.034021  8862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.095162  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 98797.4us
I20260709 13:03:10.012876  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.058748  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:03:10.094403  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 199520us
I20260709 13:03:10.105010  8359 raft_consensus.cc:2393] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:10.105676  8258 leader_election.cc:403] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:10.066735  8210 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:10.020576  8891 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:03:10.104074  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:10.020541  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.022387  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.000867  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:10.146809  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 113817us
W20260709 13:03:10.102440  8894 rpcz_store.cc:269] 0709 13:03:08.106423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.112950 (+  6527us) service_pool.cc:224] Handling call
0709 13:03:09.988109 (+1875159us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400675f54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:09.988301 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2909966592}
I20260709 13:03:10.149142  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:10.024657 12655 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:03:10.149657  8364 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:10.005626 12645 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:10.022506 12453 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:03:09.999136 12473 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.106619 12638 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:10.066262 12425 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.032217 12665 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.151283  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.161403  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.065907 12493 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:03:10.157682  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 53718.3us
I20260709 13:03:10.066902 12505 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:10.145756 12483 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.106909 12643 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:10.107297 12154 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.010530 12401 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.165998  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.166157  8862 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:10.104274 12666 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.167349  8359 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
W20260709 13:03:10.153823 12647 log.cc:927] Time spent T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:03:10.021960 12656 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.170624  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.178747 12661 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.164088 12460 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.174950 12638 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.168286 12620 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:10.178951 12643 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.179231  8332 leader_election.cc:304] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:10.172746  8211 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:10.183820  8214 raft_consensus.cc:2468] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:10.105556 12485 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.183332  8259 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.171600 12483 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:10.192575 12483 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.193186 12615 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.195695 12638 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:10.196518 12401 raft_consensus.cc:2749] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.203500 12425 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:10.209231  8864 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.173878 12614 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.210871  8184 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:10.216084  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.220098 12673 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:10.220700 12673 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:10.223559 12440 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.223784  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.225034  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.225682  8359 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:10.182983 12473 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:10.191031 12671 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:03:10.186740 12453 raft_consensus.cc:2804] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:10.232905  8363 raft_consensus.cc:3060] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.235322  8362 raft_consensus.cc:1240] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:10.239813  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:10.238927  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 206420us
I20260709 13:03:10.245447  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.245726  8287 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:03:10.246101  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 76127.6us
I20260709 13:03:10.181106 12493 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.228183 12517 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:10.191031 12443 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.221575 12673 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.280108  8364 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
W20260709 13:03:10.282198  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 117920us
I20260709 13:03:10.267568  8360 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:10.259037 12453 raft_consensus.cc:697] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:10.281406  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.288023  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.277813  8363 raft_consensus.cc:2468] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
W20260709 13:03:10.287274  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 78188.7us
I20260709 13:03:10.232477 12646 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.290165  8864 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:10.294567 12684 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:03:10.294337 12453 consensus_queue.cc:237] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.301381  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.301676  8364 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 15: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:03:10.302814 12678 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:03:10.330238  8359 raft_consensus.cc:1240] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:10.331230  8365 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:10.297696 12672 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.269541 12434 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:03:10.333964  8364 raft_consensus.cc:1240] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12. Ops: [8.9-11.10]
I20260709 13:03:10.334637  8363 raft_consensus.cc:1275] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:03:10.336899 12680 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.363s	user 0.003s	sys 0.000s
I20260709 13:03:10.298780 12228 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:03:10.339784 12412 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.340382 12412 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.342607 12485 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:10.343431 12494 consensus_meta.cc:287] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.002s
I20260709 13:03:10.303328 12462 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:03:10.290315 12505 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.348961 12473 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:10.351397 12672 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.352958  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 2018) took 1097 ms. Trace:
W20260709 13:03:10.353627  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 91472.3us
W20260709 13:03:10.348964 12640 consensus_meta.cc:287] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 13:03:10.332016 12517 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.354935 12640 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.355849  8211 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:10.356418 12517 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:10.331030 12688 log.cc:927] Time spent T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:03:10.357040 12640 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.354472  8258 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:10.358589 12646 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.358934  8209 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:03:10.359354  8209 pending_rounds.cc:85] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 8
I20260709 13:03:10.359618  8209 pending_rounds.cc:107] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:03:10.359848  8209 raft_consensus.cc:2889] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:10.361322  8183 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:10.362177 12554 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:10.363544 12643 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:10.363489 12554 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:10.364472  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:10.365038  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.364697 12554 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.365468 12493 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:10.366041 12493 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.343907 12494 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.371856  8889 raft_consensus.cc:2468] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:10.380462  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:10.383363  8184 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:10.388876  8331 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:10.403546  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 49190.9us
I20260709 13:03:10.330613 12440 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.405256  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.406109  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.385994  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:10.405659  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:10.414556  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:10.415160  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:10.386006 12678 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.004s
W20260709 13:03:10.384959 12683 log.cc:927] Time spent T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.407s	user 0.000s	sys 0.002s
I20260709 13:03:10.410121  8259 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:10.434863  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.413024  8211 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:10.385918 12228 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:10.436049  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 2017) took 1301 ms. Trace:
I20260709 13:03:10.420580  8258 leader_election.cc:400] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:10.421289 12493 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:10.422788  8292 raft_consensus.cc:2393] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 12: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:10.410838 11999 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.441728 12657 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:10.425958 12414 consensus_meta.cc:287] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.005s
I20260709 13:03:10.379333 12397 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:10.390901 12689 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:03:10.423393 12443 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.429872  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:10.431627  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:10.353528  8358 rpcz_store.cc:276] 0709 13:03:09.255148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.257948 (+  2800us) service_pool.cc:224] Handling call
0709 13:03:09.284306 (+ 26358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.335610 (+ 51304us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:09.699122 (+363512us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b180042b0e0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915d455 00007f2effc453c7 00007f2efc2579a7 00007f2efc2670bf 00007f2efc267038
0709 13:03:09.874486 (+175364us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.095505 (+221019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:10.095560 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:10.106635 (+ 11075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.352202 (+245567us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b180042b0e0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef912e2a6 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419
0709 13:03:10.352627 (+   425us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b5400433854. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:10.352670 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.352789 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3250,"prepare.queue_time_us":57481,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":12769,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11618,"spinlock_wait_cycles":186115072,"thread_start_us":365413,"threads_started":2,"wal-append.queue_time_us":281183}
I20260709 13:03:10.381065 12412 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:10.440621  8286 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:10.423329 12694 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.405236 12646 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:10.410897 12686 log.cc:927] Time spent T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: Append to log took a long time: real 0.132s	user 0.000s	sys 0.002s
I20260709 13:03:10.442839  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:10.442248  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 152252us
I20260709 13:03:10.353988 12483 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.436429  8361 rpcz_store.cc:276] 0709 13:03:09.134620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.249797 (+115177us) service_pool.cc:224] Handling call
0709 13:03:09.308435 (+ 58638us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b58001f7798. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:03:09.308712 (+   277us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:09.347341 (+ 38629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.347374 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:09.416327 (+ 68953us) log.cc:844] Serialized 52 byte log entry
0709 13:03:09.621384 (+205057us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:09.630684 (+  9300us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.630864 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.833766 (+202902us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b54003188d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:09.833819 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.435840 (+602021us) raft_consensus.cc:1685] finished
0709 13:03:10.435860 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.435975 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":793,"prepare.queue_time_us":8830,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":115234,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":46243,"spinlock_wait_cycles":66036480,"thread_start_us":152246,"threads_started":1,"wal-append.queue_time_us":481362}
W20260709 13:03:10.458714  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 44747.3us
I20260709 13:03:10.469667 12691 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.470023  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.470279  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.492583  8359 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:10.417186 12693 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:03:10.472790  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:10.475235  8209 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:10.477173  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:10.477886  8363 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:10.484418  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b726723bee647ec82d162a5cf1a6515" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:10.445089 12657 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.487546  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.490602  8215 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:10.491657  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.415880 12472 consensus_queue.cc:1059] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:03:10.492492  8218 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:10.497758  8864 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.501318  8286 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.504695  8896 raft_consensus.cc:1240] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: [10.11-12.12]
I20260709 13:03:10.509279  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:10.488384 12646 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.506981  8259 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:10.507890  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 80924.9us
I20260709 13:03:10.513489  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:10.513533  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:10.445619 12440 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.517000  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:10.467125 12414 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.526333  8864 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.526579  8862 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:10.502836 12657 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.519708 12453 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.520165 12038 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.520658 12483 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:10.510713 12517 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:03:10.522929  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:10.498613 12505 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:10.518427  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:03:10.524654  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 93137.4us
I20260709 13:03:10.519081  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:10.501827 12228 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:10.543759  8286 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:10.515245 12646 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.552665  8362 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:10.508692 12640 consensus_queue.cc:1059] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:03:10.581393 12640 raft_consensus.cc:3055] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:10.581782 12640 raft_consensus.cc:740] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:10.582407  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:03:10.577174  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 156792us
I20260709 13:03:10.535506 12038 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:10.579233  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 67724.3us
I20260709 13:03:10.576009 12401 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:10.586800  8211 raft_consensus.cc:2393] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:03:10.588774  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 74770.3us
I20260709 13:03:10.596073  8864 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.549567 12425 raft_consensus.cc:3055] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:10.597898  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 71420.1us
I20260709 13:03:10.563009 12505 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.582721 12493 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:10.606669  8862 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.610937  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:10.611366  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.615927  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.531420 12694 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:03:10.587530 12691 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.596074 12038 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.593026 12453 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.619270  8183 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.593968 12401 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:10.601861 12425 raft_consensus.cc:740] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:10.624498  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.610967 12505 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:10.570431 12699 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:03:10.631201  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:10.632011  8289 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:10.606992 12494 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.634423  8287 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
I20260709 13:03:10.582770 12640 consensus_queue.cc:260] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.635003  8183 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.622390 12460 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:10.625888 12453 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.627374 12401 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:10.625391 12434 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.631402 12412 raft_consensus.cc:2804] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:10.628978 12154 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:03:10.656625  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 54997.5us
W20260709 13:03:10.658531  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.660913  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 68003us
I20260709 13:03:10.661478  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:10.652531 12453 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.656109 12704 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.660334 12672 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:10.658821 12154 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.657392 12397 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:10.663345 12412 raft_consensus.cc:697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:10.680605  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:10.658409 12493 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:10.627216 12228 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.673902 12483 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.666530 12705 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.686236  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:10.677778 12640 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.691859 12483 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:03:10.693523 12703 log.cc:927] Time spent T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:10.674201 12460 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:03:10.685060 12414 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:10.689338 12440 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:10.712750 12711 consensus_queue.cc:1048] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:03:10.718861 12697 log.cc:927] Time spent T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:03:10.700829 12517 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.694029 12701 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:10.726779 12701 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.729039 12701 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:10.728716 12646 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.729877  8364 raft_consensus.cc:2368] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10.
I20260709 13:03:10.731043  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:10.738123 12707 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:10.705576 12483 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.729858  8897 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:10.745559  8891 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:10.711495 12412 consensus_queue.cc:237] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.747448 12693 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.683632 12425 consensus_queue.cc:260] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.755155 12425 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:10.760872  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.762180  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:10.762774  8360 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.742571 12401 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:10.803287  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 127944us
I20260709 13:03:10.809422  8360 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:10.777421 12473 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.816402 12401 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.819473 12646 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.823205  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:10.824138 12505 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:10.824841 12423 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:10.825651 12423 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:10.826066 12423 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:10.826671 12494 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:10.827114 12494 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:03:10.827353 12712 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:03:10.826964 12423 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.804191  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:10.733865 12657 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.777356 12672 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:10.846366 12672 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:10.861714  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 233602us
W20260709 13:03:10.865429  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.870918  8363 raft_consensus.cc:1275] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:10.871676  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:10.874162 12154 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:10.875641  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.877100  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.877847  8361 raft_consensus.cc:2393] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:03:10.884140 12696 log.cc:927] Time spent T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.304s	user 0.003s	sys 0.000s
I20260709 13:03:10.889793  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:10.871146  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:10.893107  8213 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.893898  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:10.894661  8218 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 8: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:03:10.896997  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 231028us
I20260709 13:03:10.897018  8291 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 13: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:10.903267  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:10.843986 12699 consensus_queue.cc:1243] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:10.898279  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:10.861238 12646 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:10.862087 12505 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:10.904474  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:10.911113  8212 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.907539  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:10.914875  8218 raft_consensus.cc:1275] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:03:10.916136  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 286681us
W20260709 13:03:10.926033  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 296169us
I20260709 13:03:10.926816  8862 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:10.918162 12494 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.973193 12699 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.916360 12228 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:10.910449 12646 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:10.975780  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:10.983433  8287 raft_consensus.cc:2393] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 12: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:10.907039 12701 consensus_queue.cc:1059] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:03:10.978789  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 51861us
I20260709 13:03:10.992362  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:10.973354 12038 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:10.983281  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:10.978617  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 44417.4us
W20260709 13:03:10.971581  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 304496us
W20260709 13:03:10.986099  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 80949.1us
I20260709 13:03:10.981437 12699 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.987438 12646 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:11.031631 12699 raft_consensus.cc:3060] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.991091 12412 consensus_queue.cc:1048] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:03:11.037456  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 45203.8us
I20260709 13:03:10.991712 12638 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:10.996313 12493 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.973822 12661 consensus_queue.cc:1048] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:11.101408  8862 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:11.140336  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.162786  8258 leader_election.cc:400] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10.
I20260709 13:03:11.163273  8258 leader_election.cc:403] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:11.172879  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.005342 12494 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.176729  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.181213  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.182106  8364 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:11.192348  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:11.198266  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 96986.8us
I20260709 13:03:11.202787  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:11.203591  8218 raft_consensus.cc:2410] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:03:11.213560  8211 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:11.171773 12656 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10.
I20260709 13:03:11.228382  8183 leader_election.cc:304] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.234100  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.235545  8216 raft_consensus.cc:1240] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:11.236876  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:11.237924  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.237968  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:11.242384  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 79847.2us
I20260709 13:03:11.242607  8183 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:03:11.243633  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.175405 12483 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.180428 12493 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.236291  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:11.177271 12453 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.231055 12505 raft_consensus.cc:2749] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:11.259358  8293 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 13: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:11.254604  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.254105  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.254053  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:11.263041  8365 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:11.243295 12657 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.264928  8291 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:11.266964 12724 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:11.271332  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.271481 12693 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.254176 12401 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.277340  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.278383  8287 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 14: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:11.280743  8258 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:11.281361 12733 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:11.282032 12733 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:11.283214 12720 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:11.284222 12710 log.cc:927] Time spent T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:03:11.284791  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.285622  8213 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:11.272429  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:11.288859  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:11.289969  8332 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.291324  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.292560  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.294124  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.245515 12672 consensus_queue.cc:1059] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:11.305500  8209 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:11.304916 12483 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:11.307978  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.312284  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:11.272073 12693 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.296351 12640 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.282531 12733 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.317705  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.295866 12638 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:11.320922  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 78416.5us
I20260709 13:03:11.322820  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:11.303400  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:11.329233  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48596.6us
I20260709 13:03:11.305603 12517 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:11.312950 12741 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:11.318006 12662 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:11.326762  8183 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:11.283799 12720 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:11.361554  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 58222.4us
I20260709 13:03:11.363320  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.325502 12038 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.321103 12743 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:11.370304  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:11.362542 12725 log.cc:927] Time spent T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:03:11.356138 12741 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:11.381656  8332 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.324294 12640 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:11.390149  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 63482.3us
I20260709 13:03:11.379546 12672 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:11.405838 12672 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:11.406716  8258 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:11.407840 12620 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:11.408138  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:11.412117 12656 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:11.413447 12656 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:11.413863 12656 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.414911 12693 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.406850 12672 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.421378 12656 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.427723 12656 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:11.430656 12699 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:11.432906  8212 consensus_meta.cc:287] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.000s
I20260709 13:03:11.438401 12493 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.438599 12453 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893)
I20260709 13:03:11.439137 12414 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:11.434566 12741 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.440151 12741 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:11.435417 12743 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.443668  8212 raft_consensus.cc:2468] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:11.445888 12673 raft_consensus.cc:2764] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:03:11.445123 12699 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:11.449463 12719 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 13:03:11.450405 12754 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.451191 12754 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:11.452214 12734 log.cc:927] Time spent T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
W20260709 13:03:11.422899 12736 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:03:11.457360 12720 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.437651 12733 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.468212  8366 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:11.480151  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 88438.7us
I20260709 13:03:11.483341  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:11.421545 12646 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.492420  8184 leader_election.cc:400] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10.
W20260709 13:03:11.492944  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 50504.4us
I20260709 13:03:11.505300  8359 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:11.427646 12640 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:11.509451  8358 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:11.481330 12495 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.521196  8362 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:11.542742  8291 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:11.551407  8293 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:11.530580 12228 consensus_meta.cc:287] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.545s	user 0.003s	sys 0.006s
I20260709 13:03:11.507016 12494 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:03:11.531376 12401 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.574213  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:11.574739 12494 consensus_queue.cc:1243] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:11.575274 12494 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:11.575583 12494 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:11.576350 12494 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.577426 12494 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:11.556734 12483 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.587172 12646 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:11.541288 12748 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:11.598451  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:11.599121  8360 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.565280 12228 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.531697 12495 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.601563  8367 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:03:11.602165  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.603453  8284 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:11.601080 12748 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:11.611047  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 80146.8us
I20260709 13:03:11.611728 12495 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:11.611898  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:11.612738 12748 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.613300 12656 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:11.614238 12714 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:11.615233  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.615837  8365 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:11.616358  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:11.616062  8290 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:11.616678  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.619045  8360 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:11.619712  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.620546  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.623034  8360 raft_consensus.cc:2393] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:11.623886  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.624558  8360 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:11.623813  8367 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:11.625524  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.626160  8360 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:11.623775  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:11.632647  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 251104us
I20260709 13:03:11.634212  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.614296 12620 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:03:11.641083 12702 raft_consensus.cc:3055] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:11.641481 12702 raft_consensus.cc:740] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:11.642393 12702 consensus_queue.cc:260] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.626422 12038 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:11.643574 12702 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.635228 12495 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:11.645653 12495 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.651459  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.652223  8290 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:11.659701  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:11.646005 12495 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.663219  8331 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:11.668020  8359 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:03:11.668826 12727 log.cc:927] Time spent T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.435s	user 0.001s	sys 0.001s
I20260709 13:03:11.670437  8184 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:11.675019  8331 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:11.674995 12397 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:11.674700 12228 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:03:11.685380 12640 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:11.674523 12673 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:03:11.685277 12763 raft_consensus.cc:2804] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:11.694684 12397 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:11.686482 12691 consensus_queue.cc:1059] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:03:11.714571  8286 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:11.705258 12640 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:11.726683 12640 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:11.712739 12397 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.725083 12656 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:11.711711 12763 raft_consensus.cc:697] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:11.756923 12763 consensus_queue.cc:237] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.761560  8892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1139) took 1243 ms. Trace:
I20260709 13:03:11.761912  8892 rpcz_store.cc:276] 0709 13:03:10.518333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.522253 (+  3920us) service_pool.cc:224] Handling call
0709 13:03:10.522532 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:10.561610 (+ 39078us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:10.733933 (+172323us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b180041fec0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915d455 00007f2effc453c7 00007f2efc2579a7 00007f2efc2670bf 00007f2efc267038
0709 13:03:10.986631 (+252698us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.307896 (+321265us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.308666 (+   770us) log.cc:844] Serialized 26 byte log entry
0709 13:03:11.308895 (+   229us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:11.312195 (+  3300us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.761081 (+448886us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b180041fec0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef90dac0a 00007f2f0281a219 00007f2ef9162a40 00007f2ef915d4e4 00007f2ef915d455 00007f2efc245060 00007f2efc257716 00007f2efc268287 00007f2efc268208
0709 13:03:11.761232 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.761300 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.761339 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:11.761352 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.761510 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17532,"prepare.queue_time_us":98326,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":510625,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":16515,"spinlock_wait_cycles":39230208,"thread_start_us":458670,"threads_started":3,"wal-append.queue_time_us":457009}
I20260709 13:03:11.767894  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.768532  8891 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:11.771970  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.773273  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.774109  8897 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:11.775173  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.775775  8897 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:11.776028  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.766300 12412 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:03:11.769933 12766 log.cc:927] Time spent T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:11.777140  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.781747  8891 raft_consensus.cc:2368] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 13. Current term is 14.
I20260709 13:03:11.782754  8893 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:11.783682 12412 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.786567 12730 raft_consensus.cc:3055] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:11.786965 12730 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:11.778576  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.779197  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.777136 12726 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:11.771613 12460 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:11.789683 12460 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:11.791368 12729 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.626s	user 0.005s	sys 0.000s
I20260709 13:03:11.792479 12460 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.779896  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.775532 12672 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:03:11.771413 12741 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:03:11.794417  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.798460  8896 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:11.796118  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:11.800243  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.785724 12412 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:11.801163  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:11.801880  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.802548  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.803974  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.804612  8896 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.775065 12505 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:03:11.804716  8889 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:11.810124  8864 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:11.806686  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:11.804859 12483 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:11.807894  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:11.808171  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:11.815690  8216 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:11.812628  8897 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:11.813301 12643 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.813470  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.813570  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.814093 12720 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:11.814229  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:11.814384  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 46061.8us
I20260709 13:03:11.813220  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:11.800413 12741 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:11.819546 12746 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.810204 12228 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:03:11.818956  8892 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:11.825292  8896 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:11.815341 12483 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.831023  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.836383 12440 raft_consensus.cc:2804] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:11.836948 12440 raft_consensus.cc:697] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:11.837807  8864 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:11.840982 12720 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:11.841380 12720 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.841701 12720 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.814724 12721 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:03:11.820158 12643 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.843628  8863 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:11.845337 12721 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:11.847483  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.848212  8890 raft_consensus.cc:2368] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13.
I20260709 13:03:11.803287 12748 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:03:11.826120 12741 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:11.934645  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.839140 12483 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.829667 12228 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:11.935542  8892 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:11.939698  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:11.951867  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 63974.7us
I20260709 13:03:11.954453 12620 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:11.954609 12704 raft_consensus.cc:493] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.966427 12620 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:11.966845 12620 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.965705 12443 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:11.968132  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 124610us
I20260709 13:03:11.966866 12704 raft_consensus.cc:515] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.968912  8863 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:11.970655 12704 leader_election.cc:290] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:11.971091 12517 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.971709  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.971613 12517 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.973754 12517 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:11.975091  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.982710  8891 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:11.975097  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.977716  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.978427  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:11.979108 12702 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:11.987870  8893 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:11.947269 12228 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:11.985992  8211 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:11.987002  8257 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:11.983825  8892 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:11.975219 12772 log.cc:927] Time spent T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:03:11.996758  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:11.997546  8367 raft_consensus.cc:2393] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 14: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:12.000279  8891 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:12.001400  8896 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
I20260709 13:03:12.001610  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:12.012408  8358 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:12.013386  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:12.014253 12717 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.014851 12717 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.821285 12730 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.021617 12730 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.022884  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:12.025633 12228 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.026921 12228 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:12.030272 12771 log.cc:927] Time spent T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:03:12.031220  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:12.032423  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:03:12.033285 12743 consensus_meta.cc:287] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: Time spent flushing consensus metadata: real 0.592s	user 0.017s	sys 0.000s
I20260709 13:03:12.033466  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:12.033717 12743 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:12.034309  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:11.992278 12741 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:11.828431 12746 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.035763  8894 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:12.037249  8892 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:12.017203 12717 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.039803 12495 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.041499  8358 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:03:12.042357 12773 log.cc:927] Time spent T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:03:12.043210 12434 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:12.018357 12614 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:12.045926 12702 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.046543 12702 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:11.935985 12440 consensus_queue.cc:237] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.048717 12702 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:12.043439 12752 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:12.046684  8286 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:12.016961 12483 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:12.052649  8894 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:12.060827  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 55086.5us
I20260709 13:03:12.061911  8892 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:11.968501 12443 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.042065 12495 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.086995  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:12.087705  8367 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:12.071280  8862 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:12.096485  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:12.096800  8862 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.097658  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:12.103658  8863 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:12.105847  8863 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:12.109088  8892 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:12.120847  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.122232 12472 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:12.125922  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.127288 12472 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.128690 12472 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:12.129383 12472 consensus_queue.cc:1243] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer 4a50f39e2d8e4886a79849938f2272a6 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:12.130060 12724 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.130645 12724 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.133040 12724 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:12.133437 12423 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:12.135982  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:12.137107  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:12.100353 12702 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:12.103518 12693 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.085824 12662 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:03:12.107892 12733 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:12.157363 12483 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:12.158339  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:12.159054  8215 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.164065  8366 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:12.106480 12493 consensus_queue.cc:1059] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:03:12.078609 12752 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.157611 12662 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:12.171933  8258 leader_election.cc:400] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13.
I20260709 13:03:12.173602  8258 leader_election.cc:403] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:12.172418  8215 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:12.176167  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:12.176944  8331 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:12.183362  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:12.184156  8209 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 8.
I20260709 13:03:12.115996 12759 consensus_queue.cc:1059] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:03:12.196455  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:12.206408  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:12.207136  8216 raft_consensus.cc:3060] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.173326 12662 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:12.174468 12701 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.209514  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:12.209836  8215 raft_consensus.cc:1275] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:12.210461  8214 raft_consensus.cc:2393] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:12.192152 12743 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:12.212169  8212 raft_consensus.cc:1275] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:12.225410 12743 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:12.214109  8862 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:12.226387 12743 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:12.227501 12724 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:12.227923 12724 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.228253 12724 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.194521 12038 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13.
I20260709 13:03:12.231014 12699 consensus_queue.cc:1048] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:12.232852  8895 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:12.214630  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:12.214563  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 44216.6us
I20260709 13:03:12.216341  8897 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:12.218924 12443 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.219647 12752 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:12.191905 12460 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.220798  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:12.197822 12397 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:12.222306  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:12.262861  8215 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:12.223349 12662 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:12.259763  8258 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.260270  8895 raft_consensus.cc:1275] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:12.258809  8890 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:12.265751  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:12.246291 12758 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.255576 12423 raft_consensus.cc:493] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.313939  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.316740  8895 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:12.324643 12423 raft_consensus.cc:515] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:12.330860  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 89704.8us
I20260709 13:03:12.331827  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.278744 12730 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.336354  8258 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:12.340482  8889 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:12.344539  8258 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.268285 12721 consensus_queue.cc:1048] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:03:12.347620  8862 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:12.269866 12460 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.356951  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.358289  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.361553 12743 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.361821 12517 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:12.355064 12440 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.362331 12517 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:12.362793 12517 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.362905 12733 raft_consensus.cc:3055] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:12.363307 12733 raft_consensus.cc:740] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:12.319334 12717 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:03:12.364085 12733 consensus_queue.cc:260] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.364550 12717 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.342664 12038 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.324573 12758 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:12.375227  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.349651 12751 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.347385 12731 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.359472 12661 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:12.379667  8332 leader_election.cc:400] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 13. Current term is 14.
I20260709 13:03:12.463833  8332 leader_election.cc:403] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:12.469794  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 122319us
I20260709 13:03:12.474463  8211 raft_consensus.cc:1240] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:12.449803 12763 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:12.476747  8214 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:12.487263  8893 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:12.479140 12661 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:12.488588  8183 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:12.489419 12785 log.cc:927] Time spent T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:03:12.489574 12661 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.490823 12397 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:12.491727 12722 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.492287 12722 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.479882 12763 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.494423 12763 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.465775 12751 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.496593 12751 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:12.502614 12788 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:03:12.503716 12795 log.cc:927] Time spent T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 13:03:12.506711 12781 log.cc:927] Time spent T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:03:12.508733 12460 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:12.473425 12412 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.509871  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:12.510907 12702 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.511093  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:12.511756  8361 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:03:12.512671  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:12.513377  8361 raft_consensus.cc:2410] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:03:12.506757 12793 log.cc:927] Time spent T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:03:12.519125 12794 log.cc:927] Time spent T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:12.475299 12038 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.374382 12440 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.533347  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:12.534001  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 45520.6us
I20260709 13:03:12.530951  8367 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:12.532478  8216 raft_consensus.cc:2468] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:12.538025  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:12.458036 12743 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.549834  8361 raft_consensus.cc:1240] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:12.550815  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:12.551446  8287 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:12.485947 12646 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 for earlier term 13. Current term is 14.
I20260709 13:03:12.494451 12722 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.462680 12717 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.554211  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:12.560189  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 186046us
I20260709 13:03:12.561074  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.562661  8218 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:12.566547  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.579188  8332 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.532169 12724 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.537233 12038 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:12.583684  8332 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.580163 12640 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:12.589309 12720 consensus_meta.cc:287] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.745s	user 0.022s	sys 0.004s
I20260709 13:03:12.583909 12646 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:12.583894 12755 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.586949 12640 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:12.593081 12646 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:12.589761 12720 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.596628 12706 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:12.599697 12646 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.598511 12640 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.700114 12730 consensus_queue.cc:1059] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:12.700547 12731 consensus_queue.cc:1048] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:12.701655 12730 consensus_queue.cc:1059] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:12.702682 12730 raft_consensus.cc:3055] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:12.667107 12440 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:12.669127  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:12.703962 12803 log.cc:927] Time spent T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:03:12.669832 12799 log.cc:927] Time spent T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:03:12.663332 12797 log.cc:927] Time spent T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:03:12.671257 12798 log.cc:927] Time spent T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:12.678867  8898 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:12.679852 12720 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:12.707121 12440 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.707659 12440 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.710783  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:12.711932  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:03:12.712289 12620 consensus_meta.cc:287] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.745s	user 0.012s	sys 0.000s
I20260709 13:03:12.712586  8363 raft_consensus.cc:2393] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:12.712736 12620 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:12.713798  8363 raft_consensus.cc:1275] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:12.682324 12706 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:12.709878 12440 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:12.661892 12755 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:12.722213 12802 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
I20260709 13:03:12.722371 12755 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:12.701908 12731 raft_consensus.cc:3055] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:12.722885 12731 raft_consensus.cc:740] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:12.682870  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:12.723279 12755 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.723758 12731 consensus_queue.cc:260] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:12.657210 12792 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:03:12.707729 12038 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:12.726471  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:12.714926 12743 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.676375 12717 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.710814 12724 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:12.721730 12706 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.703050 12758 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:12.731484 12731 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:12.680804 12517 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.721741  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:12.737381  8363 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.737766 12517 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.703011 12730 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:12.743027 12730 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.744400 12730 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:12.747787 12646 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.752022 12620 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:12.752539 12646 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.759554 12720 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.777420 12720 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.780702 12720 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:12.764660 12763 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.783280 12763 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.785094  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:12.785802  8358 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:12.774420  8363 raft_consensus.cc:2468] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:12.761031  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:12.803472 12731 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.806696 12731 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.817871  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:12.818610  8896 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:12.819864  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:12.821110 12620 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:12.821571 12620 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.821974 12620 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.807524 12640 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.825255 12640 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:12.835091  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.840408  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.841753  8863 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:12.843653  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.843981  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:12.846239  8209 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:12.848300  8863 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:12.868433  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:12.873184  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:03:12.879132  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 295582us
I20260709 13:03:12.880066  8332 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.881273  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.835399 12731 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:12.845850 12720 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.853523 12724 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.863336 12721 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:12.892175  8257 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.894048  8332 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.897445  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:12.881773 12691 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:12.882017 12640 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.900326  8360 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:12.903326  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.905413  8332 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:12.906623  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 2051) took 1418 ms. Trace:
I20260709 13:03:12.909768  8214 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:12.923743 12819 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.889333 12646 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:12.906999  8366 rpcz_store.cc:276] 0709 13:03:11.481796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.483071 (+  1275us) service_pool.cc:224] Handling call
0709 13:03:12.899979 (+1416908us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54001cedd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:12.900102 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354477952}
I20260709 13:03:12.931649  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:12.893452 12721 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.941285  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:12.899560 12731 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:12.985303  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.985963  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:12.991652  8367 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
W20260709 13:03:12.986498  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 45309.4us
I20260709 13:03:12.928373 12763 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:12.964347 12819 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:12.895236 12694 consensus_queue.cc:1059] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:03:12.931026 12646 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:12.927959 12758 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.981149 12721 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.979363 12640 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:12.993093 12517 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:12.999994  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.999394  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 74561us
W20260709 13:03:12.995150 12772 log.cc:927] Time spent T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:12.979440 12720 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:12.927597 12691 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.005887  8184 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:12.999929 12646 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.954010 12620 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.004904 12517 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.004688 12758 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:13.005915 12640 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:13.023990 12758 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.026340 12758 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:13.027194 12810 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:13.027693 12810 raft_consensus.cc:493] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.028026 12810 raft_consensus.cc:3060] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:13.031785 12809 raft_consensus.cc:2764] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:03:13.034296  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43630 (request call id 1052) took 1044 ms. Trace:
I20260709 13:03:13.034736  8898 rpcz_store.cc:276] 0709 13:03:12.004916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.013089 (+  8173us) service_pool.cc:224] Handling call
0709 13:03:13.034023 (+1020934us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54005fee54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:13.034207 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528765824}
I20260709 13:03:13.052223 12620 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.021005 12517 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.067260  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.068488  8898 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:13.031978 12784 log.cc:927] Time spent T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.444s	user 0.007s	sys 0.004s
I20260709 13:03:13.014889 12720 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.040849 12731 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:13.067312 12691 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:13.086335  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 189543us
W20260709 13:03:13.183511  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 190707us
I20260709 13:03:13.113647  8898 raft_consensus.cc:2468] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
W20260709 13:03:13.113902  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.145716  8897 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:03:13.124789  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 119008us
I20260709 13:03:13.126514  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.148857  8894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43622 (request call id 1146) took 1171 ms. Trace:
I20260709 13:03:13.144675  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee8a45d39bb4537bebf44a3d479ebd4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.149917  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.129781  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2471) took 1189 ms. Trace:
I20260709 13:03:13.146397  8893 pending_rounds.cc:85] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 9
I20260709 13:03:13.189138  8893 pending_rounds.cc:107] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:03:13.189386  8893 raft_consensus.cc:2889] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:13.112470  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:13.145023  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.108739 12620 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:13.192440 12829 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.193104  8289 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:13.108780  8257 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
W20260709 13:03:13.204905  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 96234.5us
I20260709 13:03:13.188416  8360 rpcz_store.cc:276] 0709 13:03:11.940315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.940438 (+   123us) service_pool.cc:224] Handling call
0709 13:03:12.900192 (+959754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.904557 (+  4365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.129578 (+225021us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54001cedd0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:13.129722 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207106304}
I20260709 13:03:13.152473  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.186878  8894 rpcz_store.cc:276] 0709 13:03:11.977806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.037318 (+ 59512us) service_pool.cc:224] Handling call
0709 13:03:12.052444 (+ 15126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.061345 (+  8901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.148664 (+1087319us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b540003dc50. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24c8ad 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:13.148800 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34198272}
I20260709 13:03:13.196339  8258 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:13.209821  8895 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:13.210994  8218 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:13.211630  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.213469  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.214156  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:13.214438  8898 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:13.085460 12763 raft_consensus.cc:697] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:13.218567  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.100286 12820 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.223476  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.128636 12662 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.224596  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.142247 12720 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:13.178332 12819 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.075156 12731 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.234483  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:13.203086 12614 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:13.246441  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:13.248256  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:13.241258  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.241890  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.249912  8898 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:13.242477  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.250857  8897 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:13.222157 12691 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:13.137681 12517 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.236810 12694 raft_consensus.cc:2804] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:13.242991  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.215538 12824 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:13.252316  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 48345us
I20260709 13:03:13.222455 12638 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.141024 12721 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.254935  8332 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:13.227241 12809 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:13.268715  8862 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:13.270087  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.270841  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:13.264178  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:13.271697  8289 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.216164 12620 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.266557  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.244693 12758 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:13.269481  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.257324  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.110810 12640 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.222712 12829 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.259737 12724 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.280719  8367 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:13.285724  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.261180 12691 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:13.288003  8288 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:13.275439 12809 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.301306 12809 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:13.302512 12822 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:13.302953 12822 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:13.303159 12731 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:13.305099 12829 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.307359 12721 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:13.308244 12721 raft_consensus.cc:2764] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:13.308881 12721 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:13.282701 12758 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.311057 12714 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:13.311830 12758 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:13.311676 12714 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.287883 12763 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.315003  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.352101  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:13.265177 12743 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:03:13.282521 12694 raft_consensus.cc:697] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:13.256870 12614 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.376161  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:13.359157  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.239413 12820 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.309466 12721 consensus_queue.cc:1059] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:03:13.303303 12822 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:13.379693  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 141909us
I20260709 13:03:13.272941 12638 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.348861 12758 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:13.384670  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.350124 12819 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.313941 12714 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.287250 12724 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.393787  8183 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:13.376670 12434 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:13.269243 12824 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.407804  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.409502 12443 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:13.410142  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53342 (request call id 1008) took 1630 ms. Trace:
I20260709 13:03:13.410951 12810 raft_consensus.cc:515] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.410943 12443 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:13.412883  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.411381 12820 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:13.417325  8214 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:13.417847 12614 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.418089 12517 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.418941  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:13.419694  8360 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:13.416690 12810 leader_election.cc:290] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.420568 12638 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:13.420815  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.423709 12694 consensus_queue.cc:237] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.417742  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.426419  8259 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:13.417739  8896 raft_consensus.cc:1275] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:13.410516  8286 rpcz_store.cc:276] 0709 13:03:11.777730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.777860 (+   130us) service_pool.cc:224] Handling call
0709 13:03:13.407615 (+1629755us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54001d56d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:13.407758 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559630208}
W20260709 13:03:13.429682  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 174862us
I20260709 13:03:13.431529  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:13.438817  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.432297  8896 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:13.408295 12829 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:03:13.443450  8332 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:13.443378  8259 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:13.447824  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:13.428030 12434 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.452335  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:13.400152 12758 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.400409 12819 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:13.456982  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 63247.8us
I20260709 13:03:13.458662  8291 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.419219 12646 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.462489  8183 leader_election.cc:304] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:13.463078  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 55679.7us
I20260709 13:03:13.463907  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:13.465867 12228 raft_consensus.cc:2749] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.450112 12691 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.467870  8183 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:13.469384 12638 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:13.469817 12638 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:13.469986 12228 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:13.460032 12714 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:13.470520 12228 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.470801 12714 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:13.470966 12228 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.472275 12662 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:13.472826 12662 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:13.475528 12819 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.477144  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:13.478356  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.479357  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.479535 12228 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.450253 12838 consensus_queue.cc:1059] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:03:13.465829  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.483465  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.473680 12662 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.483678  8183 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:13.490991  8367 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:13.501964 12673 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:13.502480 12673 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.502837 12673 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.484040  8286 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 15.
I20260709 13:03:13.504393  8290 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
W20260709 13:03:13.509192  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 45311.9us
I20260709 13:03:13.511199 12809 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:13.511761 12809 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.512120 12228 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.513916 12809 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:13.516177  8367 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:13.518723  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.470194 12638 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.523768  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:13.524773  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:13.525636  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 246550us
I20260709 13:03:13.525908  8286 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 15.
I20260709 13:03:13.503376 12758 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.539130 12434 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.484252 12824 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.540700  8291 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:13.541697  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.541791  8289 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
W20260709 13:03:13.544605 12786 log.cc:927] Time spent T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 1.067s	user 0.005s	sys 0.009s
I20260709 13:03:13.547048  8286 raft_consensus.cc:1275] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:13.548923  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.549605  8291 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
I20260709 13:03:13.552814  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:13.506431 12731 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:13.521081 12840 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:13.555935  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:13.559170  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.563807  8360 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:13.564770  8367 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:13.564004  8291 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:13.571978  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.578132  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:13.579820  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:13.583077 12640 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:13.594259  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.596081  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:13.596709 12646 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.597222 12704 raft_consensus.cc:493] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:13.536135 12822 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.597892 12704 raft_consensus.cc:515] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.599076 12837 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:13.599798 12822 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.600069 12704 leader_election.cc:290] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:13.601250  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.602341  8183 leader_election.cc:304] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:13.554168 12434 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.500765 12714 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.610867  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.570086 12724 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:13.570318 12731 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.613032  8360 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 15.
I20260709 13:03:13.622251 12731 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.611399 12822 consensus_queue.cc:1048] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:03:13.615990  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.616179  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.616891  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.617515 12693 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:13.610476 12837 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:13.623818  8286 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:13.624806 12746 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:13.554736 12752 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:03:13.627243  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.615091  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:13.634835  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:13.637480  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.585615 12758 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:13.642597  8893 raft_consensus.cc:2393] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 9: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:13.607118 12819 raft_consensus.cc:2749] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.644793  8331 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:13.647056  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:13.654131  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.656018  8893 raft_consensus.cc:3060] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.656411  8864 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:13.659165  8864 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:13.645260 12759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.284s	user 0.013s	sys 0.016s
I20260709 13:03:13.669377  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:13.671250  8864 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:13.672271 12759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.311s	user 0.013s	sys 0.016s
I20260709 13:03:13.672883 12759 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:13.673344 12759 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:13.673784 12759 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.682003 12759 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.658169 12743 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:13.684440 12759 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:13.685117 12759 raft_consensus.cc:2804] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:13.685590 12759 raft_consensus.cc:697] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:13.686549 12759 consensus_queue.cc:237] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.689181  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.690428  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.691390  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.691880  8889 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:13.692564  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.693008  8889 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.695118 12643 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:13.695809  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.696534  8218 raft_consensus.cc:2393] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 14: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:13.700814  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:13.647449 12837 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.665596 12857 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.665691 12440 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:13.736934  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:13.742035  8893 raft_consensus.cc:2468] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:13.743057  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.743366  8332 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:13.745263  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:13.745954  8891 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 15.
I20260709 13:03:13.686594 12701 raft_consensus.cc:3055] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:13.747512  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:13.646288 12693 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:13.747282  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 76138.2us
I20260709 13:03:13.750346  8891 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:13.752030  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 57348us
W20260709 13:03:13.754630  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 48510.4us
I20260709 13:03:13.754757  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:13.731631 12743 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:13.761852  8889 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
I20260709 13:03:13.765657  8892 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 8.
I20260709 13:03:13.751641 12758 raft_consensus.cc:2804] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:13.735977 12746 consensus_queue.cc:1048] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:03:13.748616 12701 raft_consensus.cc:740] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:13.756595 12763 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.767050 12865 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:13.741034 12673 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.780929 12733 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.765460 12840 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.755633 12856 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.764557 12743 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.780676 12758 raft_consensus.cc:697] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:13.782917 12763 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.778760 12443 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:03:13.807772 12763 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.822299 12638 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:13.824515 12638 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:13.826097  8367 raft_consensus.cc:2393] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
W20260709 13:03:13.827876  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 72547.2us
I20260709 13:03:13.820189 12837 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:13.839948  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:13.840519  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 85868.3us
I20260709 13:03:13.841427  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a377c652f93483693fc4684f03ffac4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.842767  8864 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:13.843078  8184 leader_election.cc:304] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:13.844815  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 91645.4us
I20260709 13:03:13.846416  8864 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:13.833840 12857 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:13.845479  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:13.847198  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.802281 12840 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.852335  8216 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:13.853439  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:13.850809 12759 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.809512 12701 consensus_queue.cc:260] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:13.853432  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:13.855756  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.858990  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:13.868391  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.868242  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:13.873036  8216 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:13.869974  8215 raft_consensus.cc:2393] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:13.855568 12759 raft_consensus.cc:493] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.856770 12837 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.866828 12701 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.868247 12846 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.880632 12440 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.987360  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:13.998613  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:03:14.006271  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 160900us
I20260709 13:03:14.007162  8218 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:03:14.007622  8218 pending_rounds.cc:85] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 9
I20260709 13:03:14.007848  8218 pending_rounds.cc:107] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:03:14.008073  8218 raft_consensus.cc:2889] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:13.844251 12758 consensus_queue.cc:237] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:13.991668  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.010983  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.013074  8211 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 12: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:03:14.016271  8861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.985906 12759 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.922851 12877 raft_consensus.cc:2749] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:14.025853  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:14.018150 12868 log.cc:927] Time spent T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:03:14.015242 12673 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:13.854691 12857 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.017067 12848 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:13.141078  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:14.067268  8211 raft_consensus.cc:1240] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:14.069348  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.027556 12880 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.033783 12870 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.034850 12848 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:14.057859 12832 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.643s	user 0.000s	sys 0.003s
I20260709 13:03:14.057839 12743 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:14.009757 12846 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:14.097023 12873 log.cc:927] Time spent T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
W20260709 13:03:14.096937 12872 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:14.101341 12846 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:14.089437 12880 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.104985 12880 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.102717 12840 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.093221 12848 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.085821 12425 consensus_queue.cc:1059] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:03:14.092914 12870 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.127815 12673 raft_consensus.cc:3055] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:14.219012  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 195824us
I20260709 13:03:14.220824  8183 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:14.134256 12673 raft_consensus.cc:740] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
W20260709 13:03:14.226058 12879 log.cc:927] Time spent T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:03:14.227149  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:14.227586  8893 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:14.230613  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.231900  8893 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:14.234292 12889 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:14.234892 12889 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:14.235702 12889 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.240020  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.241272  8898 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:14.241772 12724 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.242314 12724 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.219933 12423 leader_election.cc:290] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.221745 12763 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:14.251993  8862 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.1:41893 timed out after 1.530s (SENT) [suppressed 19 similar messages]
I20260709 13:03:14.260421 12829 raft_consensus.cc:3055] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:14.260895 12829 raft_consensus.cc:740] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:14.261723 12829 consensus_queue.cc:260] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.263026 12829 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:14.269266 12759 raft_consensus.cc:515] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.271284 12693 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:14.276350 12870 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:14.280841 12723 raft_consensus.cc:3055] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:14.281383 12723 raft_consensus.cc:740] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:14.282253 12723 consensus_queue.cc:260] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:14.283245 12723 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:14.296299 12852 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.297009 12852 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.299324 12854 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:14.300534 12857 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.302274 12714 consensus_queue.cc:1059] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:14.302626 12673 consensus_queue.cc:260] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.302273 12762 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:14.302300  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 518864us
I20260709 13:03:14.304313  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
W20260709 13:03:14.307871 12886 log.cc:927] Time spent T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:14.308542 12861 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:14.309255  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.334587 12704 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.309584  8360 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:14.335206 12704 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.310591  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:14.310707  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.311694  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.336915  8365 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:14.312660 12864 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:14.313325  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab0986fac1e49b59f2c51d4cd50f2b8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.313959  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.314046  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:14.318462  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.339669  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.340636  8863 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:14.324258 12759 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.324280 12852 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.336313  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.311721  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:14.342717  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:14.343310  8291 raft_consensus.cc:3060] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:14.345019  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 93096.4us
I20260709 13:03:14.346443  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.350342  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.350926  8890 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:14.348228  8183 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:14.352952  8259 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.327713 12730 raft_consensus.cc:3055] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:14.358546  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.362659  8863 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.364776  8259 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.351930 12857 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:14.355319 12852 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.354928 12693 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.358976 12730 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:14.381965  8291 raft_consensus.cc:2468] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 16.
I20260709 13:03:14.383383  8365 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:14.384822  8863 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:14.364511 12887 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:14.351827 12842 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:03:14.390317 12397 consensus_queue.cc:1059] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:14.368696 12691 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:14.337453 12762 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.368294 12440 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:14.393210  8862 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:14.373384 12714 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.377573 12614 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.394904 12887 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:14.403787 12887 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.391549 12733 raft_consensus.cc:2804] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:14.406436 12733 raft_consensus.cc:697] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 16 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:14.407331 12733 consensus_queue.cc:237] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.352710 12861 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.413213  8213 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:14.415524  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7effd0faf2d846cea5b8e82ac737b7e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:14.420629 12730 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.421386 12861 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.422811 12763 leader_election.cc:290] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.399168 12759 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:14.384696 12857 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.425421  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.426314  8211 raft_consensus.cc:2393] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:14.427922 12762 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.411314 12614 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.430603  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.433640 12614 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.434249 12741 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.435671 12731 raft_consensus.cc:3055] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:14.436112 12731 raft_consensus.cc:740] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:14.436869 12731 consensus_queue.cc:260] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.437350  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.435690 12846 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:14.438700 12846 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.440969  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:14.437837 12731 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:14.443971  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.449469  8895 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:14.428203 12857 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.452943  8361 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:14.440725 12758 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:14.454459 12758 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.447283 12823 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:14.438452 12704 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.456498 12758 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.457479 12620 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.459486  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.463516 12823 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:14.464028 12823 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:14.467648 12846 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.468708  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.469575  8892 raft_consensus.cc:2410] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:14.419304 12848 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.472049 12848 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.475351  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:14.479851  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:14.480705  8367 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 16: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:14.481006  8890 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:14.484700  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:14.487969  8258 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:14.489971  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:14.490644  8896 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.494812  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.495985  8365 raft_consensus.cc:2393] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 15: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:14.495085  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.499846  8864 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.499866  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.497464 12851 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:14.545784  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 46032.2us
I20260709 13:03:14.548221  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.549080  8897 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:14.550033  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.520675  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.550820  8890 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 9.
I20260709 13:03:14.556545  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.510583 12851 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:14.557945 12851 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.558558  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:14.559680 12723 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:14.561414 12723 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.552770 12819 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.562355 12819 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:14.564399 12819 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.552512 12752 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.498013 12748 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:14.567328 12748 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.567687 12748 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:14.554526  8894 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:14.575206  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.575794  8898 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:14.576457  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.578442  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:14.579455  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.580179  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.580574  8287 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:14.581549  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:14.586045  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.586561  8290 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:14.588670  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:14.590040  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:14.593448  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.593338  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.593976  8365 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:14.578390 12723 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.574632 12440 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.591939  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19654c841264233b661225cdb0ef14b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:14.582484 12864 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.597404  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.592581  8896 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
I20260709 13:03:14.571030 12851 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.599068  8287 raft_consensus.cc:2393] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 16: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:14.602751  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:14.591535 12828 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:14.604897  8897 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:03:14.613030  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39866 (request call id 997) took 1373 ms (client timeout 1530 ms). Trace:
I20260709 13:03:14.606726 12885 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:14.613523  8214 rpcz_store.cc:269] 0709 13:03:13.234126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.234245 (+   119us) service_pool.cc:224] Handling call
0709 13:03:14.607050 (+1372805us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400129154. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:14.607199 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402325760}
I20260709 13:03:14.611136  8210 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:14.611260  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.600838  8183 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:14.592437 12824 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:14.622615 12824 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.612811 12828 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.598829 12723 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.615149 12885 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.624089 12762 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:14.600431 12440 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.601800 12864 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.629351 12826 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:14.650873  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.628589 12887 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:14.650542  8290 raft_consensus.cc:1240] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:14.630971 12824 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.632750 12828 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.644732 12885 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:14.651427 12898 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:03:14.658010  8292 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:14.661357  8897 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:14.651257 12762 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:14.664175 12723 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.655606 12826 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:14.670470  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.679453  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60538 (request call id 2627) took 1133 ms. Trace:
I20260709 13:03:14.689550  8286 rpcz_store.cc:276] 0709 13:03:13.546104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.555203 (+  9099us) service_pool.cc:224] Handling call
0709 13:03:14.679293 (+1124090us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b540009fe54. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:14.679385 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117683456}
I20260709 13:03:14.691685 12762 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.695478 12662 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:14.696079 12662 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.657755 12887 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:14.681655  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.682569 12440 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.684500  8889 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:14.687232  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.644018 12640 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:03:14.698956  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:14.699116  8216 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:03:14.792088  8258 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:14.809718  8218 raft_consensus.cc:2393] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 12: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:14.698999  8863 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.734553  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:14.810956  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 112080us
I20260709 13:03:14.809017  8216 pending_rounds.cc:85] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 8
I20260709 13:03:14.812638  8216 pending_rounds.cc:107] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:03:14.813062  8216 raft_consensus.cc:2889] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:14.798053  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:14.782115 12831 log.cc:927] Time spent T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 1.361s	user 0.019s	sys 0.022s
W20260709 13:03:14.815712  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 81296.4us
I20260709 13:03:14.816221  8358 raft_consensus.cc:1275] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:14.819542  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2487) took 1465 ms. Trace:
I20260709 13:03:14.775506 12889 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:14.819967  8359 rpcz_store.cc:276] 0709 13:03:13.354258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.354439 (+   181us) service_pool.cc:224] Handling call
0709 13:03:13.354796 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.503783 (+148987us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:13.504078 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.699907 (+195829us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b1800439e40. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef90dac0a 00007f2f0281a219 00007f2efbe03d70 00007f2efbdf7293 00007f2efbdeccea 00007f2efbded23a 00007f2efc257a2a 00007f2efc2670bf 00007f2efc267038
0709 13:03:13.800060 (+100153us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.801037 (+   977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:13.801083 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:13.801139 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.819324 (+1018185us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540043c454. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:14.819378 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.819484 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1945,"prepare.queue_time_us":2929,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":2849,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"spinlock_wait_cycles":347790592,"thread_start_us":98368,"threads_started":1,"wal-append.queue_time_us":137630}
I20260709 13:03:14.777773 12826 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.768402 12724 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:14.802507 12851 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.823995  8258 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:14.814945 12440 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.826498  8897 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:14.841991  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.856035  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.815246 12038 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:14.821218 12746 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:14.858961 12887 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.860637  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:14.825306 12748 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.857739 12038 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
W20260709 13:03:14.868284  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 192786us
I20260709 13:03:14.712426 12838 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 13:03:14.870301 12614 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:14.871647  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:14.872563  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.872870 12704 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:14.875728 12228 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:14.892428  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.892927 12614 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.892795 12228 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.892336 12704 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:14.893947  8211 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:03:14.894420 12905 log.cc:927] Time spent T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.241s	user 0.006s	sys 0.004s
I20260709 13:03:14.875854 12890 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.895105 12890 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:14.878404  8257 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:14.890944  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.897020 12890 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.873559 12828 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.898694 12228 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.893349 12614 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:14.825183 12889 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:14.895640 12704 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.899232  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2618) took 1757 ms. Trace:
I20260709 13:03:14.886026  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:14.905457  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:14.854760 12662 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.906116  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.889623 12829 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:14.879406 12746 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:14.908910  8897 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:14.912772  8332 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:14.890390 12038 raft_consensus.cc:3060] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:14.893378 12748 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.908591  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.904299  8285 rpcz_store.cc:276] 0709 13:03:13.141869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.143148 (+  1279us) service_pool.cc:224] Handling call
0709 13:03:13.143458 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.143770 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.143798 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.144266 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.265316 (+121050us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:13.265370 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.265437 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.781747 (+1516310us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b2400276248. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef8fe69c4 00007f2ef8fe4acb 00007f2ef919fdc9 00007f2ef919fa55 00007f2ef919f09d 00007f2efbdd110e 00007f2efbde888c 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221
0709 13:03:14.898963 (+117216us) raft_consensus.cc:1685] finished
0709 13:03:14.898984 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.899178 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2459,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":15907584,"thread_start_us":120664,"threads_started":1,"wal-append.queue_time_us":276647}
I20260709 13:03:14.914927  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:14.919548  8288 raft_consensus.cc:1240] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:14.917933  8211 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:14.909795 12640 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.908506 12661 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.912539 12646 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:14.907182 12854 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:03:14.923537 12646 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:14.924120 12646 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.923604 12842 raft_consensus.cc:3055] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:14.924813 12842 raft_consensus.cc:740] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:14.912268 12763 consensus_queue.cc:1048] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:14.933350 12861 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:14.920423 12758 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.908631 12228 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:14.935109 12228 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:14.935496 12228 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.924175  8183 leader_election.cc:304] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.937638  8258 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:14.933693 12646 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:14.942054 12673 raft_consensus.cc:3060] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.942363 12720 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:14.942950 12720 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.947721 12869 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:14.942625 12801 raft_consensus.cc:2749] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:14.950977 12823 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.953657  8359 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:14.949784 12720 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:14.950611 12889 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.954805 12823 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:14.955775  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.957858  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.916373 12746 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:14.958527  8359 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
I20260709 13:03:14.959602 12730 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:14.959782  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:14.961169 12702 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:14.961445 12759 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:14.964023  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.965612  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.965739 12861 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:14.966285  8361 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:14.969090  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.969762  8218 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:14.973779  8365 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:14.971576  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.976797  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.970613  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.977391  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.988682  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.978515  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:14.989290  8366 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 10.
I20260709 13:03:14.989544  8362 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:14.970228  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.977778 12842 consensus_queue.cc:260] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.981148  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.956329  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:14.982371 12425 consensus_queue.cc:1059] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:14.969810  8862 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:14.986370  8360 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:14.979487  8367 raft_consensus.cc:1240] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:15.027021  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 70791.3us
I20260709 13:03:14.999287 12864 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.000634  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:15.001945  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.991487  8366 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:15.006695  8362 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:15.009756  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:15.010088  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:14.981606 12824 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.010427  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:14.993330 12885 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.013432  8290 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:15.014410  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.014834  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.035406  8285 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:15.035516  8214 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:15.036227  8358 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:15.016331  8361 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:15.033185  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:15.037268  8361 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:15.017884 12038 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:14.996047 12828 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:14.979550  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.019794  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.022526 12228 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.015662 12720 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:15.033223 12673 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.955947 12614 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.031989 12759 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:15.085492  8364 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 12: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:14.992831  8363 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:03:15.027134  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 57487.5us
I20260709 13:03:15.028052  8183 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:15.086997  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 59028us
I20260709 13:03:15.087330  8863 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:15.028861  8359 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:15.032051  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:15.049708  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:15.088840  8362 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.030454 12656 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:15.089643  8896 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:15.090612  8898 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:15.046203 12842 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.077412  8365 raft_consensus.cc:1275] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:15.078323  8360 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:15.024224  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 86702.4us
I20260709 13:03:15.095221  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:15.030812 12889 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:15.040330  8184 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:15.096390  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:15.075938  8291 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
I20260709 13:03:15.097837  8214 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:15.014178  8331 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:15.101147  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 60937.1us
W20260709 13:03:15.084460  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 171802us
I20260709 13:03:15.104365  8184 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:15.036262 12885 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.106267 12228 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.093163 12857 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.108289  8890 raft_consensus.cc:1240] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:15.111795  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.112532  8293 raft_consensus.cc:1240] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:15.046689 12758 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:15.113710 12900 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:15.114672 12038 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.093515 12724 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:03:15.116688  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 103566us
I20260709 13:03:15.091843 12731 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.092145 12656 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.113129  8332 leader_election.cc:304] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.093951 12823 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.114621 12900 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:15.093315 12694 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:15.127100 12694 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:15.117762  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.129503  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.092375 12759 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.126415 12829 raft_consensus.cc:2749] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:15.120741 12228 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:15.139191 12228 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:15.139575 12228 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.084959 12720 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.119987  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:15.143893  8895 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:15.146598  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:15.158715  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:15.159629  8212 raft_consensus.cc:2393] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:15.122879 12840 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.123622 12758 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.119174 12743 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.121327 12869 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:03:15.163574  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:15.131013 12656 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.131349 12900 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:15.138748 12759 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.119448  8331 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.132620  8896 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 14.
I20260709 13:03:15.119556 12640 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:03:15.137498 12646 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:15.191615  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 72266.8us
W20260709 13:03:15.195415  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 61447.4us
I20260709 13:03:15.130630 12731 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.141007 12857 consensus_queue.cc:1048] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:03:15.200748  8331 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:15.179523 12440 raft_consensus.cc:2749] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.166334 12762 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:03:15.186975 12673 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:15.144408 12911 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:03:15.204543  8331 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:15.167969 12887 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:15.206614  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:15.169661 12846 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:03:15.197924 12829 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.215727 12746 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.219069  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:15.225091 12656 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.205402 12840 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.226114  8116 catalog_manager.cc:5697] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 8, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 8 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.228303 12656 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.229660 12731 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.230206 12746 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:15.230759  8898 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:15.231354  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:15.234387  8293 raft_consensus.cc:2393] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 12: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:15.237691  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.226590 12824 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.240918 12824 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.241626 12824 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:15.242990  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:15.241828 12694 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.209347 12228 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.250054  8212 raft_consensus.cc:1240] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:15.256417  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
W20260709 13:03:15.256834  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 148238us
I20260709 13:03:15.258149  8215 raft_consensus.cc:2393] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:15.238319 12861 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.262521 12228 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.213332 12763 consensus_queue.cc:1059] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:03:15.265861  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.249301 12746 consensus_queue.cc:1048] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:03:15.269716  8891 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:15.282121  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.258497 12440 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:15.259764 12758 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:15.285367  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0356bb50f97540f48a0cb08e1407eb57" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:15.298880 12919 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:15.299486 12919 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.301990 12919 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:15.302611 12916 log.cc:927] Time spent T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:15.304736  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:15.264786 12614 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.305657  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.311013  8292 raft_consensus.cc:2393] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:15.237596 12900 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.313516  8362 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:15.309453  8891 raft_consensus.cc:2468] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:15.309829  8215 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
W20260709 13:03:15.309953  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 98904us
I20260709 13:03:15.315013  8215 pending_rounds.cc:85] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 10
I20260709 13:03:15.315392  8215 pending_rounds.cc:107] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:03:15.315640  8215 raft_consensus.cc:2889] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:15.315482  8331 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.266495 12743 consensus_queue.cc:1059] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:03:15.282828 12720 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.320043  8331 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.322700 12829 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.328702  8895 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:15.333622  8215 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:03:15.317030 12917 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:15.316525 12694 raft_consensus.cc:493] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:03:15.322943 12915 log.cc:927] Time spent T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:03:15.344579  8331 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.347244  8331 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.348537 12838 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:15.353183 12920 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:03:15.355085 12914 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:03:15.329631 12743 consensus_queue.cc:1243] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer ca43983edda443fa9d74c1f80252f1fc log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:15.342296 12846 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.358595 12694 raft_consensus.cc:515] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:15.359197 12909 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
I20260709 13:03:15.360948 12694 leader_election.cc:290] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.361620  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:15.367609 12823 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:15.368113 12823 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:15.368932 12823 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.331753 12900 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.326809 12614 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:03:15.309562 12440 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.385262 12440 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.386695  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.387394  8286 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:15.387549 12494 raft_consensus.cc:3055] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:15.388082 12494 raft_consensus.cc:740] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:15.388736  8863 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:15.388983 12494 consensus_queue.cc:260] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.389595 12440 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:15.393402 12759 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.403925  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
W20260709 13:03:15.396744  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 307144us
I20260709 13:03:15.400507  8258 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:15.424043  8258 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:15.399832 12885 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.406059  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.402526 12846 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:15.367774  8292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:45764
I20260709 13:03:15.481431  8292 raft_consensus.cc:606] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:15.413127  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 65973.8us
I20260709 13:03:15.482672  8331 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:15.414422  8286 raft_consensus.cc:1240] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:03:15.426561  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:15.422806  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:15.390007 12440 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
W20260709 13:03:15.487222  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 64513.1us
I20260709 13:03:15.508038 12425 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:15.508569 12425 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.508922 12425 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.509688  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:15.510811  8891 raft_consensus.cc:1275] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:15.347589 12861 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.164s
W20260709 13:03:15.513603  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 73838.1us
I20260709 13:03:15.515226 12818 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:15.515985  8183 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:15.520617 12759 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:15.486820 12885 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.515784 12818 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.523310 12885 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.524572  8894 raft_consensus.cc:2368] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13.
W20260709 13:03:15.524133  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 118203us
I20260709 13:03:15.489010  8895 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:15.426458 12922 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.534336  8891 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:15.528452  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:15.530720  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:15.539666  8216 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.544235  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:15.545228  8289 raft_consensus.cc:2410] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:15.545652  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:15.532780  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:15.547628  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:15.547794  8292 raft_consensus.cc:3060] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.548838  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:15.549144  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:15.549240  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:15.550796  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.527982 12846 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.529175 12440 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:15.488440 12722 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:15.555327  8259 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:15.565099  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:15.485000 12828 raft_consensus.cc:2804] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:15.560611  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:15.562515  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:15.536041 12838 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.524880 12818 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.573321  8287 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.575959  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:15.555902 12748 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.572762 12038 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.551530 12425 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.582795 12425 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.584969 12673 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:15.585479 12673 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.585767 12869 raft_consensus.cc:3055] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:15.579955  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.563820 12646 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.551348 12656 consensus_queue.cc:1059] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:03:15.590658  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.586206 12869 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:15.593050  8288 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:15.574682 12864 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:15.556458 12923 consensus_queue.cc:1059] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:03:15.590904  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.605325  8216 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:15.609023  8289 raft_consensus.cc:1275] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:15.620338  8287 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:15.586483 12614 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:03:15.607113 12864 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.612257 12885 raft_consensus.cc:493] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:15.644321  8893 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:15.592499 12038 consensus_queue.cc:1048] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:15.632197 12762 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:03:15.650907  8218 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:15.651075  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:15.592523 12646 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.651301  8213 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:15.655769 12646 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.656975 12656 consensus_queue.cc:1059] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:15.657553 12646 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:15.658360  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:15.659178  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:15.659759  8213 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:15.660686  8331 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:15.661769 12646 raft_consensus.cc:2749] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.663009  8331 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:15.663916 12646 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:15.664321 12646 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.664664 12646 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.666931 12731 raft_consensus.cc:3055] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:15.667413 12731 raft_consensus.cc:740] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:15.596254 12818 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:03:15.668324 12731 consensus_queue.cc:260] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.669785 12731 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.671262 12885 raft_consensus.cc:515] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.675170  8292 raft_consensus.cc:2468] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:15.646126 12800 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:03:15.679235 12839 raft_consensus.cc:3055] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:15.679877 12646 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.682543  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:15.631146 12864 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.683753 12869 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.629746 12838 raft_consensus.cc:3055] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:15.691731  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.696305 12494 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.697974  8361 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.708703  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:15.765197  8361 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.709456  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:15.709631  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:15.712816  8362 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:15.720019  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:15.761695  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:15.633958  8183 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:15.744940  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 44394.9us
I20260709 13:03:15.747910  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:15.767417  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 199287us
I20260709 13:03:15.758333  8863 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:15.748814 12840 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.755529  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:15.765915  8359 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:15.744809 12917 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:15.748931 12839 raft_consensus.cc:740] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:15.775861 12038 consensus_queue.cc:1059] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:15.765708 12743 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.781975 12922 consensus_queue.cc:1048] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:15.776361  8259 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:15.755300 12923 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.761134 12838 raft_consensus.cc:740] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:03:15.779704  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 145872us
I20260709 13:03:15.784574 12918 raft_consensus.cc:2804] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:15.787081 12918 raft_consensus.cc:697] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:15.789872  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:15.746389 12440 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.778182 12425 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:15.765053 12656 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:15.785138 12787 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:15.771154 12840 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.818252 12840 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.822912 12646 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.807308 12829 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.837803  8209 raft_consensus.cc:1240] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:03:15.846242 12758 raft_consensus.cc:3055] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:15.815624 12918 consensus_queue.cc:237] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.784910 12743 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.849076 12743 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.790882 12923 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.850191  8358 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:15.851125 12885 leader_election.cc:290] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.840322 12440 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.840754 12673 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.851200 12923 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:15.800195 12038 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:03:15.842279  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
W20260709 13:03:15.871580  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 95316.5us
I20260709 13:03:15.784843 12917 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.845489 12857 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.846629 12758 raft_consensus.cc:740] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:15.815461 12838 consensus_queue.cc:260] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.857252  8361 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:03:15.813853 12425 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:15.795061 12842 consensus_queue.cc:1059] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:03:15.853407  8363 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:15.878201  8361 pending_rounds.cc:85] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 10
I20260709 13:03:15.879307  8361 pending_rounds.cc:107] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:03:15.879936  8361 raft_consensus.cc:2889] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:15.878299  8259 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:15.881920  8259 leader_election.cc:304] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:15.883208  8259 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:15.890453  8897 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:15.893734  8291 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:15.894500  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:15.894974  8863 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:15.875809 12656 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.877048 12673 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:15.875856 12440 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:03:15.905409  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.900419 12038 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:15.911121 12038 raft_consensus.cc:2749] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.896476 12763 raft_consensus.cc:3055] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:15.914386 12038 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:15.893607 12640 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:03:15.893399 12838 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.917759 12038 raft_consensus.cc:993] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: : Instructing follower ee13752324154b1293a47c9dcd8d6ba5 to start an election
I20260709 13:03:15.902506 12919 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:15.877897 12857 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.937331 12038 raft_consensus.cc:1081] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Signalling peer ee13752324154b1293a47c9dcd8d6ba5 to start an election
W20260709 13:03:15.941958  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 362534us
I20260709 13:03:15.913174 12763 raft_consensus.cc:740] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:15.918869 12656 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.977922  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:15.981907 12857 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:15.912635 12440 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:15.984090  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:15.966800 12919 raft_consensus.cc:697] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:15.940505 12722 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:15.993209  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457d66c5ca7c4163a642765639bc4f3d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:15.985590 12038 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:15.995255  8258 leader_election.cc:400] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13.
I20260709 13:03:15.997920  8258 leader_election.cc:403] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:15.896936 12425 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:15.896836 12758 consensus_queue.cc:260] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.003949  8863 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.019091  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:16.019958  8209 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
W20260709 13:03:16.075863 12928 log.cc:927] Time spent T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:16.077682 12864 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.080047 12864 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.039495  8862 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:16.081511 12746 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:16.081945 12746 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:16.082324 12746 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.096031 12746 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.016702 12759 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:16.105199  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 337269us
W20260709 13:03:16.106987  8330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.114219  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:16.114413  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:16.115054  8358 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.082240 12857 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:16.026283 12758 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.128450 12917 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.132128 12887 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:16.132879 12887 consensus_queue.cc:1243] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:03:16.133343  8181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.134464  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:16.140679 12857 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.144942 12854 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:16.145572 12854 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:16.134405  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:16.147475  8361 raft_consensus.cc:2393] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:16.151571  8366 pending_rounds.cc:85] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Aborting all ops after (but not including) 9
I20260709 13:03:16.152276  8366 pending_rounds.cc:107] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:03:16.152557  8366 raft_consensus.cc:2889] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.160815 12857 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:16.172691  8213 raft_consensus.cc:1240] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:16.173799  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:16.174383  8214 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:16.175616  8862 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:16.176469 12911 consensus_queue.cc:1059] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:16.178007 12911 raft_consensus.cc:3055] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:16.178401 12911 raft_consensus.cc:740] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:03:16.158880 12828 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.019s	sys 0.016s
I20260709 13:03:16.179234 12911 consensus_queue.cc:260] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:16.179845 12828 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.019s	sys 0.016s
W20260709 13:03:16.178196  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 67282.4us
I20260709 13:03:16.180166 12828 raft_consensus.cc:697] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:16.181295 12828 consensus_queue.cc:237] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:16.182994 12931 log.cc:927] Time spent T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:03:16.180428 12911 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.186443 12759 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:16.185171  8214 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.187007 12759 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:16.187911 12759 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.112479 12853 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13.
I20260709 13:03:16.192600  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.194315  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:16.194715  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.195024  8209 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:16.196866  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.132944 12746 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:16.199383  8286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.016s	sys 0.041s
I20260709 13:03:16.200423  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.201049  8892 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 8.
W20260709 13:03:16.200390  8286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.017s	sys 0.041s
I20260709 13:03:16.200039  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:16.127701 12919 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.111284 12722 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:16.224538  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 330167us
I20260709 13:03:16.209630 12846 consensus_queue.cc:1059] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:03:16.232439  8358 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 15.
I20260709 13:03:16.233196  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:16.233623  8358 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.238523  8360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144"
dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:42814
I20260709 13:03:16.239202  8360 raft_consensus.cc:493] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:16.239521  8360 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.200696 12854 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.225930 12870 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:16.242918 12870 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.244920 12870 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.259330  8358 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:16.261451  8358 raft_consensus.cc:1240] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:16.264441  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.272816  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 473151us
I20260709 13:03:16.274618  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:16.276028  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.274739  8360 raft_consensus.cc:515] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.287671  8358 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:16.289438  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:16.290522  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:16.292271  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.292951  8285 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:16.293874  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.296306  8360 leader_election.cc:290] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:16.342056  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.342186  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.342237  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:16.342213  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:16.278687 12887 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:03:16.343883  8291 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:16.345464  8293 raft_consensus.cc:1240] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:16.351279  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:16.352433  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe3e60c735644e380589d65b7850fd2" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.359386  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:16.339381 12853 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.295737 12840 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:16.341527 12706 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:16.366631 12838 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:16.366315  8896 raft_consensus.cc:1240] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:16.345669 12939 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.346432 12911 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.354655 12943 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.385907  8285 raft_consensus.cc:3055] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:16.377105 12706 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:16.386350  8285 raft_consensus.cc:740] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:16.386605 12706 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.377331 12838 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:16.384227  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.384714  8360 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:03:16.387259 12838 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.366206 12840 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.375078  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.395815  8209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:03:16.402911  8209 raft_consensus.cc:606] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
W20260709 13:03:16.396970 12942 log.cc:927] Time spent T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:16.377341 12823 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.390843  8285 consensus_queue.cc:260] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.409029  8285 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.401505 12840 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.372561 12853 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:16.420276  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 45403us
I20260709 13:03:16.419274 12801 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.425199  8183 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:16.425846 12887 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.428427  8367 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.428125 12839 consensus_queue.cc:260] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.388339 12939 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.429358 12839 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.430781 12939 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.432555 12853 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.421182 12673 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:16.436367  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:16.437476 12900 raft_consensus.cc:3055] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:16.437911 12900 raft_consensus.cc:740] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:16.438789 12900 consensus_queue.cc:260] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.439780 12900 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:16.440933 12938 log.cc:927] Time spent T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.303s	user 0.002s	sys 0.000s
I20260709 13:03:16.442615  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:16.445648 12947 log.cc:927] Time spent T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.222s	user 0.003s	sys 0.000s
I20260709 13:03:16.460992 12706 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.461205  8116 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:16.462700  8116 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:16.463830 12706 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.454165 12838 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.464227  8116 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 8, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 8 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:16.465993 12762 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:16.467538 12854 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.466459 12838 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.473027 12840 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.475401 12763 consensus_queue.cc:260] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.476785 12763 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.446796 12801 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:16.481657 12957 log.cc:927] Time spent T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:16.483549  8259 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:16.486217  8209 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.487224  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768b3b358c7c4b1fbbf348a322e1e144" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:16.487799  8214 raft_consensus.cc:3060] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.490597  8215 raft_consensus.cc:1240] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.494379 12870 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.466411 12762 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:16.494894 12870 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.495718 12762 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.496677 12762 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.496963 12870 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.498231 12919 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.498700 12919 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.500671 12919 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:16.503211  8285 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:16.506853 12869 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.509382 12801 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.512935  8332 leader_election.cc:304] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:16.513211  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:16.513767  8285 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.515779  8367 raft_consensus.cc:2393] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:16.515944  8210 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:03:16.516217  8864 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:16.519448  8214 raft_consensus.cc:2468] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:16.519977  8215 raft_consensus.cc:1240] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:16.523095  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 73761.6us
I20260709 13:03:16.521595 12838 raft_consensus.cc:2804] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:16.526590 12838 raft_consensus.cc:697] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:16.525209  8116 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 10, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 10 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.527664 12838 consensus_queue.cc:237] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.528040  8116 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 7 to 9, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 9 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:16.525110 12425 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:16.529409 12425 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.526595 12923 consensus_queue.cc:1059] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:16.530824 12923 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:16.531175 12923 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:16.531445 12425 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.532003 12923 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:16.534237 12952 log.cc:927] Time spent T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:03:16.534952  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:16.535368  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:16.534870 12923 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.537580 12673 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.537734  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.529373  8116 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 8, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 8 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:16.542423 12694 consensus_queue.cc:1059] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:16.543264 12694 raft_consensus.cc:3055] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:16.543613 12694 raft_consensus.cc:740] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:16.544416 12694 consensus_queue.cc:260] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.545311 12694 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.538874  8183 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:16.548837  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.553372  8285 raft_consensus.cc:2468] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:16.555200  8332 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:16.521364 12620 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:16.564954  8183 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:16.567193  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:16.567950 12885 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.568819 12887 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:16.564052 12673 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:16.574287 12801 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.563788 12917 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:16.574803 12801 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.576665  8893 raft_consensus.cc:1240] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.576915 12801 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.574836 12917 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:16.578819 12917 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.581657 12440 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:16.560360 12922 raft_consensus.cc:2804] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:16.586843 12922 raft_consensus.cc:697] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:16.588307  8214 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:16.588879  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2648) took 1050 ms. Trace:
I20260709 13:03:16.591378  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:16.592283  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.592885  8894 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:16.593302  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.595948  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:16.590451  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:16.596688 12864 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.597139  8213 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:16.596716  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:16.602030  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a07d8346e4fd5a54166e1cb3b1660" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.602643  8183 leader_election.cc:304] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:16.606113  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.589248  8290 rpcz_store.cc:276] 0709 13:03:15.538781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.538934 (+   153us) service_pool.cc:224] Handling call
0709 13:03:15.556515 (+ 17581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.556717 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:15.571220 (+ 14503us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.546509 (+975289us) spinlock_profiling.cc:243] Waited 942 us on lock 0x7b18001d0200. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef9142e07 00007f2f01f9dab9 00007f2ef915f69b 00007f2ef915d93f 00007f2ef915fc02 00007f2efbde720b 00007f2efbdecd23 00007f2efbded23a 00007f2efc257a2a
0709 13:03:16.588416 (+ 41907us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.588580 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.588623 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:16.588664 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.588733 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.588829 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14345,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":7904,"spinlock_wait_cycles":2165632,"thread_start_us":41501,"threads_started":1,"wal-append.queue_time_us":991466}
I20260709 13:03:16.602033  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.608449  8285 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:16.607611  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:16.605535 12746 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:03:16.601588 12620 raft_consensus.cc:697] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
W20260709 13:03:16.612073  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 46578.9us
I20260709 13:03:16.601289 12857 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:16.615899 12857 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.617478  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:16.618816  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.620466  8213 raft_consensus.cc:1240] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.624720 12818 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.625335 12818 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.625705  8288 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:16.561611 12918 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.628918  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.630681  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.634061  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:16.632879  8894 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 8.
I20260709 13:03:16.587962 12673 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.612145 12620 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.644466  8862 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:16.645654 12870 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:16.646106 12870 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.646466 12870 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.648252  8891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1443) took 1115 ms. Trace:
I20260709 13:03:16.652968  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:16.658159  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:16.646226 12887 raft_consensus.cc:2749] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.649991 12673 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.670408 12840 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.639385 12917 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.686159  8897 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.687079 12917 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.698856  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:16.698616  8116 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.699577  8367 raft_consensus.cc:2368] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13.
I20260709 13:03:16.700646  8258 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:16.701057 12640 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.701767  8258 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:16.701545 12640 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.703049 12662 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:16.703437 12662 raft_consensus.cc:493] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.703778 12662 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.704914  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:16.705653  8359 raft_consensus.cc:2368] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13.
I20260709 13:03:16.700129  8116 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 10, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 10 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.707899  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:16.708410  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:16.708221  8116 catalog_manager.cc:5697] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 2 to 9, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 9 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.703866 12640 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.710311  8116 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 8, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 8 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.707916  8184 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.708719 12818 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.617985 12857 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:16.587641 12922 consensus_queue.cc:237] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:16.709071 12969 log.cc:927] Time spent T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:16.722568  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:16.648663  8891 rpcz_store.cc:276] 0709 13:03:15.532611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.535146 (+  2535us) service_pool.cc:224] Handling call
0709 13:03:15.535449 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:15.535832 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:15.965780 (+429948us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.287092 (+321312us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.287281 (+   189us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:16.444067 (+156786us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b18003c25c0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:03:16.446763 (+  2696us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18003c25c0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2f02028de1 00007f2f020355b1 00007f2ef91603f3 00007f2ef91627c1 00007f2ef9162779 00007f2ef9162709 00007f2ef91626d1 00007f2ef91619cd 000000000038f354 000000000038f199 00007f2ef914383a
0709 13:03:16.522155 (+ 75392us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b4400022b4c. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9086c85 00007f2ef90876a2 00007f2efbdf91db 00007f2efbdf4aaf 00007f2efbde886e 00007f2efbde7bb6 00007f2efbde77d8 00007f2efbdf1221 00007f2efbdf11d9 00007f2efbdf1169
0709 13:03:16.636797 (+114642us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b2c00047ae8. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efab46a11 00007f2efab56372 00007f2efc288a01 00007f2efc24d43a 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2
0709 13:03:16.640415 (+  3618us) log.cc:844] Serialized 52 byte log entry
0709 13:03:16.640605 (+   190us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:16.640832 (+   227us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.647916 (+  7084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.648005 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.648048 (+    43us) raft_consensus.cc:1685] finished
0709 13:03:16.648062 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.648198 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81770,"prepare.queue_time_us":603826,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":101,"raft.queue_time_us":331,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":12202,"spinlock_wait_cycles":29179776,"thread_start_us":711154,"threads_started":2,"wal-append.queue_time_us":402037}
I20260709 13:03:16.724372  8896 raft_consensus.cc:3060] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.721686  8897 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
W20260709 13:03:16.734242  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 97997.7us
I20260709 13:03:16.711856  8116 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 10, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 10 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:16.736411  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:16.737071  8362 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:16.723996  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:16.738668  8212 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:16.741233  8891 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:16.742372  8862 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.744765  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.744946  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:16.745131  8210 raft_consensus.cc:1275] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:16.745661  8362 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:16.747582  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:16.749768  8259 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:16.749683  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:16.717521 12662 raft_consensus.cc:515] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.753193  8896 raft_consensus.cc:2468] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:16.761459  8211 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:16.749790 12038 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:03:16.752516  8362 raft_consensus.cc:2368] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11.
I20260709 13:03:16.743709 12842 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.751518 12494 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:16.751492 12759 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.740592 12962 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.791015  8116 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 9 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 12 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:16.798189  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:16.758307 12857 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:16.791118  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:16.795540  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:16.800295  8288 raft_consensus.cc:2393] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:16.798908  8365 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:16.766958  8216 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:16.761114 12917 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.763489 12818 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:16.804714  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:16.806361  8864 leader_election.cc:400] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13.
I20260709 13:03:16.764158 12939 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:16.801880  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.816160  8290 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
W20260709 13:03:16.814718  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 65825.5us
I20260709 13:03:16.816536  8864 leader_election.cc:400] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13.
I20260709 13:03:16.805402  8365 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:16.814890 12818 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.819835 12818 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.765336 12869 consensus_queue.cc:1048] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:03:16.828778  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:16.832459  8359 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 15.
I20260709 13:03:16.810238 12857 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:16.803277 12494 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 15 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:16.839551 12494 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.840184 12662 leader_election.cc:290] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:16.843554  8332 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:16.844748 12759 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:16.844450 12944 raft_consensus.cc:2804] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:16.845548 12746 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:16.845712 12944 raft_consensus.cc:697] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:03:16.846474 12967 log.cc:927] Time spent T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:03:16.846851 12944 consensus_queue.cc:237] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.847522 12870 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.849568 12870 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.784920 12842 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.849890  8864 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:16.850512 12973 log.cc:927] Time spent T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:03:16.851138  8864 leader_election.cc:400] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11.
I20260709 13:03:16.851426  8864 leader_election.cc:403] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:03:16.853829 12440 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.854230 12918 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 10. Current term is 11.
I20260709 13:03:16.838639 12857 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.844501 12673 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.858603  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:16.860474  8893 raft_consensus.cc:2393] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 10: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:16.845274 12759 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:16.858990  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:16.864324  8259 leader_election.cc:304] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:16.865073 12038 raft_consensus.cc:2749] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:16.866634  8359 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:16.868160 12759 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.868000 12614 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:16.875109  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:16.877674  8890 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:16.879016  8288 raft_consensus.cc:1275] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:16.880441  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:16.880978  8288 raft_consensus.cc:2393] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:16.857194 12823 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:16.827550 12939 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:16.898906  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 2550) took 1258 ms. Trace:
I20260709 13:03:16.899116 12614 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:16.891010 12440 consensus_queue.cc:1048] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:03:16.903556  8212 rpcz_store.cc:276] 0709 13:03:15.640855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.645424 (+  4569us) service_pool.cc:224] Handling call
0709 13:03:16.898745 (+1253321us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400128754. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:16.898846 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166325632}
I20260709 13:03:16.882475 12911 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:16.904546 12911 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.904910 12911 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.888001 12823 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.912938  8183 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.914678  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:16.919622  8212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fe31b6ada204d4fab7c4cbe1912fff6"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:03:16.920315  8212 raft_consensus.cc:606] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:16.920678  8212 raft_consensus.cc:614] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:16.914832 12823 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.913839 12885 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.916963 12706 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.935864 12939 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.959303 12842 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.977025 12673 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:16.982203  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:17.041390  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:17.041651  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.042119  8362 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:17.042548  8361 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:17.042047  8363 raft_consensus.cc:3060] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:17.043942  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 50830.9us
I20260709 13:03:17.044550  8116 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.047134  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:17.046141  8116 catalog_manager.cc:5697] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 7, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 7 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.048179  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.048882  8212 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.049068  8331 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:17.052227  8367 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:17.042415 12640 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:17.054205  8363 raft_consensus.cc:2468] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:17.056447 12763 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:17.057008 12763 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:17.057868 12763 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.047039  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:17.076269  8292 raft_consensus.cc:1240] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:17.070330  8113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35666 (request call id 374) took 36173 ms (client timeout 15000 ms). Trace:
I20260709 13:03:17.068908  8116 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 9, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 9 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.067821  8184 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.051048 12917 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:03:17.079347 12640 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.065133 12911 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.080287 12662 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:17.080801 12662 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.062254 12724 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:17.081480 12911 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:17.046337 12440 raft_consensus.cc:493] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:17.082211 12724 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:17.068280 12857 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.083004 12440 raft_consensus.cc:515] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.081511 12640 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:17.064306 12823 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.086114 12857 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:17.082628 12724 raft_consensus.cc:3060] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.087422 12823 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:17.090989 12440 leader_election.cc:290] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.092998 12917 consensus_queue.cc:1243] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer ee13752324154b1293a47c9dcd8d6ba5 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:17.093372 12857 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.093557 12917 consensus_queue.cc:1059] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:17.093911 12857 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.062013 12818 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.096174 12818 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.097018  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.070726 12839 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:17.097582  8288 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.097718 12839 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.099797 12839 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:17.102193 12981 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:17.102406  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.102684 12981 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.103067 12981 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.103098  8285 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:17.106401  8211 raft_consensus.cc:2393] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 12: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.108615 12870 raft_consensus.cc:3055] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:17.108989 12870 raft_consensus.cc:740] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:17.096230 12857 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.083581 12494 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:17.109812 12870 consensus_queue.cc:260] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.110605 12494 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.111066 12494 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.082899 12662 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.111145  8292 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:17.111377 12870 raft_consensus.cc:3060] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.109989  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.117386 12640 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.117770 12640 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:17.118235 12640 raft_consensus.cc:3060] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.117872 12923 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:17.106446  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 59507.7us
I20260709 13:03:17.124629  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.125277  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.047333 12978 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:17.127710  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:17.127434  8116 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:17.128567  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.129527  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.129845  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:17.132725  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:17.130332  8293 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 15.
I20260709 13:03:17.137882  8288 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
W20260709 13:03:17.078254  8113 rpcz_store.cc:269] 0709 13:02:40.875798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.875979 (+   181us) service_pool.cc:224] Handling call
0709 13:03:17.035948 (+36159969us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:09.771723 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:09.772462 (+   739us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:09.772518 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:03:09.772547 (+    29us) tablet.cc:662] Decoding operations
0709 13:03:09.773748 (+  1201us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:09.773838 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:09.773910 (+    72us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:03:09.874518 (+100608us) tablet.cc:701] Row locks acquired
0709 13:03:09.888089 (+ 13571us) write_op.cc:260] PREPARE: finished
0709 13:03:09.906925 (+ 18836us) write_op.cc:270] Start()
0709 13:03:09.907081 (+   156us) write_op.cc:276] Timestamp: P: 1783602189906848 usec, L: 0
0709 13:03:09.907137 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 13:03:09.908245 (+  1108us) log.cc:844] Serialized 3986 byte log entry
0709 13:03:10.701581 (+793336us) op_driver.cc:464] REPLICATION: finished
0709 13:03:11.033301 (+331720us) write_op.cc:301] APPLY: starting
0709 13:03:11.113509 (+ 80208us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:11.717407 (+603898us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:11.748420 (+ 31013us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:11.837318 (+ 88898us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b5400332cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24a32a 00007f2efc1cff14 00007f2efc1cfec3 00007f2efc1cfe38 00007f2efc1cfdf3 00007f2efc1cf0dc 00007f2efc1f8e16 00007f2efc1e0cbb 00007f2efc1cb39d 00007f2efc1ced75
0709 13:03:12.598021 (+760703us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b480067a970. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efbdfbb91 00007f2efbe11f3a 00007f2effdbd95f 00007f2effe06b37 00007f2effceb775 00007f2effb978da 00007f2effb9a3cb 00007f2effb99fd3 00007f2effc98e34 00007f2effc8497c 00007f2effc88d61
0709 13:03:12.603730 (+  5709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:12.674592 (+ 70862us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:03:12.674663 (+    71us) write_op.cc:312] APPLY: finished
0709 13:03:12.675125 (+   462us) log.cc:844] Serialized 97 byte log entry
0709 13:03:12.934518 (+259393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.934656 (+   138us) write_op.cc:454] Released schema lock
0709 13:03:12.934724 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:12.978746 (+ 44022us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.981313 (+  2567us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2216293,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":294575,"apply.run_cpu_time_us":54996,"apply.run_wall_time_us":1903683,"cfile_cache_hit":38,"cfile_cache_hit_bytes":39805,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6222,"cfile_init":2,"lbm_read_time_us":90536,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":10,"prepare.queue_time_us":1308004,"prepare.run_cpu_time_us":23501,"prepare.run_wall_time_us":401480,"raft.queue_time_us":146108,"raft.run_cpu_time_us":28074,"raft.run_wall_time_us":1170415,"replication_time_us":770839,"spinlock_wait_cycles":22875264,"thread_start_us":1417395,"threads_started":5,"wal-append.queue_time_us":614141,"wal-append.run_cpu_time_us":35412,"wal-append.run_wall_time_us":2438387}]]}
I20260709 13:03:17.129115  8864 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.146278  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.147490  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:17.147734  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:17.148154  8362 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.148499  8358 raft_consensus.cc:2393] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 12: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:17.150758  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73508a52a1594a38badce805866b753e" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.139052  8332 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.158205  8366 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:17.159170  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:17.157344  8863 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:17.163399  8215 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 9: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.160933  8864 leader_election.cc:304] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:17.171272  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.172034  8212 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:17.176285  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.176959  8367 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 15.
W20260709 13:03:17.183117  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 267086us
I20260709 13:03:17.127337 12656 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:17.184482  8362 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:17.190277  8184 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.173069 12838 raft_consensus.cc:2804] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:17.193929  8288 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:17.195412  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.196014  8293 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.196775  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.174966 12917 raft_consensus.cc:2804] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:17.175132 12440 raft_consensus.cc:2749] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.127002 12978 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.160037 12857 consensus_queue.cc:1059] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:03:17.181576 12759 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:17.112635 12724 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:17.204485  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 155534us
I20260709 13:03:17.213140  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.213789  8359 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:17.214340  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.202603 12981 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.218025  8896 raft_consensus.cc:2368] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:17.219084  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:17.220418 12976 raft_consensus.cc:993] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:03:17.221627  8363 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.181444 12887 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:17.228189  8897 raft_consensus.cc:3060] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.233902 12724 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.204008 12979 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:17.239447  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 54774.5us
I20260709 13:03:17.207386 12759 raft_consensus.cc:493] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.191939 12656 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.203896 12838 raft_consensus.cc:697] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:17.240713  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:17.252743  8363 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:17.263589  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:17.264390  8215 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.268040  8288 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:17.269658 12762 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:17.249042 12759 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.266820 12662 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:17.219340 12981 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:17.273101 12662 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.277513 12662 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:17.278641 12986 log.cc:927] Time spent T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:17.279276  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:17.273121 12440 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:17.234900 12706 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:03:17.285104 12706 consensus_queue.cc:1243] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer ecc8d80ac6df4f5b95c8befae4d08ed0 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:17.283540 12440 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.285449 12640 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.261847 12918 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.248392 12975 raft_consensus.cc:1081] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:03:17.288491 12673 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:17.290634  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:17.293982  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.314415  8218 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 15: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.314635  8285 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 13.
I20260709 13:03:17.295881  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.303692  8897 raft_consensus.cc:2468] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:17.295495  8257 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:17.307034  8209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:03:17.316425  8209 raft_consensus.cc:606] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:17.319419 12038 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.319818 12038 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:17.320437 12038 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.272292 12978 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.327307  8218 raft_consensus.cc:1275] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:17.337253  8367 raft_consensus.cc:2468] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:17.305776 12922 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.338442 12922 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.340411 12922 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:17.341585  8864 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.262248 12979 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:17.344193  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.344910  8209 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.345331 12038 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.346158  8293 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:17.349583  8257 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:17.351974  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:17.321053 12673 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:17.361723  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.362540  8363 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 15: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.363979 12038 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:17.362016  8215 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:17.365372  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:17.349273 12978 raft_consensus.cc:2804] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:17.352957 12939 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.319849 12918 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.374859  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:03:17.375654  8215 raft_consensus.cc:606] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:17.376528  8215 raft_consensus.cc:614] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:17.343815 12494 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.367362 12731 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.381206  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:17.379473  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.387558  8293 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.383466  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.388379  8288 raft_consensus.cc:2393] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:17.394248  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:03:17.393846  8293 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:17.395534  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.396324  8288 raft_consensus.cc:2368] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10.
I20260709 13:03:17.394915  8898 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.398867  8898 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.386963 12978 raft_consensus.cc:697] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:17.405194 12978 consensus_queue.cc:237] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.407716 13000 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:17.408289 13000 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:17.409094 13000 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.410833 12979 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.423010 12640 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:17.423728 12918 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:17.371681 12838 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.425905 12425 raft_consensus.cc:993] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:03:17.428462 12425 raft_consensus.cc:1081] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Signalling peer 4a50f39e2d8e4886a79849938f2272a6 to start an election
I20260709 13:03:17.430603  8863 leader_election.cc:400] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10.
I20260709 13:03:17.431051  8863 leader_election.cc:403] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:17.375253 12917 raft_consensus.cc:697] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:17.432664  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.433362  8215 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:17.434188  8290 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 9.
I20260709 13:03:17.432797  8898 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.434638  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:17.448032  8258 leader_election.cc:400] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929) with higher term. Message: Invalid argument: T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
W20260709 13:03:17.448444  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 66816.4us
I20260709 13:03:17.400076 12731 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:17.456226  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.456194  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:17.458092  8285 raft_consensus.cc:2393] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 10: Already voted for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in this term.
I20260709 13:03:17.456472  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.460417  8898 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.466214  8290 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:17.459009  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:17.472321  8218 raft_consensus.cc:3055] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:17.472606  8218 raft_consensus.cc:740] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:17.468561  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.473261 12923 consensus_queue.cc:1048] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:17.467985  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.474570  8293 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
W20260709 13:03:17.474717  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 122844us
I20260709 13:03:17.469302  8287 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:17.470791  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:17.476984  8897 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 9.
I20260709 13:03:17.463407  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:17.473325  8218 consensus_queue.cc:260] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.478376  8218 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.479040  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:17.479571  8365 raft_consensus.cc:3060] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.480208  8358 raft_consensus.cc:1240] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:03:17.445696 12981 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:17.476833  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.484750  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.485364  8358 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:17.486115  8367 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:17.486212 12640 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:17.486615 12640 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.486933 12640 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.488740 12917 consensus_queue.cc:237] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.490676  8889 raft_consensus.cc:1275] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:03:17.491073  8889 pending_rounds.cc:85] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 8
I20260709 13:03:17.491312  8889 pending_rounds.cc:107] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:03:17.491518  8889 raft_consensus.cc:2889] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:17.479450  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:17.466511  8183 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:17.503460  8289 raft_consensus.cc:2468] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:17.463491 12731 raft_consensus.cc:3060] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.512888  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:17.510510  8332 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.511611  8365 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 15.
I20260709 13:03:17.399879 12673 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.522856 12988 raft_consensus.cc:2804] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:17.523530 12988 raft_consensus.cc:697] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
W20260709 13:03:17.525770  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 59380.2us
I20260709 13:03:17.526803  8289 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.458992 13000 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859) with higher term. Message: Invalid argument: T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10.
I20260709 13:03:17.518893 12614 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.483286 12981 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.482952 12440 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.530678  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:43622
I20260709 13:03:17.539740  8898 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.540108  8898 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.512792 12870 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:17.477357 12759 raft_consensus.cc:515] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.547863  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:17.551039  8212 raft_consensus.cc:2393] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.511050 12923 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:03:17.534861 12425 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:17.536669 12981 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.560972  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.564540  8289 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.524432 12988 consensus_queue.cc:237] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.566779  8898 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.541920 12656 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.577189  8289 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:17.580025  8183 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:17.580842 12979 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:17.581470 12979 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:17.582317 12979 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.584076 12919 raft_consensus.cc:3055] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:17.584462 12919 raft_consensus.cc:740] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:17.585315 12919 consensus_queue.cc:260] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.587904  8218 raft_consensus.cc:2468] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 15.
I20260709 13:03:17.588901  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:17.591354  8212 raft_consensus.cc:2368] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:17.592669  8862 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
W20260709 13:03:17.595319  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 102261us
I20260709 13:03:17.596221  8864 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:17.561478 12425 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.563493 12870 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:03:17.600533  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 84785.5us
I20260709 13:03:17.584535 12494 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.603457  8259 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:17.616379  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.618846  8257 leader_election.cc:400] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:17.621941  8257 leader_election.cc:403] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:17.604807 12425 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.604103 12999 raft_consensus.cc:2804] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:17.610466 12919 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.609536 12746 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:17.621073 12818 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:17.658684 12999 raft_consensus.cc:697] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:17.659559 13020 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.694437  8897 raft_consensus.cc:1240] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:17.658391 12746 raft_consensus.cc:493] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:03:17.678506 13012 log.cc:927] Time spent T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:03:17.679239 13005 log.cc:927] Time spent T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:03:17.679965 13007 log.cc:927] Time spent T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:17.682152 12870 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.690388 12614 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 13. Current term is 14.
I20260709 13:03:17.691185 13018 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:17.704741  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 86031us
I20260709 13:03:17.710716  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:03:17.781661  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 66433us
I20260709 13:03:17.785272  8365 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.692433 12759 leader_election.cc:290] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.689775 12640 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.696967 12746 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.798312  8365 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 16.
I20260709 13:03:17.795384 12038 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
W20260709 13:03:17.804045  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.806049 12038 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.812976  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c00c17016841839312c823fcffaf82" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.813758  8285 raft_consensus.cc:3060] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.714414 13020 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:17.838995 13021 log.cc:927] Time spent T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:03:17.840340 13020 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:17.842763  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.843418  8289 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 14.
I20260709 13:03:17.844218 12038 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.847316  8285 raft_consensus.cc:2468] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 16.
I20260709 13:03:17.780699 12948 consensus_queue.cc:1059] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:03:17.848819  8863 leader_election.cc:304] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:17.818387 12759 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:17.823078 12818 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:17.853662  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:17.860281  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:17.879828 13020 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:17.880326 13020 raft_consensus.cc:493] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.880654 13020 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.859951 12999 consensus_queue.cc:237] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.887036 12759 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.868141 12994 raft_consensus.cc:2804] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:17.899904 12994 raft_consensus.cc:697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 16 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:17.901175 12759 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.905383 12640 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:17.910112 12425 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:17.911293  8212 raft_consensus.cc:2368] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15.
I20260709 13:03:17.900810 12994 consensus_queue.cc:237] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.913690 12425 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.914729  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.915417  8287 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.921135  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:17.922065  8358 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 15: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.923050  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.924373  8211 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:17.925732  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:17.931630  8284 raft_consensus.cc:1275] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:17.933347 12981 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.873764 12731 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:17.938686 12939 consensus_meta.cc:287] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 13:03:17.939294 12939 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.939821 12731 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:17.942571  8289 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 15.
I20260709 13:03:17.955422 12673 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.958415  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.959183  8216 raft_consensus.cc:2393] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 15: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:17.960654 12746 raft_consensus.cc:515] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.959120 12939 raft_consensus.cc:493] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.963609 12939 raft_consensus.cc:515] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.967213  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:17.969344  8257 leader_election.cc:400] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15.
I20260709 13:03:17.975127  8257 leader_election.cc:403] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:17.975529  8210 raft_consensus.cc:3055] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:17.975869 13033 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.975893  8210 raft_consensus.cc:740] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:17.983515  8210 consensus_queue.cc:260] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:17.984433  8210 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.988574  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:17.993511  8289 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:17.989240  8212 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 15.
I20260709 13:03:18.015793  8287 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:18.024956  8332 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:18.031208  8891 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:18.034449  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:18.035318  8216 raft_consensus.cc:2393] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:18.039772  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:18.045625  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:18.048230  8182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.114396  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 71084.1us
W20260709 13:03:18.115378  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 73121.9us
W20260709 13:03:18.121516  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 74549.8us
I20260709 13:03:18.131956  8210 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:18.132900 13024 consensus_queue.cc:1059] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:18.007321 12939 leader_election.cc:290] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:18.027201 12746 leader_election.cc:290] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:18.030304 12743 raft_consensus.cc:2804] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:18.171433  8358 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:03:18.172966  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 56990.3us
W20260709 13:03:18.173761  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.951514 12919 consensus_queue.cc:1048] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.191s
W20260709 13:03:18.175194  8259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.044s	sys 0.089s
I20260709 13:03:17.954722 12818 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:18.178207  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.180578  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
W20260709 13:03:18.191180  8259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.044s	sys 0.089s
W20260709 13:03:18.197167  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 570726us
I20260709 13:03:18.191314  8358 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:18.198380  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:18.198982  8284 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.029513 13009 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
I20260709 13:03:18.196086 12981 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:18.205698 13001 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.201972 12989 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.201305 12743 raft_consensus.cc:697] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:18.182799 12656 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:03:18.203043 12887 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:03:18.238822  8289 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:18.224201 12425 raft_consensus.cc:493] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.228804 12840 raft_consensus.cc:3055] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:18.256269  8289 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:18.230909 12989 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:18.255035 12840 raft_consensus.cc:740] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:18.287865 13033 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15.
W20260709 13:03:18.298099  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 81425.8us
I20260709 13:03:18.231822 13001 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:18.290573 13022 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:18.290972 12981 raft_consensus.cc:493] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:18.255126 13020 raft_consensus.cc:515] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:18.252085 13025 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:03:18.257567 12425 raft_consensus.cc:515] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:18.286396 12922 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:03:18.310746  8292 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:18.314368  8289 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:18.316711 12978 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.317236 12978 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:18.319828 12978 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:18.323272  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:18.324705 12425 leader_election.cc:290] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:18.354312  8898 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:18.359880 12840 consensus_queue.cc:260] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:18.361032 12840 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.294530 12743 consensus_queue.cc:237] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:18.363296 13020 leader_election.cc:290] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:18.366750 13001 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:18.312486 12981 raft_consensus.cc:515] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:18.369372 12981 leader_election.cc:290] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:18.373833  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:18.375847  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:18.310937 13022 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:18.378221 12494 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:18.378582 12923 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:18.379109 12923 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:18.381000 12923 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:18.381753  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:18.383141  8359 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:18.395967 13008 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:03:18.403988  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d553c54f49c4cd1a7737e4136f02960" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:18.378330 12948 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:03:18.407720  8364 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:18.417647  8863 leader_election.cc:304] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:18.378598 13022 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:18.427078  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:18.430266  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:18.431516  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:18.432816  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:18.434784  8359 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:18.435859  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:18.436585  8287 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.433808  8362 raft_consensus.cc:3060] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.442883  8284 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:18.453742  8293 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:18.452641  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:18.455897 12989 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:18.457549  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:18.461578  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:18.462482  8212 raft_consensus.cc:2393] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 15: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
W20260709 13:03:18.464788  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 54639us
I20260709 13:03:18.466032  8864 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:18.471448  8362 raft_consensus.cc:2468] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
W20260709 13:03:18.477761  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 60225.5us
I20260709 13:03:18.480157  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fa1d719554be2a7a068962b4672d8" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:18.482481  8287 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 16.
I20260709 13:03:18.484226  8183 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:18.488574  8332 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:18.488986  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:18.489684  8284 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 9.
I20260709 13:03:18.494444  8863 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:18.464542 12838 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.538398  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 72453.2us
I20260709 13:03:18.518268  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:18.458619 12948 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:03:18.458384 12944 consensus_queue.cc:1048] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:03:18.557353  8210 raft_consensus.cc:1240] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Rejecting Update request from peer ee13752324154b1293a47c9dcd8d6ba5 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:18.552115  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:18.559383  8209 raft_consensus.cc:1275] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:18.496959 12724 raft_consensus.cc:2749] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.559674  8212 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.559348  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:18.562031  8210 raft_consensus.cc:3060] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.565846  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58573b7fd6d5467ea27aa5185d42aed7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:18.566506  8897 raft_consensus.cc:3060] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.567538  8894 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:18.517845 12922 raft_consensus.cc:2804] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:18.574029  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:18.547900 12978 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:18.583410  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:18.550647 12918 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:18.588039 12911 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.010s	sys 0.017s
I20260709 13:03:18.580065  8210 raft_consensus.cc:2468] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 16.
I20260709 13:03:18.516950 13050 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:18.588912  8897 raft_consensus.cc:2468] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:18.563699  8864 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:18.570098  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 51876.8us
I20260709 13:03:18.551107 12999 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:03:18.576723 12801 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:18.599232  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:18.601281  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:18.602701  8212 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:18.602929  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893302ae4fac4d73945a8ad0a674a1e5" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:18.604063  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:18.638582  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.588701 12922 raft_consensus.cc:697] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:18.582640 12838 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:18.638846  8183 leader_election.cc:304] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:18.521157 12702 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:18.588361 12823 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.680980  8290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.015s	sys 0.023s
W20260709 13:03:18.934643  8290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.025s	sys 0.038s
W20260709 13:03:18.933679  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 190268us
W20260709 13:03:18.766216  8863 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.641757  8209 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:18.933544  8362 raft_consensus.cc:2368] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15.
W20260709 13:03:18.597908 12911 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.010s	sys 0.017s
I20260709 13:03:18.946549  8366 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:03:18.946564  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 383025us
I20260709 13:03:18.953491  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:18.605259 12978 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:03:18.936004 12743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.029s	sys 0.039s
W20260709 13:03:18.972496 12743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.030s	sys 0.039s
I20260709 13:03:18.963213  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2683) took 1079 ms. Trace:
I20260709 13:03:18.973580  8290 rpcz_store.cc:276] 0709 13:03:17.883851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.885249 (+  1398us) service_pool.cc:224] Handling call
0709 13:03:17.885512 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.885707 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:18.171897 (+286190us) log.cc:844] Serialized 14 byte log entry
0709 13:03:18.962878 (+790981us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.962927 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:18.962986 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.963048 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.963154 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30549,"prepare.queue_time_us":359221,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2464,"raft.queue_time_us":26880,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":1023635,"threads_started":2}
I20260709 13:03:18.933118 12801 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.965248 13055 raft_consensus.cc:493] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:18.945896 13022 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.966902 12838 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:18.961838 13009 raft_consensus.cc:2749] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:18.936918 13039 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.005s	sys 0.024s
I20260709 13:03:18.846550 12763 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:18.846062 12640 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:18.955856 12923 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:18.834481 12673 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
W20260709 13:03:18.960599  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 321923us
I20260709 13:03:18.928853 12762 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.950742 12948 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.950783 12823 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:18.989369  8864 leader_election.cc:304] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:19.005712 12818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.030s	sys 0.044s
I20260709 13:03:18.993080  8360 raft_consensus.cc:2468] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:18.953184 12702 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:18.953173 12870 raft_consensus.cc:2804] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:19.008528  8862 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:19.009384  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:18.984193 12801 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:19.002249 13039 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.005s	sys 0.024s
I20260709 13:03:19.019979  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:18.991585  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 54551.1us
I20260709 13:03:19.037518  8360 raft_consensus.cc:1275] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:19.002014 12944 consensus_queue.cc:1048] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:03:19.049324  8331 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.039317 12702 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:19.039649 12823 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.024536 12918 raft_consensus.cc:2749] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:19.003593 12922 consensus_queue.cc:237] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:19.093677 13025 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.040414  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:19.095804 13002 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:19.014635 12923 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:19.101228  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 92818.7us
W20260709 13:03:19.101423  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 47341.7us
I20260709 13:03:19.101816 12923 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:19.102316 12919 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.103911 13036 consensus_queue.cc:1048] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:19.080693 12870 raft_consensus.cc:697] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
W20260709 13:03:19.031291 12818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.030s	sys 0.045s
I20260709 13:03:19.122123  8212 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:19.123729  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.124945  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fc7732f1124e04b9a47402ad544464" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:19.045547 12801 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.023382 12948 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:19.052099  8286 raft_consensus.cc:1275] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:03:19.052698  8360 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:19.039057 13003 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.023257 12762 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:19.090417  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:19.001767 13022 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.000100 13055 raft_consensus.cc:515] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.006935 12763 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.011560 12640 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:19.092968  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 43738.6us
I20260709 13:03:19.144774 13025 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:19.178061  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.058220 12978 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.124743  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:19.182977  8367 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 15.
I20260709 13:03:19.185799 13022 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.191514 13055 leader_election.cc:290] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.164738 13003 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.194828 13003 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.195577  8209 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:19.195959 12763 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.126332  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:19.150918  8290 raft_consensus.cc:1275] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:19.157817  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:19.146463  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:19.164101  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 44004us
I20260709 13:03:19.165848  8211 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:03:19.200663  8211 pending_rounds.cc:85] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 6
I20260709 13:03:19.200941  8211 pending_rounds.cc:107] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:03:19.201176  8211 raft_consensus.cc:2889] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:19.166278  8210 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:19.176882  8331 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.179075  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:19.167276 13006 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:03:19.203927  8285 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 15.
I20260709 13:03:19.206832  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:19.210453  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e437f18bf26d472eba0aa8ed4b920b7e" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:19.214855 12917 raft_consensus.cc:493] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.215690 12917 raft_consensus.cc:515] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.145982 12997 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:03:19.207332 12720 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:19.218566  8367 raft_consensus.cc:1275] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:19.214913  8289 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:19.222170  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:19.228927  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.231567 13064 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.232120 13064 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.232089 12870 consensus_queue.cc:237] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:19.235483  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 58721.6us
I20260709 13:03:19.242916  8259 leader_election.cc:304] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:19.245488  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:19.246140  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:19.252878  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:19.227802 13060 log.cc:927] Time spent T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.112s	user 0.002s	sys 0.002s
I20260709 13:03:19.255481  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:19.258373  8367 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:19.215610 12801 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.259711  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:19.196923 13020 consensus_queue.cc:1048] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:03:19.230785  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:19.183984 13036 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:03:19.258414  8259 leader_election.cc:400] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337) with higher term. Message: Invalid argument: T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 14. Current term is 15.
I20260709 13:03:19.276605  8259 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:19.266578  8892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:19.281457 12746 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:19.284456 12746 raft_consensus.cc:493] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.284885 12746 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.288573 13010 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:19.292497 13006 consensus_queue.cc:1048] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:19.294589  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.296176 12944 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.257082 13064 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:19.307389 12948 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:19.229799 12981 consensus_queue.cc:1048] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 13:03:19.314554  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 51065.2us
I20260709 13:03:19.314939  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:19.315653  8363 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:19.320587 13010 raft_consensus.cc:2804] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:19.258940 12939 raft_consensus.cc:2749] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:19.321695  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 45189.1us
I20260709 13:03:19.341264  8183 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:19.344149  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:19.347682 12640 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:19.350015 12762 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:19.351617  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:19.352757 13010 raft_consensus.cc:697] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:19.339038  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:19.322592  8359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.054s	sys 0.084s
I20260709 13:03:19.320360 12981 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:19.356859  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:19.364938  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a1960353b84e25a3e3faea11a1f4fb" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:19.369493  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.370939  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:19.372009  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:19.372571  8292 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:19.326807 13055 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.359319  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b137d34f34145b18037845635e297eb" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:19.356850  8359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.054s	sys 0.085s
I20260709 13:03:19.378350  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:19.382123  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:19.383090  8183 leader_election.cc:304] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.383522  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:19.382742  8213 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:19.385191  8863 leader_election.cc:304] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:19.376624 13025 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:19.371131 12917 leader_election.cc:290] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:19.380357 12919 raft_consensus.cc:2749] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.403023  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:19.408630  8292 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 10.
I20260709 13:03:19.425906 12038 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:19.426597 12038 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.429916 12038 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.430629  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:19.434690  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:19.436564  8257 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:19.437995 12038 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.370997 12918 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:03:19.368503 13010 consensus_queue.cc:237] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:19.395010 12673 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:19.477133 12762 raft_consensus.cc:2749] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:19.476177 13009 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:19.386303 13001 raft_consensus.cc:493] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:19.517970 13001 raft_consensus.cc:515] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.402667 12640 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:19.471728  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 88715.6us
I20260709 13:03:19.520290 13001 leader_election.cc:290] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.521270  8183 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:19.475258  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 136340us
I20260709 13:03:19.386868 13064 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:03:19.508613 12746 raft_consensus.cc:515] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.523751  8892 raft_consensus.cc:2393] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 14: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
I20260709 13:03:19.449056  8894 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 15.
I20260709 13:03:19.418552 12997 raft_consensus.cc:493] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:19.525390  8293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.024s	sys 0.010s
W20260709 13:03:19.534518  8293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.024s	sys 0.010s
I20260709 13:03:19.388131 13055 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:19.543627  8365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.017s
W20260709 13:03:19.544692  8365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.014s	sys 0.017s
I20260709 13:03:19.514886 12673 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.531366 13009 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.548269 12762 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.558229 12673 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.561508 13009 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.545670 12997 raft_consensus.cc:515] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.585815 12746 leader_election.cc:290] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:19.585690 12997 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.591121 12724 raft_consensus.cc:3055] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:19.591557 12724 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:19.592407 12724 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:19.593629 12724 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:19.599946  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:19.600581  8361 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.626793  8361 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
I20260709 13:03:19.628540  8864 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:19.626974  8358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.004s	sys 0.008s
W20260709 13:03:19.642030  8358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.005s	sys 0.008s
I20260709 13:03:19.654273 12923 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:19.665796  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2384ae06cadc456cb351a6dbe8483639" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:19.666507  8218 raft_consensus.cc:3060] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.701148  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:19.677901  8218 raft_consensus.cc:2468] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 14.
W20260709 13:03:19.710184  8284 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.016s
W20260709 13:03:19.710582  8284 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.000s	sys 0.016s
W20260709 13:03:19.712145  8288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.009s	sys 0.007s
W20260709 13:03:19.712585  8288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.010s	sys 0.007s
W20260709 13:03:19.714020  8896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.029s	sys 0.022s
I20260709 13:03:19.633965 12870 raft_consensus.cc:2804] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:19.704515 13062 log.cc:927] Time spent T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:03:19.715749  8896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.030s	sys 0.022s
I20260709 13:03:19.732703 12870 raft_consensus.cc:697] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:19.732973 13055 leader_election.cc:290] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:19.740512  8216 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:03:19.739328  8360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.015s
W20260709 13:03:19.742794  8360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.003s	sys 0.015s
W20260709 13:03:19.743989  8898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.014s	sys 0.003s
W20260709 13:03:19.744400  8898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.015s	sys 0.003s
W20260709 13:03:19.741490  8366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.017s
W20260709 13:03:19.746502  8366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.000s	sys 0.017s
I20260709 13:03:19.748682  8332 leader_election.cc:304] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
W20260709 13:03:19.751597  8362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.019s
W20260709 13:03:19.751998  8362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.000s	sys 0.019s
W20260709 13:03:19.749830 12922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.004s	sys 0.014s
I20260709 13:03:19.771430 13025 raft_consensus.cc:2749] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:19.752694 12994 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:03:19.800518 12922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.004s	sys 0.015s
W20260709 13:03:19.828420 13063 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:19.895217  8359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2567) took 1453 ms. Trace:
I20260709 13:03:19.907214  8359 rpcz_store.cc:276] 0709 13:03:18.442055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.484926 (+ 42871us) service_pool.cc:224] Handling call
0709 13:03:18.485302 (+   376us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:18.501985 (+ 16683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.502020 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:18.502702 (+   682us) log.cc:844] Serialized 78 byte log entry
0709 13:03:19.381485 (+878783us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:19.827331 (+445846us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.894390 (+ 67059us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.894744 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.894895 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.894970 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.895010 (+    40us) raft_consensus.cc:1685] finished
0709 13:03:19.895021 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.895162 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10260,"raft.queue_time_us":82874,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":32661,"thread_start_us":1194775,"threads_started":2,"wal-append.queue_time_us":929406}
I20260709 13:03:19.900678 13022 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:19.828665 13049 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.019s	sys 0.019s
W20260709 13:03:19.936132  8363 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.035s	sys 0.045s
W20260709 13:03:19.937986  8363 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.035s	sys 0.046s
W20260709 13:03:19.942829 13049 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.019s	sys 0.020s
I20260709 13:03:19.894646 12870 consensus_queue.cc:237] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:20.018800 13072 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:03:20.021618 13078 log.cc:927] Time spent T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:03:20.023409 13071 log.cc:927] Time spent T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:03:20.024907 13076 log.cc:927] Time spent T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:03:20.026571 13088 log.cc:927] Time spent T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:03:20.028159 13075 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:03:20.031025 13069 log.cc:927] Time spent T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:03:20.087407  8182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.012s
W20260709 13:03:20.088551  8182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.006s	sys 0.012s
W20260709 13:03:20.089677  8209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.008s	sys 0.019s
W20260709 13:03:20.090240  8209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.008s	sys 0.019s
W20260709 13:03:20.090327  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.007s	sys 0.003s
W20260709 13:03:20.090920  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.007s	sys 0.003s
W20260709 13:03:20.091456  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 569074us
W20260709 13:03:20.093319  8213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.007s
W20260709 13:03:20.093873  8213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.002s	sys 0.007s
W20260709 13:03:20.090323  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.005s	sys 0.001s
W20260709 13:03:20.094661  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.005s	sys 0.001s
W20260709 13:03:20.095448  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 570833us
I20260709 13:03:20.112010  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42830 (request call id 2572) took 1123 ms. Trace:
W20260709 13:03:20.105587  8286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.015s	sys 0.024s
I20260709 13:03:20.138862  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51072 (request call id 947) took 1038 ms. Trace:
I20260709 13:03:20.139489  8366 rpcz_store.cc:276] 0709 13:03:19.100647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.105380 (+  4733us) service_pool.cc:224] Handling call
0709 13:03:19.105640 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:19.105943 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.105971 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.116177 (+ 10206us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.746917 (+630740us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:19.746954 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.747024 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.138231 (+391207us) raft_consensus.cc:1685] finished
0709 13:03:20.138273 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.138634 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1186,"raft.queue_time_us":445,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7495,"thread_start_us":574906,"threads_started":1,"wal-append.queue_time_us":749068}
I20260709 13:03:20.112627  8365 rpcz_store.cc:276] 0709 13:03:18.988267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.989325 (+  1058us) service_pool.cc:224] Handling call
0709 13:03:18.989605 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.989892 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.989915 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.000073 (+ 10158us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.545870 (+545797us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:19.546844 (+   974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.546915 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.111155 (+564240us) raft_consensus.cc:1685] finished
0709 13:03:20.111202 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.111725 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13094,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7110,"thread_start_us":527834,"threads_started":1,"wal-append.queue_time_us":773301}
I20260709 13:03:20.142343  8358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 2138) took 1399 ms. Trace:
W20260709 13:03:20.147485  8286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.016s	sys 0.025s
I20260709 13:03:20.152701 13037 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:03:20.156334 13009 consensus_meta.cc:287] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.002s
I20260709 13:03:20.157084 13009 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:20.158740  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60538 (request call id 2705) took 1034 ms. Trace:
W20260709 13:03:20.161324  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 64717.6us
I20260709 13:03:20.143807  8358 rpcz_store.cc:276] 0709 13:03:18.742621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.936376 (+193755us) service_pool.cc:224] Handling call
0709 13:03:18.936686 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.980562 (+ 43876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.980591 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.981027 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.642555 (+661528us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:19.642598 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.644500 (+  1902us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54001531d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:19.644552 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.141596 (+497044us) raft_consensus.cc:1685] finished
0709 13:03:20.141641 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.142128 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39273,"raft.queue_time_us":19680,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":55175552,"thread_start_us":661142,"threads_started":1,"wal-append.queue_time_us":922194}
I20260709 13:03:20.165601  8288 rpcz_store.cc:276] 0709 13:03:19.124583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.124769 (+   186us) service_pool.cc:224] Handling call
0709 13:03:19.125075 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:19.125407 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.125434 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.125853 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.713330 (+587477us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:19.713370 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.713455 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.158140 (+444685us) raft_consensus.cc:1685] finished
0709 13:03:20.158191 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.158472 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3210,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2477,"thread_start_us":587166,"threads_started":1,"wal-append.queue_time_us":802695}
I20260709 13:03:20.196290  8896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43630 (request call id 1149) took 1631 ms. Trace:
I20260709 13:03:20.197218  8898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43628 (request call id 1470) took 1046 ms. Trace:
W20260709 13:03:20.200122  8364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42814 (request call id 2133) took 1597 ms (client timeout 2029 ms). Trace:
I20260709 13:03:20.197696  8898 rpcz_store.cc:276] 0709 13:03:19.150298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.150417 (+   119us) service_pool.cc:224] Handling call
0709 13:03:19.177523 (+ 27106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:19.177963 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.177994 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.178484 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.744811 (+566327us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:19.984634 (+239823us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.196541 (+211907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.196714 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.196801 (+    87us) raft_consensus.cc:1685] finished
0709 13:03:20.196818 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.197056 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146361,"prepare.queue_time_us":187443,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2693,"raft.queue_time_us":4368,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":11181,"thread_start_us":805448,"threads_started":2,"wal-append.queue_time_us":867818}
I20260709 13:03:20.207378 12978 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:20.208623 12978 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.197259 13097 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.211095 13097 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:20.211848 12981 raft_consensus.cc:2749] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:20.226465 12994 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:20.227460 12994 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.231986 13009 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:20.200639  8364 rpcz_store.cc:269] 0709 13:03:18.602060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.603776 (+  1716us) service_pool.cc:224] Handling call
0709 13:03:20.199585 (+1595809us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54000672d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc2512fa 00007f2f01212b17 00007f2efa78d6d4 00007f2efa78d662 00007f2efa78d591 00007f2efa78d50c 00007f2efa78c7c2 00007f2efa58848c 00007f2efa5878c6 00007f2efa58726f
0709 13:03:20.199851 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270199552}
I20260709 13:03:20.238085  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.222580  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:20.225777 12746 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:20.196966  8896 rpcz_store.cc:276] 0709 13:03:18.554167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.554272 (+   105us) service_pool.cc:224] Handling call
0709 13:03:18.554611 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.956727 (+402116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.956754 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.957295 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.736516 (+779221us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:19.736559 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.736706 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.132617 (+395911us) raft_consensus.cc:1685] finished
0709 13:03:20.132654 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.185761 (+ 53107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2348,"raft.queue_time_us":6366,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":12708,"spinlock_wait_cycles":28928,"thread_start_us":1178307,"threads_started":2,"wal-append.queue_time_us":951271}
I20260709 13:03:20.290480 13097 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:20.262171 12994 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:20.294909  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 62960.7us
I20260709 13:03:20.302363 12640 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.303284 12640 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:20.295527 12746 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.322887  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.326972  8367 raft_consensus.cc:2410] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:20.333356  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:20.339908  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:20.342936 12640 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:20.345717  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44115d987e9746a3b4f158acec40ce8f" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.324376 13097 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:20.359251  8331 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:20.361814 13022 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.369009  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.369963  8291 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 15.
I20260709 13:03:20.372797  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:20.373034  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f1d898d0e9492bbd25195dba3e62d4" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
W20260709 13:03:20.373298  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 152554us
I20260709 13:03:20.374542  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:20.380683 12978 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:20.388229 12746 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:20.389580 13097 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:20.390859 13097 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.394279  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.394520  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.395407  8293 raft_consensus.cc:2410] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:20.373790 12640 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:20.414436  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 101798us
I20260709 13:03:20.415850  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39866 (request call id 1081) took 1018 ms. Trace:
I20260709 13:03:20.417483  8210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.418207  8210 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 15.
I20260709 13:03:20.406450 12640 raft_consensus.cc:493] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.429083  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:20.444038 12999 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:20.444932 12999 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.447702 12999 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:20.444095 12640 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.416337  8213 rpcz_store.cc:276] 0709 13:03:19.397654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.487772 (+ 90118us) service_pool.cc:224] Handling call
0709 13:03:19.488085 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:19.571337 (+ 83252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.571371 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.578863 (+  7492us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.094682 (+515819us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:20.094890 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.406914 (+312024us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b54004740d4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc24de01 00007f2efc24c83e 00007f2f01211419 00007f2efa788bd4 00007f2efa788b62 00007f2efa788a91 00007f2efa788a0c 00007f2efa787cc2 00007f2efa58848c 00007f2efa5878c6
0709 13:03:20.406975 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.412319 (+  5344us) raft_consensus.cc:1685] finished
0709 13:03:20.412337 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.415797 (+  3460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3420,"raft.queue_time_us":27149,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":172437248,"thread_start_us":515211,"threads_started":1,"wal-append.queue_time_us":463336}
W20260709 13:03:20.434248  8259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.236.3:37337 timed out after 2.029s (SENT)
I20260709 13:03:20.439776 13119 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.458047  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.462383  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.464591 13119 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.467284 13119 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:20.480206  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 46223.7us
I20260709 13:03:20.492810  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42814 (request call id 2141) took 1134 ms. Trace:
I20260709 13:03:20.469872 12870 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:20.495643  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.513484 12870 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.516196 12870 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:20.519438  8218 raft_consensus.cc:1240] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Rejecting Update request from peer ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:03:20.526645 12818 consensus_queue.cc:1059] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:20.528067 13121 raft_consensus.cc:3055] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:20.528540 13121 raft_consensus.cc:740] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:20.530331  8218 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:20.529830 13121 consensus_queue.cc:260] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:20.532538 13121 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.533874  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.534128  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.535045  8218 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:20.503054  8363 rpcz_store.cc:276] 0709 13:03:19.338465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.338633 (+   168us) service_pool.cc:224] Handling call
0709 13:03:19.339024 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:19.364022 (+ 24998us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:19.941451 (+577429us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.300766 (+359315us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:20.466260 (+165494us) log.cc:844] Serialized 52 byte log entry
0709 13:03:20.466431 (+   171us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:20.466463 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.466580 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.470191 (+  3611us) raft_consensus.cc:1685] finished
0709 13:03:20.470208 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.472872 (+  2664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8859,"prepare.queue_time_us":539394,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":2756,"raft.queue_time_us":44065,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":15863,"thread_start_us":823339,"threads_started":2,"wal-append.queue_time_us":245858}
I20260709 13:03:20.537375  8184 leader_election.cc:304] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.539057  8184 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.540707 13101 raft_consensus.cc:2749] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:20.541507 13101 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:20.546698 12673 consensus_meta.cc:287] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Time spent flushing consensus metadata: real 0.956s	user 0.000s	sys 0.021s
I20260709 13:03:20.548779  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.551405  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:20.490329 12724 consensus_meta.cc:287] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Time spent flushing consensus metadata: real 0.893s	user 0.018s	sys 0.004s
I20260709 13:03:20.540767  8184 leader_election.cc:304] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.568099  8257 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:20.573789  8284 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:20.576371  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.577962  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.576943  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.578522  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.583150 13036 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:20.547781 12673 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.583716 12944 raft_consensus.cc:493] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.595532  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 54877us
I20260709 13:03:20.596668  8184 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.573671 12818 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:03:20.584910 13101 raft_consensus.cc:2749] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.608268 12706 raft_consensus.cc:2749] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:20.623068  8218 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:20.623049  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.637593 12038 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:20.638994 12038 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.639395 12038 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.583843 13036 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.637888 13022 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.660782 12978 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:20.661091 13106 raft_consensus.cc:493] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4a50f39e2d8e4886a79849938f2272a6)
I20260709 13:03:20.665548 13106 raft_consensus.cc:515] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.668893  8211 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:20.671281 13123 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:20.687855 13022 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:20.700896 13137 log.cc:927] Time spent T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.010s
I20260709 13:03:20.654898 12944 raft_consensus.cc:515] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.703814  8358 raft_consensus.cc:1275] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:20.703898 12944 leader_election.cc:290] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:20.706257 12673 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 16 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:20.707858  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:20.708577  8889 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.715293  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.722661  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.723618 13106 leader_election.cc:290] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:20.723946  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.727182  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:20.724092 13122 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:20.728802 13122 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:20.728147  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 91121.8us
I20260709 13:03:20.725196  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.693764 13036 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:20.731875  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.685809 12640 raft_consensus.cc:515] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:20.736222  8889 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 16.
I20260709 13:03:20.738525  8362 raft_consensus.cc:2393] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca43983edda443fa9d74c1f80252f1fc in current term 16: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:20.738564 12746 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.744845  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:20.749698  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0545ed3bf21c4b3489c11d21d7796f22" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:20.750974  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44a898a39ca4aef88c7fc182072ddac" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:20.751271 12919 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:20.754354  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.756073  8331 leader_election.cc:304] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:20.756518  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.743342  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:20.734038 13122 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:20.768275 13106 raft_consensus.cc:2749] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:20.773399  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 118235us
I20260709 13:03:20.780470  8361 raft_consensus.cc:1275] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:20.782760  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028a77b252d249a6bef6c5f1f87a39e9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.786661 12746 raft_consensus.cc:493] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee13752324154b1293a47c9dcd8d6ba5)
I20260709 13:03:20.787329 12746 raft_consensus.cc:515] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.789618 12746 leader_election.cc:290] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:20.793080  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.797223 13022 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:20.804991  8284 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.812052  8864 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.815551  8365 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.810539  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe403af31f9840f3b20788181ba23576" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.814271 12038 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.822353  8287 raft_consensus.cc:1240] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Rejecting Update request from peer 4a50f39e2d8e4886a79849938f2272a6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:03:20.823180 12038 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:20.831911 12919 consensus_queue.cc:1048] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:20.834534 12702 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.836109  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f8a1b635cb4638922cb1dcf37e6e5b" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.851774  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:20.861009  8284 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 16.
I20260709 13:03:20.870204 13022 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:20.870913 13022 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:20.876518 12038 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:20.883519 12038 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.885409 12038 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:20.886459  8863 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.890818  8863 leader_election.cc:304] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:20.905429  8332 leader_election.cc:304] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:20.905841 12702 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:20.921965  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 334616us
I20260709 13:03:20.937952 13022 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:20.915854 12978 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.939792 12978 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.943197  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.943897  8284 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:20.908129 12994 raft_consensus.cc:2749] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:20.957086  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:20.945839 13018 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:20.968199  8365 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 16.
I20260709 13:03:20.941987 12978 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:20.988920  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:20.991802 12922 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.992409 12922 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:20.999557 13018 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:21.005368  8291 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 10.
I20260709 13:03:21.014417 12758 raft_consensus.cc:2749] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:21.017118 12640 leader_election.cc:290] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:21.020431  8259 leader_election.cc:304] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:21.020877  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:21.021633  8285 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.023731 12038 raft_consensus.cc:2749] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:21.024425  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 145432us
I20260709 13:03:21.028056 13118 consensus_queue.cc:1048] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:03:21.031284  8184 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:21.035043 13146 raft_consensus.cc:3060] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.035231 12922 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:21.039636  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:21.039829  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:21.040213  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd433d0931a84d969a77a1cd54cd32b5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:21.040375  8890 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 16.
I20260709 13:03:21.041119  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:21.041832  8212 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:21.039852  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:21.043740 13018 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:21.043923  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
W20260709 13:03:21.044711  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 116458us
I20260709 13:03:21.053588  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:21.032424  8184 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:21.062477  8293 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:21.044528  8287 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 16.
I20260709 13:03:21.063261  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:21.073251  8332 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:21.070277  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:03:21.077459  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 45100.1us
I20260709 13:03:21.077844  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:21.080101  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:21.080083 13036 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:21.079155  8258 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:21.090715  8361 raft_consensus.cc:1275] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:21.091756 13025 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:21.092159 13025 raft_consensus.cc:493] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:21.092566 13025 raft_consensus.cc:3060] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.092367 12917 consensus_queue.cc:1059] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:03:21.093384 12917 raft_consensus.cc:3055] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:21.093823 12917 raft_consensus.cc:740] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:21.094841 12917 consensus_queue.cc:260] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:21.096688 12917 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:21.085371 13036 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.098639 13036 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.099728 13123 consensus_queue.cc:1048] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:21.102977  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:21.105757  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:21.075161  8115 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 6 to 8, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 8 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:21.119558 12038 raft_consensus.cc:2749] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:21.119673  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:21.083734 12673 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:21.136672 13119 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:21.149842  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 44806.1us
I20260709 13:03:21.153285 12673 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 16 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:21.154866 12673 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:21.158286  8257 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
W20260709 13:03:21.149461  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 59482.8us
I20260709 13:03:21.161700 13121 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:21.166383  8115 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.193056 13049 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:03:21.214386 13112 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.184902 13025 raft_consensus.cc:515] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:21.258332  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:21.259087  8209 raft_consensus.cc:2393] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee13752324154b1293a47c9dcd8d6ba5 in current term 13: Already voted for candidate ca43983edda443fa9d74c1f80252f1fc in this term.
I20260709 13:03:21.230768 13146 raft_consensus.cc:2749] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.242669  8115 catalog_manager.cc:5697] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:21.245561  8116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48060 (request call id 279) took 17820 ms (client timeout 15000 ms). Trace:
I20260709 13:03:21.253281 13036 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:21.279762  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 189922us
I20260709 13:03:21.283489  8285 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 16.
I20260709 13:03:21.288638  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:21.301314  8891 raft_consensus.cc:1240] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:21.299821 12944 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.311921 12944 raft_consensus.cc:493] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.312286 12944 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:21.263794  8116 rpcz_store.cc:269] 0709 13:03:03.432209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.449363 (+ 17154us) service_pool.cc:224] Handling call
0709 13:03:21.245346 (+17795983us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:17.632141 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:17.686254 (+ 54113us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:17.686292 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:03:17.686311 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:17.687707 (+  1396us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:17.687774 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:17.687805 (+    31us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:03:17.688955 (+  1150us) tablet.cc:701] Row locks acquired
0709 13:03:17.688970 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:03:17.689104 (+   134us) write_op.cc:270] Start()
0709 13:03:17.689215 (+   111us) write_op.cc:276] Timestamp: P: 1783602197689059 usec, L: 0
0709 13:03:17.689231 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:03:17.689919 (+   688us) log.cc:844] Serialized 6624 byte log entry
0709 13:03:18.293907 (+603988us) op_driver.cc:464] REPLICATION: finished
0709 13:03:19.123303 (+829396us) write_op.cc:301] APPLY: starting
0709 13:03:19.146929 (+ 23626us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:19.965849 (+818920us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:19.977938 (+ 12089us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:20.338482 (+360544us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:20.386494 (+ 48012us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:03:20.386574 (+    80us) write_op.cc:312] APPLY: finished
0709 13:03:20.387159 (+   585us) log.cc:844] Serialized 156 byte log entry
0709 13:03:20.506550 (+119391us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.526794 (+ 20244us) write_op.cc:454] Released schema lock
0709 13:03:20.526871 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:20.527837 (+   966us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.527864 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5062211,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":813675,"apply.run_cpu_time_us":49150,"apply.run_wall_time_us":1417104,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75357,"num_ops":17,"prepare.queue_time_us":176234,"prepare.run_cpu_time_us":6001,"prepare.run_wall_time_us":178703,"raft.queue_time_us":345494,"raft.run_cpu_time_us":39264,"raft.run_wall_time_us":822432,"replication_time_us":596430,"thread_start_us":1305202,"threads_started":5,"wal-append.queue_time_us":326892,"wal-append.run_cpu_time_us":51782,"wal-append.run_wall_time_us":1291690}]]}
I20260709 13:03:21.332638 13036 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:21.333007  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:21.334761  8209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:21.337184 13145 consensus_queue.cc:1059] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:21.338052 13145 consensus_queue.cc:1243] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer 4a50f39e2d8e4886a79849938f2272a6 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:21.339283 13001 raft_consensus.cc:3055] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:21.339740  8218 raft_consensus.cc:2468] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 16.
I20260709 13:03:21.339627 13001 raft_consensus.cc:740] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:21.340754 13001 consensus_queue.cc:260] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:21.341998 13001 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.350244  8862 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:21.351331 13025 leader_election.cc:290] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:21.353529 12944 raft_consensus.cc:515] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:21.356204 12944 leader_election.cc:290] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 17 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:21.317521  8115 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 7 to 9, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 9 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:21.359314  8115 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.361075  8115 catalog_manager.cc:5697] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:21.362803  8115 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 7 to 10, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 10 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.365644 12917 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:21.364571  8115 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 7 to 10, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 10 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.372179  8115 catalog_manager.cc:5697] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:21.373951  8115 catalog_manager.cc:5697] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 11, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 11 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:21.376591  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:21.385191  8332 leader_election.cc:304] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:21.386600 13022 raft_consensus.cc:2804] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:21.387512  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28b8f6279ab44fcb0de6caac309a961" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:21.387929 13022 raft_consensus.cc:697] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:21.389084 13022 consensus_queue.cc:237] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:21.385993  8115 catalog_manager.cc:5697] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:21.396991  8289 raft_consensus.cc:2468] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:21.396010  8115 catalog_manager.cc:5697] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 5 to 8, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 8 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.402643  8890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:21.403229  8890 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.403757  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c46760f54470bb49d3fd515fb4414" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:21.404386  8289 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.420089  8289 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 17.
I20260709 13:03:21.426298  8332 leader_election.cc:304] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:21.427268 12922 raft_consensus.cc:2804] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:21.431545 12922 raft_consensus.cc:697] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:21.434546  8890 raft_consensus.cc:2468] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 17.
I20260709 13:03:21.435629  8115 catalog_manager.cc:5697] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:21.440423  8332 leader_election.cc:304] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:21.441190  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.445130 12922 consensus_queue.cc:237] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:21.460790 13025 raft_consensus.cc:2804] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:21.461596 13025 raft_consensus.cc:697] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 17 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:21.464085  8115 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 8 to 11, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 11 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.472780  8115 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.465461 13025 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:21.504675  8115 catalog_manager.cc:5697] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:21.569988  8289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ca43983edda443fa9d74c1f80252f1fc"
 from {username='slave'} at 127.0.0.1:45764
I20260709 13:03:21.570724  8289 raft_consensus.cc:606] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Received request to transfer leadership to TS ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:21.571029  8289 raft_consensus.cc:614] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.573660  8289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e3ae0ec4e2b4f60b8666dc0d97b4c1b"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:45764
I20260709 13:03:21.574223  8289 raft_consensus.cc:606] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:21.574534  8289 raft_consensus.cc:614] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.579468  8890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:03:21.580004  8890 raft_consensus.cc:606] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:21.580246  8890 raft_consensus.cc:614] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.582818  8289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "4a50f39e2d8e4886a79849938f2272a6"
 from {username='slave'} at 127.0.0.1:45764
I20260709 13:03:21.583377  8289 raft_consensus.cc:606] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 4a50f39e2d8e4886a79849938f2272a6
I20260709 13:03:21.583675  8289 raft_consensus.cc:614] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.586515  8289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f676e8a33e184058b1fda69dd2836ce6"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
mode: GRACEFUL
new_leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
 from {username='slave'} at 127.0.0.1:45764
I20260709 13:03:21.587066  8289 raft_consensus.cc:606] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Received request to transfer leadership to TS ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:21.587352  8289 raft_consensus.cc:614] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.588829  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:21.592957  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:21.649819  8890 raft_consensus.cc:1240] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 17 FOLLOWER]: Rejecting Update request from peer ca43983edda443fa9d74c1f80252f1fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:21.652760 13149 consensus_queue.cc:1059] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:21.653702 13148 raft_consensus.cc:3055] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:21.654119 13148 raft_consensus.cc:740] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:21.654954 13148 consensus_queue.cc:260] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:21.656417 13148 raft_consensus.cc:3060] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:21.931396  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 74964.1us
I20260709 13:03:22.152534  8212 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:22.157272  8216 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:22.308094  8285 raft_consensus.cc:1275] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:22.319015 12944 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:03:22.302632 13167 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:03:22.342751  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 76765.2us
W20260709 13:03:22.353192  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 62401.6us
W20260709 13:03:22.355995  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 71933.9us
W20260709 13:03:22.357611  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 54778.6us
W20260709 13:03:22.371934  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 100846us
I20260709 13:03:22.383915  8211 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 17 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:03:22.384423  8211 pending_rounds.cc:85] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Aborting all ops after (but not including) 11
W20260709 13:03:22.424917  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 50131.3us
I20260709 13:03:22.371068 12917 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.384627  8211 pending_rounds.cc:107] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:03:22.434149  8211 raft_consensus.cc:2889] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:22.431710  8285 raft_consensus.cc:1275] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:22.450771  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 81695.1us
W20260709 13:03:22.456223  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 97776.4us
I20260709 13:03:22.447016 12917 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:22.474035 13187 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:22.475905 12917 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:22.479230 12944 consensus_queue.cc:1048] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:22.482983 13181 consensus_queue.cc:1048] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:22.485564  8285 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 17 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:22.505563 13182 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:22.513644  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 139264us
W20260709 13:03:22.519003  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 144814us
W20260709 13:03:22.520057  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 142631us
I20260709 13:03:22.535872  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:22.536552  8215 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:22.536183  8890 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 17 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:22.518193 13149 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.559159 13187 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:22.565616 13149 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:22.567896 13149 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:22.608283  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 154036us
W20260709 13:03:22.630329  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 74151.2us
I20260709 13:03:22.640347  8862 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: 
I20260709 13:03:22.641980 12702 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:22.642431 12702 raft_consensus.cc:493] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.642758 12702 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:22.655414  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 198588us
I20260709 13:03:22.655683  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:22.669031  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:22.669826  8292 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
W20260709 13:03:22.723932  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 46965.3us
W20260709 13:03:22.725457  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 51513.8us
I20260709 13:03:22.594044  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.752168 12702 raft_consensus.cc:515] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:22.730283  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:22.759850  8894 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 11.
I20260709 13:03:22.810024 12702 leader_election.cc:290] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:22.810904  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:22.811573  8289 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:22.819816  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52604c43ccee4ddca5408d7cc08e134a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:22.820508  8216 raft_consensus.cc:3060] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:22.835440  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:22.862948  8289 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:22.869108  8863 leader_election.cc:304] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:22.869982 12702 raft_consensus.cc:2804] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:22.870507 12702 raft_consensus.cc:697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:22.871430 12702 consensus_queue.cc:237] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:22.898384  8216 raft_consensus.cc:2468] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:22.861514 13186 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:22.882287 13193 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:22.901851 13186 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.916782 13186 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.927739 13193 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:22.945858 13193 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:22.912951  8110 catalog_manager.cc:5697] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 8 to 10, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:22.950891  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca43983edda443fa9d74c1f80252f1fc" is_pre_election: true
I20260709 13:03:22.955602  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:22.956691  8896 raft_consensus.cc:2393] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 11: Already voted for candidate 4a50f39e2d8e4886a79849938f2272a6 in this term.
W20260709 13:03:22.984162  8115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35666 (request call id 375) took 20311 ms (client timeout 15000 ms). Trace:
I20260709 13:03:22.998308 13186 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:23.003364  8216 raft_consensus.cc:2368] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 11. Current term is 12.
I20260709 13:03:23.005853  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:23.006501  8285 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:03:22.984719  8115 rpcz_store.cc:269] 0709 13:03:02.670415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.670587 (+   172us) service_pool.cc:224] Handling call
0709 13:03:22.981779 (+20311192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:21.577065 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:21.581459 (+  4394us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:21.581513 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:03:21.581529 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:21.582791 (+  1262us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:21.582885 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:21.582911 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:03:21.584062 (+  1151us) tablet.cc:701] Row locks acquired
0709 13:03:21.584110 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:03:21.584284 (+   174us) write_op.cc:270] Start()
0709 13:03:21.584437 (+   153us) write_op.cc:276] Timestamp: P: 1783602201584220 usec, L: 0
0709 13:03:21.584456 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:03:21.606319 (+ 21863us) log.cc:844] Serialized 6218 byte log entry
0709 13:03:21.645043 (+ 38724us) op_driver.cc:464] REPLICATION: finished
0709 13:03:22.047194 (+402151us) write_op.cc:301] APPLY: starting
0709 13:03:22.047305 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:22.309466 (+262161us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:22.330515 (+ 21049us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:22.561892 (+231377us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:22.562235 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:03:22.562278 (+    43us) write_op.cc:312] APPLY: finished
0709 13:03:22.562600 (+   322us) log.cc:844] Serialized 148 byte log entry
0709 13:03:22.572289 (+  9689us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:22.572499 (+   210us) write_op.cc:454] Released schema lock
0709 13:03:22.572557 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:22.572968 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:22.572996 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6201094,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":401906,"apply.run_cpu_time_us":23260,"apply.run_wall_time_us":525756,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71167,"num_ops":16,"prepare.queue_time_us":39384,"prepare.run_cpu_time_us":13149,"prepare.run_wall_time_us":51763,"raft.queue_time_us":15535,"raft.run_cpu_time_us":50270,"raft.run_wall_time_us":286308,"replication_time_us":60429,"thread_start_us":335405,"threads_started":4,"wal-append.queue_time_us":20278}]]}
I20260709 13:03:23.018096  8285 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
W20260709 13:03:23.029862  8331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 120366us
I20260709 13:03:23.000701  8110 catalog_manager.cc:5697] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.033877  8183 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:23.042701  8257 leader_election.cc:400] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 11. Current term is 12.
I20260709 13:03:23.043006  8257 leader_election.cc:403] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:23.045045 13118 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893) with higher term. Message: Invalid argument: T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 for earlier term 11. Current term is 12.
I20260709 13:03:23.043344 13001 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:23.051816 13001 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Becoming Leader. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:23.054602  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ca43983edda443fa9d74c1f80252f1fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:23.057523  8894 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.061697  8110 catalog_manager.cc:5697] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 9 to 10, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 10 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.053582 13186 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:23.065457  8110 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 9 to 14, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 14 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.083792  8110 catalog_manager.cc:5697] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 12 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.059129 13001 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:23.070739  8894 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca43983edda443fa9d74c1f80252f1fc in term 12.
I20260709 13:03:23.085588  8110 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 8 to 10, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.095306  8110 catalog_manager.cc:5697] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.096694  8110 catalog_manager.cc:5697] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.097986  8110 catalog_manager.cc:5697] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 11, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 11 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.108439  8110 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.112944  8110 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 8 to 11, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 11 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.114898  8110 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 7 to 11, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 11 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.116726  8110 catalog_manager.cc:5697] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 10, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 10 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.118580  8110 catalog_manager.cc:5697] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 16, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 16 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.124814  8110 catalog_manager.cc:5697] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 4 to 14. New cstate: current_term: 14 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.129402  8110 catalog_manager.cc:5697] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.131853  8110 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 11, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 11 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.139452  8110 catalog_manager.cc:5697] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 8 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 12 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.141167  8110 catalog_manager.cc:5697] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 11, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 11 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.142717  8110 catalog_manager.cc:5697] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 9 to 10, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 10 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.144249  8110 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 13, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 13 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.147384  8110 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.150884  8110 catalog_manager.cc:5697] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 9 to 11, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 11 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.156237  8110 catalog_manager.cc:5697] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 8 to 10, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.157780  8110 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 13, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 13 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.159294  8110 catalog_manager.cc:5697] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.160858  8110 catalog_manager.cc:5697] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 12 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.162501  8110 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 11, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 11 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.164171  8110 catalog_manager.cc:5697] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.165529  8110 catalog_manager.cc:5697] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 3 to 10, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.168838  8110 catalog_manager.cc:5697] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 8 to 15, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 15 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.170575  8110 catalog_manager.cc:5697] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 7 to 13, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 13 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.172255  8110 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 12, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 12 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.173736  8110 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 10 to 14, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 14 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.175510  8110 catalog_manager.cc:5697] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.180258  8110 catalog_manager.cc:5697] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.182615  8110 catalog_manager.cc:5697] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 6 to 10, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.184381  8110 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 9 to 11, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 11 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.189842  8110 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.191226  8110 catalog_manager.cc:5697] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 11 to 14, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 14 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.312148  8285 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:23.313830 12917 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:23.333868  8216 raft_consensus.cc:1275] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:23.335395 12917 consensus_queue.cc:1048] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:23.487723  8894 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:23.491307 13175 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:23.492056 13175 consensus_queue.cc:1243] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Peer 4a50f39e2d8e4886a79849938f2272a6 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:23.494964  8894 pending_rounds.cc:85] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Aborting all ops after (but not including) 9
I20260709 13:03:23.495322  8894 pending_rounds.cc:107] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:03:23.495597  8894 raft_consensus.cc:2889] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:23.516477  8285 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Refusing update from remote peer ca43983edda443fa9d74c1f80252f1fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:23.518045 13146 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:23.536108  8112 catalog_manager.cc:5697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 10 to 13, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 13 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.548496  8112 catalog_manager.cc:5697] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.550160  8112 catalog_manager.cc:5697] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.552067  8112 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 9 to 10, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 10 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:23.554255  8110 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48060 (request call id 280) took 2410 ms. Trace:
I20260709 13:03:23.553458  8112 catalog_manager.cc:5697] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 6 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 12 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.554749  8110 rpcz_store.cc:276] 0709 13:03:21.144403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.144741 (+   338us) service_pool.cc:224] Handling call
0709 13:03:23.554169 (+2409428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:23.224039 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:23.224560 (+   521us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:23.224596 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:03:23.224610 (+    14us) tablet.cc:662] Decoding operations
0709 13:03:23.227533 (+  2923us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:23.227616 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:23.227642 (+    26us) tablet.cc:685] Acquiring locks for 40 operations
0709 13:03:23.240816 (+ 13174us) tablet.cc:701] Row locks acquired
0709 13:03:23.240836 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:03:23.240980 (+   144us) write_op.cc:270] Start()
0709 13:03:23.241091 (+   111us) write_op.cc:276] Timestamp: P: 1783602203240932 usec, L: 0
0709 13:03:23.241118 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:03:23.241868 (+   750us) log.cc:844] Serialized 15230 byte log entry
0709 13:03:23.269104 (+ 27236us) op_driver.cc:464] REPLICATION: finished
0709 13:03:23.276804 (+  7700us) write_op.cc:301] APPLY: starting
0709 13:03:23.276883 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:23.382896 (+106013us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:23.383007 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:23.458999 (+ 75992us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:23.459430 (+   431us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=80,key_file_lookups=80,delta_file_lookups=80,mrs_lookups=0
0709 13:03:23.459478 (+    48us) write_op.cc:312] APPLY: finished
0709 13:03:23.460047 (+   569us) log.cc:844] Serialized 340 byte log entry
0709 13:03:23.460831 (+   784us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.461094 (+   263us) write_op.cc:454] Released schema lock
0709 13:03:23.461178 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:23.486960 (+ 25782us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.486996 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":7444,"apply.run_cpu_time_us":45070,"apply.run_wall_time_us":190132,"cfile_cache_hit":162,"cfile_cache_hit_bytes":171727,"num_ops":40,"prepare.queue_time_us":19022,"prepare.run_cpu_time_us":7460,"prepare.run_wall_time_us":18116,"replication_time_us":27839,"thread_start_us":29048,"threads_started":2}]]}
I20260709 13:03:23.565451  8112 catalog_manager.cc:5697] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 8 to 9, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 9 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:23.580807  8112 catalog_manager.cc:5697] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 7 to 10, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:23.633299  8110 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 8 to 12, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 12 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.634997  8110 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { replace: true } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:23.646417  8110 catalog_manager.cc:5697] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:23.678539  8112 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35680 (request call id 400) took 12700 ms (client timeout 15000 ms). Trace:
W20260709 13:03:23.705713  8112 rpcz_store.cc:269] 0709 13:03:11.031235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.233246 (+202011us) service_pool.cc:224] Handling call
0709 13:03:23.678453 (+12445207us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:23.589510 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:23.589947 (+   437us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:23.589970 (+    23us) write_op.cc:435] Acquired schema lock
0709 13:03:23.589978 (+     8us) tablet.cc:662] Decoding operations
0709 13:03:23.590724 (+   746us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:23.590777 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:23.590802 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:03:23.591335 (+   533us) tablet.cc:701] Row locks acquired
0709 13:03:23.591354 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:03:23.591489 (+   135us) write_op.cc:270] Start()
0709 13:03:23.591611 (+   122us) write_op.cc:276] Timestamp: P: 1783602203591445 usec, L: 0
0709 13:03:23.591639 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:03:23.592327 (+   688us) log.cc:844] Serialized 2824 byte log entry
0709 13:03:23.595571 (+  3244us) op_driver.cc:464] REPLICATION: finished
0709 13:03:23.595916 (+   345us) write_op.cc:301] APPLY: starting
0709 13:03:23.596000 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:23.599404 (+  3404us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:23.599504 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:23.606945 (+  7441us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:23.607149 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:03:23.607192 (+    43us) write_op.cc:312] APPLY: finished
0709 13:03:23.607443 (+   251us) log.cc:844] Serialized 73 byte log entry
0709 13:03:23.607620 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.607857 (+   237us) write_op.cc:454] Released schema lock
0709 13:03:23.607905 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:23.612236 (+  4331us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.612271 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31804,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":108,"apply.run_cpu_time_us":9214,"apply.run_wall_time_us":16268,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29330,"num_ops":7,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":3063,"prepare.run_wall_time_us":3085,"replication_time_us":3767}]]}
I20260709 13:03:23.704541  8113 catalog_manager.cc:5697] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 11 to 14, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 14 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.725121  8113 catalog_manager.cc:5697] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 11 to 12, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 12 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.726908  8113 catalog_manager.cc:5697] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 3 to 8, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 8 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.751684  8113 catalog_manager.cc:5697] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 6 to 10, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 10 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:23.763851  8113 catalog_manager.cc:5697] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 5 to 14. New cstate: current_term: 14 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:23.766206  8113 catalog_manager.cc:5697] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 2 to 12. New cstate: current_term: 12 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:23.812613  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:23.900874  8113 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35686 (request call id 350) took 5929 ms. Trace:
I20260709 13:03:23.903718  8111 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.917009  8111 catalog_manager.cc:5697] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 10 to 12, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 12 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.919255  8111 catalog_manager.cc:5697] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc reported cstate change: term changed from 11 to 15, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ca43983edda443fa9d74c1f80252f1fc (127.6.236.1). New cstate: current_term: 15 leader_uuid: "ca43983edda443fa9d74c1f80252f1fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.911734  8113 rpcz_store.cc:276] 0709 13:03:17.971832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.972038 (+   206us) service_pool.cc:224] Handling call
0709 13:03:23.900760 (+5928722us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:23.784584 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:23.785082 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:23.785127 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:03:23.785143 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:23.785861 (+   718us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:23.785913 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:23.785942 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:03:23.786463 (+   521us) tablet.cc:701] Row locks acquired
0709 13:03:23.786481 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:23.786616 (+   135us) write_op.cc:270] Start()
0709 13:03:23.786721 (+   105us) write_op.cc:276] Timestamp: P: 1783602203786572 usec, L: 0
0709 13:03:23.786747 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:03:23.787351 (+   604us) log.cc:844] Serialized 2446 byte log entry
0709 13:03:23.789323 (+  1972us) op_driver.cc:464] REPLICATION: finished
0709 13:03:23.789819 (+   496us) write_op.cc:301] APPLY: starting
0709 13:03:23.789890 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:23.792831 (+  2941us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:23.792917 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:23.799074 (+  6157us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:23.799245 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:03:23.799285 (+    40us) write_op.cc:312] APPLY: finished
0709 13:03:23.799509 (+   224us) log.cc:844] Serialized 65 byte log entry
0709 13:03:23.800242 (+   733us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.800343 (+   101us) write_op.cc:454] Released schema lock
0709 13:03:23.800388 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:23.802255 (+  1867us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.802285 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":271,"apply.run_cpu_time_us":7472,"apply.run_wall_time_us":12423,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25140,"num_ops":6,"prepare.queue_time_us":11447,"prepare.run_cpu_time_us":3047,"prepare.run_wall_time_us":4658,"replication_time_us":2462}]]}
I20260709 13:03:24.134872  8111 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35666 (request call id 376) took 4838 ms. Trace:
I20260709 13:03:24.138239  8111 rpcz_store.cc:276] 0709 13:03:19.296230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.296964 (+   734us) service_pool.cc:224] Handling call
0709 13:03:19.595598 (+298634us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002eff90. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef91290b2 00007f2f020a2a89 00007f2f0203ada6 00007f2f0200c088 00007f2f0210a37e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc
0709 13:03:24.134799 (+4539201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:23.986821 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:23.987354 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:23.987395 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:03:23.987408 (+    13us) tablet.cc:662] Decoding operations
0709 13:03:23.987929 (+   521us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:23.987990 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:23.988020 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:03:23.988345 (+   325us) tablet.cc:701] Row locks acquired
0709 13:03:23.988359 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:03:23.988502 (+   143us) write_op.cc:270] Start()
0709 13:03:23.988605 (+   103us) write_op.cc:276] Timestamp: P: 1783602203988453 usec, L: 0
0709 13:03:23.988628 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:23.989234 (+   606us) log.cc:844] Serialized 1299 byte log entry
0709 13:03:23.991013 (+  1779us) op_driver.cc:464] REPLICATION: finished
0709 13:03:23.991462 (+   449us) write_op.cc:301] APPLY: starting
0709 13:03:23.991537 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:23.993212 (+  1675us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:23.993307 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:23.998170 (+  4863us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:23.998325 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:03:23.998366 (+    41us) write_op.cc:312] APPLY: finished
0709 13:03:23.998560 (+   194us) log.cc:844] Serialized 41 byte log entry
0709 13:03:23.998719 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.998805 (+    86us) write_op.cc:454] Released schema lock
0709 13:03:23.998857 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:23.999169 (+   312us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.999199 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28190,"reported_tablets":44,"spinlock_wait_cycles":347182336,"child_traces":[["op",{"apply.queue_time_us":231,"apply.run_cpu_time_us":4833,"apply.run_wall_time_us":7688,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12570,"num_ops":3,"prepare.queue_time_us":3645,"prepare.run_cpu_time_us":2671,"prepare.run_wall_time_us":2670,"replication_time_us":2270}]]}
I20260709 13:03:24.144798  8112 catalog_manager.cc:5697] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:24.166749  8112 catalog_manager.cc:5697] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 13 to 16, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 16 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:24.168903  8112 catalog_manager.cc:5697] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 10 to 13, leader changed from ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 13 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.170943  8112 catalog_manager.cc:5697] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 12 to 13, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 13 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
I20260709 13:03:24.177172  8894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4"
dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:58924
I20260709 13:03:24.178689  8894 raft_consensus.cc:606] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:24.184186  8216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb"
dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
mode: GRACEFUL
new_leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:03:24.184727  8216 raft_consensus.cc:606] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Received request to transfer leadership to TS ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:24.187103  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:24.203855  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:24.220645  8112 catalog_manager.cc:5697] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 9 to 13, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 13 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } }
W20260709 13:03:24.233385  8114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35686 (request call id 349) took 26555 ms (client timeout 15000 ms). Trace:
W20260709 13:03:24.233776  8114 rpcz_store.cc:269] 0709 13:02:57.678051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.679720 (+  1669us) service_pool.cc:224] Handling call
0709 13:02:58.166234 (+486514us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5400332cd4. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b7090 00007f2efc255f3a 00007f2f0200c1cc 00007f2f0210a37e 00007f2f005cb2a4 00007f2f005cb232 00007f2f005cb161 00007f2f005cb0dc 00007f2f005ca392 00007f2efa58848c 00007f2efa5878c6
0709 13:03:24.233172 (+26066938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1063950,"reported_tablets":45,"spinlock_wait_cycles":29781248}
I20260709 13:03:24.467793 12870 raft_consensus.cc:993] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:03:24.468276 12870 raft_consensus.cc:1081] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:03:24.469851  8285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:03:24.470489  8285 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.470844  8285 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.478063  8285 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:24.486281  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:24.486512  8285 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:24.486891  8213 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.488725  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b37780d9694d53a9aa75ce1f7515b4" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:24.489301  8894 raft_consensus.cc:3055] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:24.489593  8894 raft_consensus.cc:740] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:24.490312  8894 consensus_queue.cc:260] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:24.491374  8894 raft_consensus.cc:3060] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.497429  8213 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 15.
I20260709 13:03:24.499102  8257 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:24.499886 13172 raft_consensus.cc:2804] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:24.500437 13172 raft_consensus.cc:697] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:24.501259 13172 consensus_queue.cc:237] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:24.511413  8894 raft_consensus.cc:2468] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 15.
I20260709 13:03:24.548183  8111 catalog_manager.cc:5697] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 14 to 15, leader changed from 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 15 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.634009 13186 raft_consensus.cc:993] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: : Instructing follower ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:03:24.645104 13186 raft_consensus.cc:1081] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Signalling peer ecc8d80ac6df4f5b95c8befae4d08ed0 to start an election
I20260709 13:03:24.647244  8287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb"
dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:03:24.647796  8287 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.648186  8287 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.662668  8287 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:24.665756  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:24.666430  8894 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.667373  8287 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:24.680895  8894 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 15.
I20260709 13:03:24.682134  8258 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:24.683019 13172 raft_consensus.cc:2804] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:24.683547 13172 raft_consensus.cc:697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:24.684505 13172 consensus_queue.cc:237] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:24.691591  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b139f81eea56438e9aba32ed1941dedb" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "ca43983edda443fa9d74c1f80252f1fc"
I20260709 13:03:24.692233  8213 raft_consensus.cc:3055] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:24.692495  8213 raft_consensus.cc:740] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca43983edda443fa9d74c1f80252f1fc, State: Running, Role: LEADER
I20260709 13:03:24.693145  8213 consensus_queue.cc:260] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:24.694496  8213 raft_consensus.cc:3060] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.704435  8213 raft_consensus.cc:2468] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 15.
I20260709 13:03:24.712088  8111 catalog_manager.cc:5697] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 14 to 15, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 15 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.017688  8896 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:25.020268 13228 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:25.102807  8213 raft_consensus.cc:1275] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:25.110241 13172 consensus_queue.cc:1048] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:25.205018  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:25.315760  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 69753.6us
I20260709 13:03:25.324664  7088 tablet_server.cc:179] TabletServer@127.6.236.1:0 shutting down...
I20260709 13:03:25.356115  8894 raft_consensus.cc:1275] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:03:25.361969 13229 consensus_queue.cc:1048] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260709 13:03:25.411899  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.426913  8257 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.428867  8257 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.430088  8257 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.435252  8257 consensus_peers.cc:597] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.441460  8331 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:03:25.447265  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.449620  8257 consensus_peers.cc:597] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.455077  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.465348  8257 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.473246  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.495465  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.501283  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.503513  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.519636  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.527637  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.530347  8257 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.536926  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.549813  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.553532  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:25.556370  7088 tablet_replica.cc:333] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.557420  7088 raft_consensus.cc:2243] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.558653  7088 raft_consensus.cc:2272] T f6d613c8b7844e67ad3e2aa415a57d42 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.575446  7088 tablet_replica.cc:333] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.576402  7088 raft_consensus.cc:2243] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.577437  7088 raft_consensus.cc:2272] T c777a0028400426e8927312e58b8d1c5 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.580264  7088 tablet_replica.cc:333] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.581043  7088 raft_consensus.cc:2243] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.581672  7088 raft_consensus.cc:2272] T 768b3b358c7c4b1fbbf348a322e1e144 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.590256  8331 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.594290  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.596411  7088 tablet_replica.cc:333] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
W20260709 13:03:25.597126  8331 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.597343  7088 raft_consensus.cc:2243] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.606637  7088 raft_consensus.cc:2272] T 84f1d898d0e9492bbd25195dba3e62d4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.609372  7088 tablet_replica.cc:333] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.610096  7088 raft_consensus.cc:2243] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.610587  7088 raft_consensus.cc:2272] T ffe3e60c735644e380589d65b7850fd2 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.619220  7088 tablet_replica.cc:333] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.620400  7088 raft_consensus.cc:2243] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.629691  7088 raft_consensus.cc:2272] T 13996684f22f4504bbd9a98a387657e7 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.632745  7088 tablet_replica.cc:333] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.633564  7088 raft_consensus.cc:2243] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.634112  7088 raft_consensus.cc:2272] T cc7fa1d719554be2a7a068962b4672d8 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.647328  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.658931  7088 tablet_replica.cc:333] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.664700  7088 raft_consensus.cc:2243] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.665424  7088 raft_consensus.cc:2272] T 54b37780d9694d53a9aa75ce1f7515b4 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.672591  7088 tablet_replica.cc:333] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
W20260709 13:03:25.673252  8257 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.684813  7088 raft_consensus.cc:2243] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.686985  7088 raft_consensus.cc:2272] T 44115d987e9746a3b4f158acec40ce8f P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.689953  7088 tablet_replica.cc:333] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
W20260709 13:03:25.690016  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.691006  7088 raft_consensus.cc:2243] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.691649  7088 raft_consensus.cc:2272] T 028a77b252d249a6bef6c5f1f87a39e9 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.696077  7088 tablet_replica.cc:333] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.697000  7088 raft_consensus.cc:2243] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:25.700397  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.710915  7088 raft_consensus.cc:2272] T fe403af31f9840f3b20788181ba23576 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.716509  7088 tablet_replica.cc:333] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.717370  7088 raft_consensus.cc:2243] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.717929  7088 raft_consensus.cc:2272] T b139f81eea56438e9aba32ed1941dedb P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.720743  7088 tablet_replica.cc:333] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
W20260709 13:03:25.721195  8257 consensus_peers.cc:597] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.721650  7088 raft_consensus.cc:2243] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.742902  7088 raft_consensus.cc:2272] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ca43983edda443fa9d74c1f80252f1fc [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.749475  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.756489  7088 tablet_replica.cc:333] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.757395  7088 raft_consensus.cc:2243] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.758361  7088 raft_consensus.cc:2272] T 60372205e52244a299cc381c5212f23b P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.761065  7088 tablet_replica.cc:333] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
W20260709 13:03:25.767449  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.761812  7088 raft_consensus.cc:2243] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.781527  7088 raft_consensus.cc:2272] T e437f18bf26d472eba0aa8ed4b920b7e P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.784395  7088 tablet_replica.cc:333] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.790934  7088 raft_consensus.cc:2243] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.798914  7088 raft_consensus.cc:2272] T c1b1759fd5564511bf32b2e51ed1404c P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.814785  7088 tablet_replica.cc:333] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.815681  7088 raft_consensus.cc:2243] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.816354  7088 raft_consensus.cc:2272] T dd433d0931a84d969a77a1cd54cd32b5 P ca43983edda443fa9d74c1f80252f1fc [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.818162  8331 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.820900  7088 tablet_replica.cc:333] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.838869  7088 raft_consensus.cc:2243] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.839722  7088 raft_consensus.cc:2272] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.842584  7088 tablet_replica.cc:333] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.843355  7088 raft_consensus.cc:2243] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.844308  7088 raft_consensus.cc:2272] T 7effd0faf2d846cea5b8e82ac737b7e5 P ca43983edda443fa9d74c1f80252f1fc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.847049  7088 tablet_replica.cc:333] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.851266  7088 raft_consensus.cc:2243] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.869056  7088 raft_consensus.cc:2272] T a41c46760f54470bb49d3fd515fb4414 P ca43983edda443fa9d74c1f80252f1fc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.871989  7088 tablet_replica.cc:333] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.882651  7088 raft_consensus.cc:2243] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.889035  7088 raft_consensus.cc:2272] T 864d288163824eac975181159a2708d9 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.902274  7088 tablet_replica.cc:333] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.906764  7088 raft_consensus.cc:2243] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.907577  7088 raft_consensus.cc:2272] T 457d66c5ca7c4163a642765639bc4f3d P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.913007  7088 tablet_replica.cc:333] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.922724  7088 raft_consensus.cc:2243] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.923868  7088 raft_consensus.cc:2272] T be07a93f3c5547ebbcf1319de3133c06 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.933197  7088 tablet_replica.cc:333] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.934508  7088 raft_consensus.cc:2243] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.936012  7088 raft_consensus.cc:2272] T fe6af4737faf47919cb8e012e72bb44e P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.944234  7088 tablet_replica.cc:333] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.949254  7088 raft_consensus.cc:2243] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.950007  7088 raft_consensus.cc:2272] T 2384ae06cadc456cb351a6dbe8483639 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.966223  8864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 47823.6us
I20260709 13:03:25.973078  7088 tablet_replica.cc:333] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.974224  7088 raft_consensus.cc:2243] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.984742  7088 raft_consensus.cc:2272] T 30a1960353b84e25a3e3faea11a1f4fb P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.992934  7088 tablet_replica.cc:333] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:25.994462  7088 raft_consensus.cc:2243] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.002707  7088 raft_consensus.cc:2272] T 5b726723bee647ec82d162a5cf1a6515 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.012595  7088 tablet_replica.cc:333] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.014700  7088 raft_consensus.cc:2243] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.015923  7088 raft_consensus.cc:2272] T d01b1e9908444e55b2b779bb7a18324a P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.019100  7088 tablet_replica.cc:333] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.020262  7088 raft_consensus.cc:2243] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.021010  7088 raft_consensus.cc:2272] T a28b8f6279ab44fcb0de6caac309a961 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.028980  7088 tablet_replica.cc:333] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.029949  7088 raft_consensus.cc:2243] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.031215  7088 raft_consensus.cc:2272] T f92a5d6830044936958a95556af24660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.037150  7088 tablet_replica.cc:333] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.038107  7088 raft_consensus.cc:2243] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.047000  7088 raft_consensus.cc:2272] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.059338  7088 tablet_replica.cc:333] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.062276  7088 raft_consensus.cc:2243] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.063277  7088 raft_consensus.cc:2272] T c253a65d080e4e3f8185f6278cc7b6f9 P ca43983edda443fa9d74c1f80252f1fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.067838  7088 tablet_replica.cc:333] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.068588  7088 raft_consensus.cc:2243] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.069147  7088 raft_consensus.cc:2272] T b44a898a39ca4aef88c7fc182072ddac P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.071764  7088 tablet_replica.cc:333] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.072453  7088 raft_consensus.cc:2243] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.072973  7088 raft_consensus.cc:2272] T 0545ed3bf21c4b3489c11d21d7796f22 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.075407  7088 tablet_replica.cc:333] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.076114  7088 raft_consensus.cc:2243] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.077107  7088 raft_consensus.cc:2272] T d8e2862cbf8e4bfdb5395396ea06c348 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.107230  7088 tablet_replica.cc:333] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.108088  7088 raft_consensus.cc:2243] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.108794  7088 raft_consensus.cc:2272] T aee8a45d39bb4537bebf44a3d479ebd4 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.111717  7088 tablet_replica.cc:333] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.112511  7088 raft_consensus.cc:2243] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.113131  7088 raft_consensus.cc:2272] T 6a377c652f93483693fc4684f03ffac4 P ca43983edda443fa9d74c1f80252f1fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.115782  7088 tablet_replica.cc:333] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.116468  7088 raft_consensus.cc:2243] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.117512  7088 raft_consensus.cc:2272] T 9f17336652094c69a7e70a69b68a335d P ca43983edda443fa9d74c1f80252f1fc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.120186  7088 tablet_replica.cc:333] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.120951  7088 raft_consensus.cc:2243] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.121994  7088 raft_consensus.cc:2272] T 0e16f2ade8444f2c95d17cae4d4654c2 P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.134158  7088 tablet_replica.cc:333] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.134972  7088 raft_consensus.cc:2243] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.136118  7088 raft_consensus.cc:2272] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.139103  7088 tablet_replica.cc:333] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.139837  7088 raft_consensus.cc:2243] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.140515  7088 raft_consensus.cc:2272] T 0356bb50f97540f48a0cb08e1407eb57 P ca43983edda443fa9d74c1f80252f1fc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.143097  7088 tablet_replica.cc:333] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.143779  7088 raft_consensus.cc:2243] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:26.144835  7088 raft_consensus.cc:2272] T d7d3b2e6d3394d178e2db304c3767659 P ca43983edda443fa9d74c1f80252f1fc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.148154  7088 tablet_replica.cc:333] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.149963  7088 raft_consensus.cc:2243] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.150708  7088 raft_consensus.cc:2272] T 37fc7732f1124e04b9a47402ad544464 P ca43983edda443fa9d74c1f80252f1fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.153312  7088 tablet_replica.cc:333] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc: stopping tablet replica
I20260709 13:03:26.153956  7088 raft_consensus.cc:2243] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.154649  7088 raft_consensus.cc:2272] T 52604c43ccee4ddca5408d7cc08e134a P ca43983edda443fa9d74c1f80252f1fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.558568 13182 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.559181 13182 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.561733 13182 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:26.562464 13200 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.563000 13200 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.563587  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:26.564989 13200 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:26.570693  8331 leader_election.cc:336] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.571233  8331 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:26.574522 13239 raft_consensus.cc:2749] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:26.576571  8862 leader_election.cc:336] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.578472  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:26.580938  8864 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:26.582700 13200 raft_consensus.cc:2749] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.701716 13250 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.703387 13250 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.706465  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:26.710453 13250 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:26.714641  8862 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.715185  8862 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:26.716368 13250 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:26.725687 13242 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.726331 13242 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.728538 13242 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:26.730315  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:26.730984  8896 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:26.732686  8332 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:26.734503  8331 leader_election.cc:336] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.734328 13182 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:26.737982 13182 raft_consensus.cc:493] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.738430 13182 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.747694 13182 raft_consensus.cc:515] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:26.767768  8331 leader_election.cc:336] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.770186 13182 leader_election.cc:290] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:26.779281  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13996684f22f4504bbd9a98a387657e7" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:26.779924  8896 raft_consensus.cc:3060] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.789274  8896 raft_consensus.cc:2468] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:26.793368  8332 leader_election.cc:304] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:26.795550 13182 raft_consensus.cc:2804] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:26.796103 13182 raft_consensus.cc:697] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:26.796923 13182 consensus_queue.cc:237] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.839097  8111 catalog_manager.cc:5697] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 12 to 13, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 13 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.844401 13182 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.845017 13182 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.848047 13182 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:26.848243  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:26.851575  8331 leader_election.cc:336] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.851982  8331 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:26.852684 13182 raft_consensus.cc:2749] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:26.869293 13200 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.869885 13200 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.872026 13200 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:26.874185  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:26.875207  8365 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:26.876900  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
W20260709 13:03:26.879570  8862 leader_election.cc:336] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.880561 13250 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:26.880988 13250 raft_consensus.cc:493] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.881319 13250 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:26.886340 13200 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.887862 13200 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.894542  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:26.895190  8365 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:26.896793  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:26.897540 13252 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:26.897944 13252 raft_consensus.cc:493] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.898319 13252 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:26.900589  8862 leader_election.cc:336] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.901328 13200 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:26.915364 13252 raft_consensus.cc:515] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.919806  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d613c8b7844e67ad3e2aa415a57d42" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:26.920360  8365 raft_consensus.cc:3060] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:26.916494 13250 raft_consensus.cc:515] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.926679  8365 raft_consensus.cc:2468] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
W20260709 13:03:26.935673  8862 leader_election.cc:336] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.943336 13250 leader_election.cc:290] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:26.945308 13252 leader_election.cc:290] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:26.954304  8864 leader_election.cc:304] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:26.955193 13200 raft_consensus.cc:2804] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:26.955667 13200 raft_consensus.cc:697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:26.956456 13200 consensus_queue.cc:237] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.960994  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c777a0028400426e8927312e58b8d1c5" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:26.961618  8365 raft_consensus.cc:3060] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:26.968261  8365 raft_consensus.cc:2468] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:26.970252  8864 leader_election.cc:304] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:26.971359 13262 raft_consensus.cc:2804] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:26.972076  8862 leader_election.cc:336] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:26.975667 13262 raft_consensus.cc:697] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:26.978534 13262 consensus_queue.cc:237] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:26.993569 13242 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:26.994174 13242 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:26.996146 13242 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:27.003906  8285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.038094 13228 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.038631 13228 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.040602 13228 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:27.045645  8331 leader_election.cc:336] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.046523  8331 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:27.050275 13242 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.053558  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:27.054271  8362 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
W20260709 13:03:27.051355  8257 leader_election.cc:336] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.061473  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.062597 13241 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:27.063019 13241 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.063369 13241 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.078131 13241 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.091873 13262 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.092483 13262 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.092757  8113 catalog_manager.cc:5697] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 11 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 12 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.094718 13262 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:27.104809  8862 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.105818  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.112301  8863 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:27.115223 13200 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:27.117765  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60372205e52244a299cc381c5212f23b" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:27.118405  8362 raft_consensus.cc:3060] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:27.123343  8257 leader_election.cc:336] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.125765  8362 raft_consensus.cc:2468] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:27.126948  8259 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.126269 13241 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.128155 13228 raft_consensus.cc:2804] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:27.152124  8113 catalog_manager.cc:5697] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 11 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 12 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.154476 13228 raft_consensus.cc:697] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:27.162710 13228 consensus_queue.cc:237] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.170460 13242 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.171422 13242 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.173907 13268 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.174558 13268 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:27.180753  8331 leader_election.cc:336] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.183020  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.183640  8289 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 15.
I20260709 13:03:27.185247  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.186064 13239 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:27.186568 13239 raft_consensus.cc:493] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.186894 13239 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.192493 13182 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.195528 13182 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.192726 13241 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:03:27.198196  8257 leader_election.cc:336] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.199916  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.192806 13242 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:27.198477 13182 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:27.199002 13268 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.198540 13241 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.219947 13241 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.220990  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:27.225359  8257 leader_election.cc:336] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.225857  8257 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.226588 13268 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.228771  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:27.227078 13268 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.234088 13241 raft_consensus.cc:2749] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.234649 13268 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.238317  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:27.238842  8894 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
W20260709 13:03:27.239529  8331 leader_election.cc:336] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.239905  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:27.240676 13268 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:27.241053 13268 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.241400 13268 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:27.242168  8257 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.244850 13239 raft_consensus.cc:515] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.246001  8362 raft_consensus.cc:2393] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in current term 16: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:27.248785 13250 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.249341 13250 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.252746  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.253309  8287 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:27.254276 13241 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.254285  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:27.255247 13200 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:27.255628 13200 raft_consensus.cc:493] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.254952 13241 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.255950 13262 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.256512 13262 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:27.256927  8862 leader_election.cc:336] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.257563 13241 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.255983 13200 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:27.263509  8257 leader_election.cc:336] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.265759 13262 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:27.256084 13250 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:27.267396 13269 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.268009 13269 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:27.269428  8862 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.271189 13269 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.275067  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.277390 13271 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.277626 13273 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.277992 13271 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.278201 13273 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.280570 13271 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:27.280612 13273 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.281925  8863 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:27.246785  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:27.282804 13273 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.283162 13250 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:27.285593  8259 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:27.286747 13241 raft_consensus.cc:3060] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:27.287343  8257 leader_election.cc:336] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.271731 13268 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.289992 13268 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:27.299929  8257 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.294968 13200 raft_consensus.cc:515] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.278883 13239 leader_election.cc:290] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:27.297350  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c253a65d080e4e3f8185f6278cc7b6f9" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:27.300565  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.302820  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b1759fd5564511bf32b2e51ed1404c" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:27.303495  8889 raft_consensus.cc:3060] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.302906 13200 leader_election.cc:290] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:27.306559  8862 leader_election.cc:336] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.307775  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01b1e9908444e55b2b779bb7a18324a" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:27.308350  8289 raft_consensus.cc:3060] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.313290  8889 raft_consensus.cc:2468] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 15.
I20260709 13:03:27.314400  8289 raft_consensus.cc:2468] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:27.314998  8258 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.316869  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:27.317520  8365 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:27.318517  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:27.319046  8863 leader_election.cc:304] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.320143 13262 raft_consensus.cc:2804] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:27.320669 13262 raft_consensus.cc:697] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:27.321868 13275 raft_consensus.cc:2804] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:27.321513 13262 consensus_queue.cc:237] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.322494 13275 raft_consensus.cc:697] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:27.322371  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:27.323727 13268 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.323521 13275 consensus_queue.cc:237] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:27.334658  7088 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:27.334580  8331 leader_election.cc:336] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:27.335541  8331 leader_election.cc:336] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.336329  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:27.338824  8331 leader_election.cc:336] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.340289  8331 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.327858 13241 raft_consensus.cc:2749] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.338830 13239 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.346226 13200 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.349335  8287 raft_consensus.cc:2468] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 16.
I20260709 13:03:27.335899 13269 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.325491 13268 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.358870 13200 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.369640  8889 raft_consensus.cc:1275] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:27.370710 13200 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.353209 13272 raft_consensus.cc:2749] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:27.373733  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:27.374413  8359 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 11.
I20260709 13:03:27.373140 13268 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.355453 13241 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.375684 13241 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.376025  8864 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:27.377058 13250 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:27.377418 13250 raft_consensus.cc:493] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.368382 13269 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.377758 13250 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.380846 13269 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.377768 13241 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:27.383914  8862 leader_election.cc:336] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.385429 13272 consensus_queue.cc:1048] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:27.385465 13250 raft_consensus.cc:515] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:27.387863  8331 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.389734 13250 leader_election.cc:290] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.390853  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92a5d6830044936958a95556af24660" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:27.391523  8359 raft_consensus.cc:3060] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.395645 13250 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:03:27.396193  8862 leader_election.cc:336] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.396217 13250 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:27.403223  8862 leader_election.cc:336] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.405217 13250 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:27.424031  8862 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.431548 13272 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.432219 13272 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.434554 13272 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:27.436105  8862 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.437460  8332 leader_election.cc:304] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.438588 13239 raft_consensus.cc:2804] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:27.439071 13239 raft_consensus.cc:697] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:27.439941 13239 consensus_queue.cc:237] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.439862  8365 raft_consensus.cc:1275] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:27.442119 13200 consensus_queue.cc:1048] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:27.443053  8331 leader_election.cc:336] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.450929  8359 raft_consensus.cc:2468] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:27.452185  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:27.452586  8864 leader_election.cc:304] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.452821  8894 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:27.454762  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:27.455484  8894 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
I20260709 13:03:27.459623  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:27.460559 13278 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:27.460961 13278 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.461289 13278 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:27.461628  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.462430 13228 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:27.462814 13228 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.463167 13228 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.469192 13250 raft_consensus.cc:2804] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:27.469169  8113 catalog_manager.cc:5697] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 12 to 13, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 13 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.488675  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.483806  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" is_pre_election: true
I20260709 13:03:27.492385  8287 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:27.474463 13228 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.480065  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:27.495306  8362 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:27.490579  8113 catalog_manager.cc:5697] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 12 to 13, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 13 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.497457  8332 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.496624  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:27.462834  8259 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:27.501286 13269 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:27.501881 13269 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.502290 13269 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:27.506011  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:27.502830 13242 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:27.502806 13250 raft_consensus.cc:697] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:27.509670 13268 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:27.510380 13281 raft_consensus.cc:2749] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.512475 13242 raft_consensus.cc:493] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.524796 13268 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
W20260709 13:03:27.551896  8257 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:27.552815  8257 leader_election.cc:336] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:27.553592  8257 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.530719 13242 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.532986 13228 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.550508 13268 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.551430 13182 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.567917 13182 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.563833 13250 consensus_queue.cc:237] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.580704 13182 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.580744 13269 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.589538 13292 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.531790 13278 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:27.627274  8331 leader_election.cc:336] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.635248 13278 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.622212 13292 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.644367  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:27.645104  8889 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 10.
I20260709 13:03:27.652127  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
W20260709 13:03:27.652029  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 144936us
W20260709 13:03:27.654503  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 100015us
I20260709 13:03:27.655748 13182 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:27.656224 13292 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.656188 13182 raft_consensus.cc:493] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.657626 13182 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:27.664829 13182 raft_consensus.cc:515] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.665448  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:27.664716 13242 raft_consensus.cc:515] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.667359  8359 raft_consensus.cc:2393] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a50f39e2d8e4886a79849938f2272a6 in current term 11: Already voted for candidate ee13752324154b1293a47c9dcd8d6ba5 in this term.
I20260709 13:03:27.667271 13296 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.667896 13296 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.669981 13296 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.653118 13269 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.678440 13182 leader_election.cc:290] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.680428 13268 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.683626  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:27.684407  8896 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 11.
I20260709 13:03:27.684520  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864d288163824eac975181159a2708d9" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:27.685173  8889 raft_consensus.cc:3060] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:27.686470  8331 leader_election.cc:336] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:27.687168  8331 leader_election.cc:336] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.684042  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e16f2ade8444f2c95d17cae4d4654c2" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:27.694731  8894 raft_consensus.cc:3060] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:27.702605  8257 leader_election.cc:336] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.703137  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:27.704449 13269 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:27.704859 13269 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca43983edda443fa9d74c1f80252f1fc)
I20260709 13:03:27.705215 13269 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.707072  8894 raft_consensus.cc:2468] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:27.707371 13268 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:27.708611 13242 leader_election.cc:290] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:27.711339  8258 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:27.712860 13276 raft_consensus.cc:2804] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:27.713356 13276 raft_consensus.cc:697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:27.714576 13276 consensus_queue.cc:237] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.719033  8111 catalog_manager.cc:5697] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 15 to 16, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 16 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.721957 13269 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.723273  8889 raft_consensus.cc:2468] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 14.
I20260709 13:03:27.725719  8258 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:27.728083 13278 raft_consensus.cc:2804] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:27.728644 13278 raft_consensus.cc:697] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:27.729516 13278 consensus_queue.cc:237] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:27.748679  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be07a93f3c5547ebbcf1319de3133c06" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0"
I20260709 13:03:27.749336  8287 raft_consensus.cc:3060] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.750439  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f17336652094c69a7e70a69b68a335d" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:27.751089  8891 raft_consensus.cc:3060] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:27.754316  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 51786.8us
W20260709 13:03:27.758246  8259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:37337, user_credentials={real_user=slave}} blocked reactor thread for 249703us
I20260709 13:03:27.768083 13269 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Requested vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:27.769001  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e2862cbf8e4bfdb5395396ea06c348" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:27.769584  8894 raft_consensus.cc:3060] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.773882  8287 raft_consensus.cc:2468] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:27.778553  8894 raft_consensus.cc:2468] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 12.
I20260709 13:03:27.788365  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7d3b2e6d3394d178e2db304c3767659" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:27.789155  8359 raft_consensus.cc:3060] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:27.800371  8862 leader_election.cc:336] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.800655  8359 raft_consensus.cc:2468] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 15.
I20260709 13:03:27.800951  8332 leader_election.cc:304] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.801820 13272 raft_consensus.cc:2804] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:27.802399 13272 raft_consensus.cc:697] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:27.803294  8862 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:27.803310 13272 consensus_queue.cc:237] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
W20260709 13:03:27.813133  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 256021us
I20260709 13:03:27.809572  8258 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0; no voters: 
I20260709 13:03:27.815042  8359 raft_consensus.cc:1275] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:27.815941  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.816255  8863 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:27.817655  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6af4737faf47919cb8e012e72bb44e" candidate_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:27.818266  8365 raft_consensus.cc:3060] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.823825  8259 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.838605 13278 raft_consensus.cc:2804] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:27.839139 13278 raft_consensus.cc:697] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:27.839965 13278 consensus_queue.cc:237] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.840734 13275 consensus_queue.cc:1048] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:27.853538  8331 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.858271  8361 raft_consensus.cc:1275] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:27.859707 13289 consensus_queue.cc:1048] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:27.857146 13228 raft_consensus.cc:2804] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:27.861891 13228 raft_consensus.cc:697] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:27.862738 13228 consensus_queue.cc:237] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:27.860184  8257 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.857158  8365 raft_consensus.cc:2468] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc8d80ac6df4f5b95c8befae4d08ed0 in term 13.
W20260709 13:03:27.866955  8257 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.855023  8894 raft_consensus.cc:1275] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:27.874666  8259 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:27.876168 13290 raft_consensus.cc:2804] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:27.876652 13290 raft_consensus.cc:697] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Becoming Leader. State: Replica: ecc8d80ac6df4f5b95c8befae4d08ed0, State: Running, Role: LEADER
I20260709 13:03:27.877475 13290 consensus_queue.cc:237] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:27.880867  8111 catalog_manager.cc:5697] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 11 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 12 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.819739 13250 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:27.894327  8289 raft_consensus.cc:1275] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:27.897735 13295 consensus_queue.cc:1048] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:27.902484  8293 raft_consensus.cc:1275] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:03:27.903867  8257 leader_election.cc:336] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.906251 13297 consensus_queue.cc:1048] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:27.905993  8113 catalog_manager.cc:5697] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 14 to 15, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 15 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:27.907975  8257 leader_election.cc:336] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:27.907663  8113 catalog_manager.cc:5697] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 13 to 14, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 14 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:27.908958  8257 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.911768  8257 leader_election.cc:336] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:27.912461  8257 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.912791  8257 consensus_peers.cc:597] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.923139  8113 catalog_manager.cc:5697] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 13 to 14, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 14 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.928369  8891 raft_consensus.cc:2468] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:27.934154 13292 raft_consensus.cc:2749] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:27.938369  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.936789  8111 catalog_manager.cc:5697] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 12 to 13, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 13 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.926612 13242 consensus_queue.cc:1048] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 13:03:27.954340  8257 consensus_peers.cc:597] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.950477  8332 leader_election.cc:304] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc
I20260709 13:03:27.963362 13182 raft_consensus.cc:2804] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:27.963991 13182 raft_consensus.cc:697] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:27.964928 13182 consensus_queue.cc:237] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:27.987076  8257 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.023478  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.033537  8257 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.034468  8257 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.034878  8257 consensus_peers.cc:597] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.034976 13303 log.cc:927] Time spent T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:03:28.074736  8111 catalog_manager.cc:5697] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 10 to 11, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 11 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.078006  8113 catalog_manager.cc:5697] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 14 to 15, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 15 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:28.078975  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:28.079684  8113 catalog_manager.cc:5697] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 11 to 12, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 12 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.091409  8113 catalog_manager.cc:5697] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 reported cstate change: term changed from 12 to 13, leader changed from ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) to ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2). New cstate: current_term: 13 leader_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:28.106519  8331 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.108316  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.113157  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.122896  8257 consensus_peers.cc:597] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.155537  8891 raft_consensus.cc:1275] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:03:28.156966  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:28.158529 13295 consensus_queue.cc:1048] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:28.159262  8257 consensus_peers.cc:597] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.175598  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.181457  8257 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.187302  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.196408  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.212872  8257 consensus_peers.cc:597] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.222443  8862 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.251613  8361 raft_consensus.cc:1275] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:28.255090 13275 consensus_queue.cc:1048] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:28.262280  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.262825  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.273442  8331 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.274690  8331 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:28.283555  8891 raft_consensus.cc:1275] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:28.286732 13296 consensus_queue.cc:1048] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:28.287649  8359 raft_consensus.cc:1275] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:03:28.288359  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.289873  8331 consensus_peers.cc:597] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.291487 13292 consensus_queue.cc:1048] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:28.292824  8889 raft_consensus.cc:1275] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:28.299618 13296 consensus_queue.cc:1048] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:28.303565  8293 raft_consensus.cc:1275] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:28.305733 13273 consensus_queue.cc:1048] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:28.315219  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.335299  7088 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:28.350672  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.358525  8257 consensus_peers.cc:597] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.390152  8257 consensus_peers.cc:597] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.400138  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.414243  8257 consensus_peers.cc:597] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.420971  8361 raft_consensus.cc:1275] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Refusing update from remote peer ecc8d80ac6df4f5b95c8befae4d08ed0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:28.425352 13296 consensus_queue.cc:1048] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:28.429374  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.459939  8257 consensus_peers.cc:597] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.499661  8889 raft_consensus.cc:1275] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:28.507966 13182 consensus_queue.cc:1048] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:28.562696  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:28.574647  8331 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:29.336058  7088 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:29.763665  8862 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:29.780611  8331 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.142048  8257 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.163597  8257 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.190181  8331 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.191082  8862 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.240554  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.315621  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.318873  8257 consensus_peers.cc:597] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.329106  8257 consensus_peers.cc:597] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.336756  7088 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:30.404556  8257 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.418901  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.433739  8257 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.451211  8862 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111) [suppressed 411 similar messages]
W20260709 13:03:30.460143  8257 consensus_peers.cc:597] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.528496  8331 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.535866  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.542717  8257 consensus_peers.cc:597] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.558671  8257 consensus_peers.cc:597] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.598971  8257 consensus_peers.cc:597] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.607683  8331 consensus_peers.cc:597] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.613559  8257 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.633865  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.637501  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.645995  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.671828  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.675168  8257 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.681384  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.701009  8862 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.718793  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.728777  8331 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.768082  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.801615  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.845808  8331 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.857730  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.894656  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.928690  8257 consensus_peers.cc:597] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.953814  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.976575  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.993641  8331 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:31.104434  8257 consensus_peers.cc:597] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:31.104943  8257 consensus_peers.cc:597] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:31.121346  8257 consensus_peers.cc:597] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:31.142511  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:31.337962  7088 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:31.438982  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.061010  8331 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.267130  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 50166.4us
W20260709 13:03:32.338478  7088 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:32.356712  8862 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.393383  8331 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.452535  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.637440  8862 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.736447  8257 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.737079  8257 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.769165  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.859237  8257 consensus_peers.cc:597] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.865849  8257 consensus_peers.cc:597] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.910351  8257 consensus_peers.cc:597] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.926954  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.976343  8257 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.008785  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.022964  8257 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.039219  8257 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.055078  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.055644  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.072765  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.075913  8862 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.087579  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.112766  8257 consensus_peers.cc:597] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.121798  8331 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.126899  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.170621  8257 consensus_peers.cc:597] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.181324  8257 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.205334  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.219166  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.286823  8331 consensus_peers.cc:597] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.291304  8331 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.338970  7088 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:33.366412  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.423744  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.429874  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.435896  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.578532  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.690178  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 170542us
W20260709 13:03:33.704936  8257 consensus_peers.cc:597] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.708160  8257 consensus_peers.cc:597] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.712939  8257 consensus_peers.cc:597] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.708997  8331 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.720471  8331 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.728561  8257 consensus_peers.cc:597] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.936455  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.955371  8257 consensus_peers.cc:597] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:34.027777  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:34.339504  7088 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:34.445106  8388 debug-util.cc:398] Leaking SignalData structure 0x7b0800360500 after lost signal to thread 7091
W20260709 13:03:34.446285  8388 debug-util.cc:398] Leaking SignalData structure 0x7b0800359f40 after lost signal to thread 8150
W20260709 13:03:34.447639  8388 debug-util.cc:398] Leaking SignalData structure 0x7b0800237ac0 after lost signal to thread 8317
W20260709 13:03:34.448745  8388 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3220 after lost signal to thread 8391
W20260709 13:03:34.449946  8388 debug-util.cc:398] Leaking SignalData structure 0x7b080027e7e0 after lost signal to thread 8922
W20260709 13:03:34.605602  8331 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:34.784300  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 89501us
W20260709 13:03:34.908771  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.029488  8862 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.063495  8862 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.242592  8257 consensus_peers.cc:597] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.277069  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.340009  7088 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:35.391485  8257 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.405839  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.442114  8331 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.458339  8862 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111) [suppressed 426 similar messages]
W20260709 13:03:35.509940  8257 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.515275  8257 consensus_peers.cc:597] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.543551  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.551527  8257 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.588758  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.594484  8257 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.598321  8257 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.614509  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.617094  8331 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.676913  8862 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.696152  8257 consensus_peers.cc:597] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.713819  8257 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.747203  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.758405  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.787093  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.800518  8257 consensus_peers.cc:597] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.824543  8331 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.849143  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.885389  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.909590  8331 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.925853  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.930313  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.952090  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.953244  8257 consensus_peers.cc:597] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.956694  8257 consensus_peers.cc:597] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.984733  8257 consensus_peers.cc:597] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:36.015743  8331 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:36.033430  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.059033  8331 consensus_peers.cc:597] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:36.094430  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.226320  8257 consensus_peers.cc:597] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:36.340509  7088 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:36.419313  8257 consensus_peers.cc:597] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.443363  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.509833  8257 consensus_peers.cc:597] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.637679  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.107220  8331 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.291585  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.341032  7088 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:37.408653  8862 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.455058  8862 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.588835  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.684185  8257 consensus_peers.cc:597] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.819661  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.895648  8257 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.896935  8331 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.977252  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.984321  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.006830  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.014602  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.024597  8257 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.059629  8257 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.105166  8257 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.108335  8331 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.158492  8257 consensus_peers.cc:597] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.219090  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.242461  8257 consensus_peers.cc:597] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.245307  8257 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.249871  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.258925  8257 consensus_peers.cc:597] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.284149  8331 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.285043  8257 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.294327  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.324685  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.341552  7088 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:38.349121  8862 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.353947  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.367029  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.427531  8257 consensus_peers.cc:597] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.429594  8331 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.443574  8257 consensus_peers.cc:597] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.461717  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.524246  8257 consensus_peers.cc:597] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.531333  8331 consensus_peers.cc:597] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.549252  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.569172  8331 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.784188  8257 consensus_peers.cc:597] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.805796  8257 consensus_peers.cc:597] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.814028  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.827051  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.923228  8257 consensus_peers.cc:597] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.060354  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.342060  7088 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:39.579126  8331 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.748889  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.834734  8862 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.889269  8862 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.893005  8257 consensus_peers.cc:597] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.906898  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.269119  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.289733  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.308172  8257 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.343175  7088 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:40.343163  8331 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.361027  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.468084  8331 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 13:03:40.522192  8257 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.521553  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.554271  8257 consensus_peers.cc:597] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.554719  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.555612  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 49806.3us
W20260709 13:03:40.566202  8257 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.613510  8257 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.614135  8257 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.692066  8257 consensus_peers.cc:597] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.736624  8331 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.790107  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.798364  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.824173  8331 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.831038  8257 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.831799  8257 consensus_peers.cc:597] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.832324  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.843181  8331 consensus_peers.cc:597] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.849964  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.894588  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.911746  8331 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.924609  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.954298  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.979954  8257 consensus_peers.cc:597] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.990944  8862 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:41.091117  8257 consensus_peers.cc:597] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:41.123199  8257 consensus_peers.cc:597] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:41.123859  8257 consensus_peers.cc:597] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:41.154753  8331 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.259872  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.292922  8257 consensus_peers.cc:597] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.343863  7088 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:41.373070  8257 consensus_peers.cc:597] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.398324  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:41.462960  8359 consensus_queue.cc:237] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:41.468664  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:41.522388  8290 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 17 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:41.524233 13369 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:41.577760  8894 raft_consensus.cc:1275] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 17 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:41.586640 13369 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 4 to 13, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:41.601893 13371 consensus_queue.cc:1048] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:41.641937  8293 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 4 to 13, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
I20260709 13:03:41.655819  8103 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a41c46760f54470bb49d3fd515fb4414 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:03:41.674546  8113 catalog_manager.cc:5697] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: config changed from index 4 to 13, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New cstate: current_term: 17 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.711367  8894 raft_consensus.cc:2955] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 4 to 13, VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } }
W20260709 13:03:41.811120  8101 catalog_manager.cc:4755] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a41c46760f54470bb49d3fd515fb4414: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:41.811721  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:42.056120  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.187172  8257 consensus_peers.cc:597] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:42.246722  8331 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:42.254534  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:42.344376  7088 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 8239)
W20260709 13:03:42.414912  8257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 137035us
W20260709 13:03:42.420068  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:42929, user_credentials={real_user=slave}} blocked reactor thread for 203284us
W20260709 13:03:42.505786  8862 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:42.509266  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.509882  8862 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:42.618603  8331 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:42.723836  8257 consensus_peers.cc:597] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.834432  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.848027  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.944769  8257 consensus_peers.cc:597] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:42.954493  8361 consensus_queue.cc:237] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: NON_VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { promote: true } }
W20260709 13:03:42.973503  8331 consensus_peers.cc:597] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:42.978283  8289 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:42.980268 13378 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:42.981104  8891 raft_consensus.cc:1275] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:42.987103 13400 consensus_queue.cc:1048] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:42.998021 13378 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 4 to 10, NON_VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: NON_VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { promote: true } } }
I20260709 13:03:43.008080  8289 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 4 to 10, NON_VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: NON_VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { promote: true } } }
W20260709 13:03:43.018270  8257 consensus_peers.cc:597] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.025655  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.029325  8894 raft_consensus.cc:2955] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 4 to 10, NON_VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: NON_VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { promote: true } } }
W20260709 13:03:43.078037  8257 consensus_peers.cc:597] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:43.074796  8112 catalog_manager.cc:5697] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: config changed from index 4 to 10, NON_VOTER ca43983edda443fa9d74c1f80252f1fc (127.6.236.1) added. New cstate: current_term: 10 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } attrs { replace: true } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } } peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: NON_VOTER last_known_addr { host: "127.6.236.1" port: 41893 } attrs { promote: true } } }
W20260709 13:03:43.111953  8101 catalog_manager.cc:4755] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a41c46760f54470bb49d3fd515fb4414: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:43.142789  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.144112  8863 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:39859, user_credentials={real_user=slave}} blocked reactor thread for 92472.8us
W20260709 13:03:43.158262  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.194305  8257 consensus_peers.cc:597] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.194806  8257 consensus_peers.cc:597] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.254468  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.262753  7088 tablet_server.cc:196] TabletServer@127.6.236.1:0 shutdown complete.
W20260709 13:03:43.309125  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.398258  8257 consensus_peers.cc:597] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.399240  8331 consensus_peers.cc:597] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:43.402840  8257 consensus_peers.cc:597] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:43.435034  8257 consensus_peers.cc:597] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:43.438344  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.458017  7088 tablet_server.cc:179] TabletServer@127.6.236.2:0 shutting down...
W20260709 13:03:43.458753  8257 consensus_peers.cc:597] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:43.490186  8332 consensus_peers.cc:597] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.504511  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.505388  8257 consensus_peers.cc:597] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.513309  8257 consensus_peers.cc:597] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:43.529961  8863 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.548038  8332 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.551489  8331 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:43.554654  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.567435  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:43.570581  7088 tablet_replica.cc:333] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.571667  7088 raft_consensus.cc:2243] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.572378  7088 raft_consensus.cc:2272] T 768b3b358c7c4b1fbbf348a322e1e144 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.576520  7088 tablet_replica.cc:333] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.577446  7088 raft_consensus.cc:2243] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.578164  7088 raft_consensus.cc:2272] T 58573b7fd6d5467ea27aa5185d42aed7 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.582199  7088 tablet_replica.cc:333] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.583206  7088 raft_consensus.cc:2243] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.583942  7088 raft_consensus.cc:2272] T d01b1e9908444e55b2b779bb7a18324a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.586843  7088 tablet_replica.cc:333] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.587683  7088 raft_consensus.cc:2243] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.588331  7088 raft_consensus.cc:2272] T 7d553c54f49c4cd1a7737e4136f02960 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.591507  7088 tablet_replica.cc:333] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.593397  7088 raft_consensus.cc:2243] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.594169  7088 raft_consensus.cc:2272] T 94f8a1b635cb4638922cb1dcf37e6e5b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.597335  7088 tablet_replica.cc:333] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.598228  7088 raft_consensus.cc:2243] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.599443  7088 raft_consensus.cc:2272] T fe403af31f9840f3b20788181ba23576 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.601639  8332 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.602257  7088 tablet_replica.cc:333] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.603229  7088 raft_consensus.cc:2243] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:43.603621  8862 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:43.603835  7088 raft_consensus.cc:2272] T cc7fa1d719554be2a7a068962b4672d8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.606798  7088 tablet_replica.cc:333] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.608685  7088 raft_consensus.cc:2243] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:03:43.609589  8863 consensus_peers.cc:597] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.612601  7088 raft_consensus.cc:2272] T 54b37780d9694d53a9aa75ce1f7515b4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.617158  7088 tablet_replica.cc:333] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.618316  7088 raft_consensus.cc:2243] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.619521  7088 raft_consensus.cc:2272] T 3161be69a5b64eea9d078c61741b3db0 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.622709  7088 tablet_replica.cc:333] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.623551  7088 raft_consensus.cc:2243] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.624248  7088 raft_consensus.cc:2272] T 028a77b252d249a6bef6c5f1f87a39e9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.624583  8332 consensus_peers.cc:597] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.627063  7088 tablet_replica.cc:333] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.628062  7088 raft_consensus.cc:2243] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.629269  7088 raft_consensus.cc:2272] T 60372205e52244a299cc381c5212f23b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.632331  7088 tablet_replica.cc:333] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.633248  7088 raft_consensus.cc:2243] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.633973  7088 raft_consensus.cc:2272] T 3b137d34f34145b18037845635e297eb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.644125  7088 tablet_replica.cc:333] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.645088  7088 raft_consensus.cc:2243] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.645902  7088 raft_consensus.cc:2272] T e437f18bf26d472eba0aa8ed4b920b7e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.648684  7088 tablet_replica.cc:333] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.649650  7088 raft_consensus.cc:2243] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.651084  7088 raft_consensus.cc:2272] T c1b1759fd5564511bf32b2e51ed1404c P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.654145  7088 tablet_replica.cc:333] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.654979  7088 raft_consensus.cc:2243] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.655694  7088 raft_consensus.cc:2272] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.661482  7088 tablet_replica.cc:333] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.662427  7088 raft_consensus.cc:2243] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.663587  7088 raft_consensus.cc:2272] T b139f81eea56438e9aba32ed1941dedb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.666392  7088 tablet_replica.cc:333] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
W20260709 13:03:43.672817  8332 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.674582  8863 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.674906  7088 raft_consensus.cc:2243] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.676205  7088 raft_consensus.cc:2272] T c38bdb3838dd476fb824170ffe3fe5e2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.682930  7088 tablet_replica.cc:333] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.683802  7088 raft_consensus.cc:2243] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.684530  7088 raft_consensus.cc:2272] T dd433d0931a84d969a77a1cd54cd32b5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.684697  8331 consensus_peers.cc:597] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.687600  7088 tablet_replica.cc:333] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.688480  7088 raft_consensus.cc:2243] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.690752  7088 raft_consensus.cc:2272] T 864d288163824eac975181159a2708d9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.694541  7088 tablet_replica.cc:333] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.695757  7088 raft_consensus.cc:2243] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.696887  7088 raft_consensus.cc:2272] T 30a1960353b84e25a3e3faea11a1f4fb P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.699460  8863 consensus_peers.cc:597] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.699656  7088 tablet_replica.cc:333] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.700604  7088 raft_consensus.cc:2243] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.701258  7088 raft_consensus.cc:2272] T 5b726723bee647ec82d162a5cf1a6515 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.703966  7088 tablet_replica.cc:333] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.704766  7088 raft_consensus.cc:2243] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.705372  7088 raft_consensus.cc:2272] T 893302ae4fac4d73945a8ad0a674a1e5 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.707968  7088 tablet_replica.cc:333] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.711616  7088 raft_consensus.cc:2243] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.712466  7088 raft_consensus.cc:2272] T a41c46760f54470bb49d3fd515fb4414 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.715154  7088 tablet_replica.cc:333] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.725613  7088 raft_consensus.cc:2243] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.726966  7088 raft_consensus.cc:2272] T 931eba945dfb4e34aae782648072e6ea P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.727365  8332 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.736065  8332 consensus_peers.cc:597] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.736271  7088 tablet_replica.cc:333] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
W20260709 13:03:43.736752  8331 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.737190  7088 raft_consensus.cc:2243] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.738997  7088 raft_consensus.cc:2272] T fe6af4737faf47919cb8e012e72bb44e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.741675  7088 tablet_replica.cc:333] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
W20260709 13:03:43.741933  8332 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.742522  7088 raft_consensus.cc:2243] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.743673  7088 raft_consensus.cc:2272] T 457d66c5ca7c4163a642765639bc4f3d P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.746492  7088 tablet_replica.cc:333] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.747371  7088 raft_consensus.cc:2243] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.748005  7088 raft_consensus.cc:2272] T be07a93f3c5547ebbcf1319de3133c06 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.750934  7088 tablet_replica.cc:333] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.751683  7088 raft_consensus.cc:2243] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.752337  7088 raft_consensus.cc:2272] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.754981  7088 tablet_replica.cc:333] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.755736  7088 raft_consensus.cc:2243] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.756460  7088 raft_consensus.cc:2272] T d19654c841264233b661225cdb0ef14b P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.757618  8257 consensus_peers.cc:597] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:43.759387  7088 tablet_replica.cc:333] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.761669  7088 raft_consensus.cc:2243] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.762683  7088 raft_consensus.cc:2272] T a28b8f6279ab44fcb0de6caac309a961 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.765828  7088 tablet_replica.cc:333] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.766685  7088 raft_consensus.cc:2243] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.767501  7088 raft_consensus.cc:2272] T c8c00c17016841839312c823fcffaf82 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.770489  7088 tablet_replica.cc:333] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.771309  7088 raft_consensus.cc:2243] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.772411  7088 raft_consensus.cc:2272] T b3069684e0be469dba5b83137f0c4e62 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.773129  8863 consensus_peers.cc:597] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.776463  7088 tablet_replica.cc:333] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.777383  7088 raft_consensus.cc:2243] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.778146  7088 raft_consensus.cc:2272] T 52604c43ccee4ddca5408d7cc08e134a P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.781025  7088 tablet_replica.cc:333] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
W20260709 13:03:43.781538  8332 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.781796  7088 raft_consensus.cc:2243] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.782995  7088 raft_consensus.cc:2272] T 8b6a07d8346e4fd5a54166e1cb3b1660 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.785640  7088 tablet_replica.cc:333] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.786500  7088 raft_consensus.cc:2243] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.787824  7088 raft_consensus.cc:2272] T 0356bb50f97540f48a0cb08e1407eb57 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.791520  7088 tablet_replica.cc:333] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.792351  7088 raft_consensus.cc:2243] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.793044  7088 raft_consensus.cc:2272] T 73508a52a1594a38badce805866b753e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.795719  7088 tablet_replica.cc:333] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.796543  7088 raft_consensus.cc:2243] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.797624  7088 raft_consensus.cc:2272] T 6a377c652f93483693fc4684f03ffac4 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.800385  7088 tablet_replica.cc:333] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.801183  7088 raft_consensus.cc:2243] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.802470  7088 raft_consensus.cc:2272] T 0e16f2ade8444f2c95d17cae4d4654c2 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.805172  7088 tablet_replica.cc:333] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.805895  7088 raft_consensus.cc:2243] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.807085  7088 raft_consensus.cc:2272] T d7d3b2e6d3394d178e2db304c3767659 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.809677  7088 tablet_replica.cc:333] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.810462  7088 raft_consensus.cc:2243] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.811664  7088 raft_consensus.cc:2272] T 37fc7732f1124e04b9a47402ad544464 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.814489  7088 tablet_replica.cc:333] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.815222  7088 raft_consensus.cc:2243] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.815946  7088 raft_consensus.cc:2272] T 410fe3c36e834265b4c3b139e453a76e P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.818715  7088 tablet_replica.cc:333] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.819532  7088 raft_consensus.cc:2243] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.820245  7088 raft_consensus.cc:2272] T c253a65d080e4e3f8185f6278cc7b6f9 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.823654  7088 tablet_replica.cc:333] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.824473  7088 raft_consensus.cc:2243] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:43.825173  7088 raft_consensus.cc:2272] T f676e8a33e184058b1fda69dd2836ce6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:43.827757  7088 tablet_replica.cc:333] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.828465  7088 raft_consensus.cc:2243] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.829632  7088 raft_consensus.cc:2272] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.828392  8332 consensus_peers.cc:597] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:43.832466  7088 tablet_replica.cc:333] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0: stopping tablet replica
I20260709 13:03:43.833153  7088 raft_consensus.cc:2243] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:43.834272  7088 raft_consensus.cc:2272] T d8e2862cbf8e4bfdb5395396ea06c348 P ecc8d80ac6df4f5b95c8befae4d08ed0 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:43.869340  8332 consensus_peers.cc:597] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.878211  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.888217  8332 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.896508  8332 consensus_peers.cc:597] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.900847  8863 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.911859  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.913790  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.937373  8863 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.974756  8332 consensus_peers.cc:597] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.992900  8863 consensus_peers.cc:597] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.026230  8332 consensus_peers.cc:597] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.058980  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:44.078545  8332 consensus_peers.cc:597] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.207890  8101 catalog_manager.cc:4755] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a41c46760f54470bb49d3fd515fb4414: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:44.280838  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:44.557791  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:44.575974 13402 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.576522 13402 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:44.578855 13402 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:44.583253  8862 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:44.585390  8863 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.585832  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.587407 13402 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:44.590370 13378 raft_consensus.cc:493] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.590952 13378 raft_consensus.cc:515] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:44.593132 13378 leader_election.cc:290] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:44.601955  8332 leader_election.cc:336] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:44.605818  8331 leader_election.cc:336] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:44.606323  8331 leader_election.cc:304] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.607800 13378 raft_consensus.cc:2749] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:44.625643 13402 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.626346 13402 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:44.633991  8863 leader_election.cc:336] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.642791 13378 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.644021 13378 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:44.646253 13378 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:44.641808  8862 leader_election.cc:336] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:44.661244  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.668012 13410 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:44.658145  8331 consensus_peers.cc:597] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:44.673197 13394 raft_consensus.cc:493] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.673707 13394 raft_consensus.cc:515] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:44.675794 13394 leader_election.cc:290] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:44.681703  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
W20260709 13:03:44.660534  8332 leader_election.cc:336] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.643467 13402 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:44.711448  8331 leader_election.cc:336] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:44.713814  8332 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: 4a50f39e2d8e4886a79849938f2272a6, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.715641 13402 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.717654 13402 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:44.719971 13378 raft_consensus.cc:2749] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:44.726593  8863 leader_election.cc:336] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.727788 13378 raft_consensus.cc:493] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.728358 13378 raft_consensus.cc:515] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:44.730674  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:44.736359  8864 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:44.738622 13396 raft_consensus.cc:2749] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:44.742009 13378 leader_election.cc:290] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:44.731479 13402 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:44.747154  8332 leader_election.cc:336] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.751420  8332 leader_election.cc:304] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.755873 13378 raft_consensus.cc:2749] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:44.756961  8331 leader_election.cc:336] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:44.754237  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:44.764242 13394 raft_consensus.cc:493] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.764868 13394 raft_consensus.cc:515] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:44.766989 13394 leader_election.cc:290] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:44.780632  8332 leader_election.cc:336] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.781071  8332 leader_election.cc:304] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.786617 13394 raft_consensus.cc:2749] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:44.793205  8331 leader_election.cc:336] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:44.795079  8332 leader_election.cc:336] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.797025  8332 leader_election.cc:304] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.797811 13394 raft_consensus.cc:2749] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:44.844099 13394 raft_consensus.cc:493] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.844631 13394 raft_consensus.cc:515] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:44.846881 13394 leader_election.cc:290] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:44.851435  8332 leader_election.cc:336] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:44.852319  8331 consensus_peers.cc:597] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:44.861531 13402 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.862159 13402 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:44.870117  8863 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.873023 13402 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:44.876446  8862 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:44.876955  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.878122 13402 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:44.856910  8331 leader_election.cc:336] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:44.879307  8331 leader_election.cc:304] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.880034 13394 raft_consensus.cc:2749] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:44.888670 13396 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.889241 13396 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:44.899019  8863 leader_election.cc:336] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.899907 13396 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:44.922348  8862 leader_election.cc:336] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:44.923784  8862 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.924997 13396 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:44.932191 13396 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.932806 13396 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:44.946848  8863 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.935096 13396 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:44.957911  8862 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:44.958498  8862 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:44.965209 13402 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:44.966987 13402 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.967554 13402 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:44.967833 13394 raft_consensus.cc:493] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.970693 13394 raft_consensus.cc:515] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } }
I20260709 13:03:44.972811 13394 leader_election.cc:290] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:44.970715  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:44.973949  8362 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 12.
I20260709 13:03:44.975534  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:44.976438 13396 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:44.976794 13396 raft_consensus.cc:493] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.977126 13396 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:44.984203 13410 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.984750 13410 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:44.986754 13410 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:44.988498  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:44.984663 13402 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
W20260709 13:03:44.991778  8332 leader_election.cc:336] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:44.997941 13410 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:44.998588 13410 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.001648  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:45.003611 13410 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:45.023823 13421 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.024382 13421 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.026867 13421 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:45.028528 13396 raft_consensus.cc:515] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:45.031397  8331 leader_election.cc:336] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:45.039393  8331 leader_election.cc:304] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee13752324154b1293a47c9dcd8d6ba5; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:45.037283  8862 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:45.044194 13378 raft_consensus.cc:2749] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:45.052366  8862 leader_election.cc:336] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:45.061561  8863 leader_election.cc:336] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.062086  8863 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:45.063382 13396 leader_election.cc:290] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:45.064766  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3161be69a5b64eea9d078c61741b3db0" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5"
I20260709 13:03:45.065408  8362 raft_consensus.cc:3060] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:45.067296 13402 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.067818 13402 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.069792 13402 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:45.070284 13402 raft_consensus.cc:2749] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:45.073961  8862 leader_election.cc:336] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:45.082471  8863 leader_election.cc:336] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.082929  8863 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:45.083830  8863 leader_election.cc:336] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.084147 13422 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:45.084499  8863 leader_election.cc:336] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.084796  8362 raft_consensus.cc:2468] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a50f39e2d8e4886a79849938f2272a6 in term 13.
I20260709 13:03:45.084954  8863 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:45.086376 13423 raft_consensus.cc:2749] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:45.087977  8864 leader_election.cc:304] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: 
I20260709 13:03:45.097446 13394 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.098040 13394 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.099726 13423 raft_consensus.cc:2804] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:45.100149 13394 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:45.098332 13421 raft_consensus.cc:493] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.101199 13421 raft_consensus.cc:515] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.103327 13421 leader_election.cc:290] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:45.104135  8863 leader_election.cc:336] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:45.104858  8863 leader_election.cc:336] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.105214  8863 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.105159 13423 raft_consensus.cc:697] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 LEADER]: Becoming Leader. State: Replica: 4a50f39e2d8e4886a79849938f2272a6, State: Running, Role: LEADER
I20260709 13:03:45.106062 13396 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:45.106726 13423 consensus_queue.cc:237] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:45.112152  8863 leader_election.cc:336] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:45.115134  8332 leader_election.cc:336] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:45.122884  8862 leader_election.cc:336] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:45.123378  8862 leader_election.cc:304] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.120991  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:45.124145  8894 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:45.124169 13396 raft_consensus.cc:2749] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:45.128329  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.129166 13394 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:45.128751  8113 catalog_manager.cc:5697] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 reported cstate change: term changed from 12 to 13, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4). New cstate: current_term: 13 leader_uuid: "4a50f39e2d8e4886a79849938f2272a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:45.130034  8862 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:45.129536 13394 raft_consensus.cc:493] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.134838 13394 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:45.143808 13394 raft_consensus.cc:515] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.147047 13394 leader_election.cc:290] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:45.148476  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931eba945dfb4e34aae782648072e6ea" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:45.149062  8894 raft_consensus.cc:3060] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:45.157048  8332 leader_election.cc:336] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.158030  8894 raft_consensus.cc:2468] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:45.160116 13396 raft_consensus.cc:493] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.160663 13396 raft_consensus.cc:515] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.165375 13396 leader_election.cc:290] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:45.166239  8332 leader_election.cc:304] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
W20260709 13:03:45.167546  8863 leader_election.cc:336] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.172196 13400 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.172792 13400 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.175240 13423 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.175807 13423 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.178473 13378 raft_consensus.cc:2804] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:45.179034 13378 raft_consensus.cc:697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:45.179857 13378 consensus_queue.cc:237] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.182489 13423 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337)
I20260709 13:03:45.188643  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "4a50f39e2d8e4886a79849938f2272a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ee13752324154b1293a47c9dcd8d6ba5" is_pre_election: true
I20260709 13:03:45.184392 13400 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:45.195108  8332 leader_election.cc:336] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:45.194093  8331 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:45.198506  8889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:45.199229  8889 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
W20260709 13:03:45.199498  8863 leader_election.cc:336] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.199935  8863 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0, ee13752324154b1293a47c9dcd8d6ba5
I20260709 13:03:45.193480 13428 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.203402 13428 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.207715 13428 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:45.205180  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.209322 13423 raft_consensus.cc:2749] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:45.213742 13378 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:45.214260 13378 raft_consensus.cc:493] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.214748 13378 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:45.210353  8862 leader_election.cc:336] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:45.219353  8862 leader_election.cc:304] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.220120 13422 raft_consensus.cc:2749] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:45.230237  8113 catalog_manager.cc:5697] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 11 to 12, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 12 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:45.236549  8332 leader_election.cc:336] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.240780 13378 raft_consensus.cc:515] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.246518  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:45.248703  8894 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:45.258332  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.259713 13428 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:45.260104 13428 raft_consensus.cc:493] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.260438 13428 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:45.271422 13378 leader_election.cc:290] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
W20260709 13:03:45.274616  8332 leader_election.cc:336] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.274163 13428 raft_consensus.cc:515] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.275797  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bdb3838dd476fb824170ffe3fe5e2" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:45.276849  8894 raft_consensus.cc:3060] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:45.277948 13428 leader_election.cc:290] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:45.281939  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3069684e0be469dba5b83137f0c4e62" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:45.282562  8891 raft_consensus.cc:3060] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:45.283444  8332 leader_election.cc:336] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.283458  8894 raft_consensus.cc:2468] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 13.
I20260709 13:03:45.285480  8332 leader_election.cc:304] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.286162 13428 raft_consensus.cc:2804] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:45.287251 13428 raft_consensus.cc:697] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:45.288209 13428 consensus_queue.cc:237] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.289392  8891 raft_consensus.cc:2468] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:45.290977  8332 leader_election.cc:304] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.291678 13378 raft_consensus.cc:2804] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:45.292111 13378 raft_consensus.cc:697] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:45.292802 13378 consensus_queue.cc:237] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.297094 13423 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.297636 13423 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.299854 13423 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:45.301980  8862 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:45.307651  8863 leader_election.cc:336] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:45.308476  8862 leader_election.cc:336] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:45.308944  8862 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.310374 13423 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:45.320683 13378 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.321369 13378 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:45.329401  8332 leader_election.cc:336] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:45.332741 13378 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:45.338487  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6" is_pre_election: true
I20260709 13:03:45.339186  8891 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 11.
I20260709 13:03:45.343041  8113 catalog_manager.cc:5697] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 12 to 13, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 13 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.347282  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.348104 13428 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:45.348461 13428 raft_consensus.cc:493] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:45.348788 13428 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:45.364107 13428 raft_consensus.cc:515] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.367157  8113 catalog_manager.cc:5697] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 11 to 12, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 12 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.381378 13428 leader_election.cc:290] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Requested vote from peers ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859), 4a50f39e2d8e4886a79849938f2272a6 (127.6.236.4:42929)
I20260709 13:03:45.384832  8891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0cdb40f8b48a7a5b79a8bfe7c8fb6" candidate_uuid: "ee13752324154b1293a47c9dcd8d6ba5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4a50f39e2d8e4886a79849938f2272a6"
I20260709 13:03:45.396276  8891 raft_consensus.cc:3060] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:45.390339  8332 leader_election.cc:336] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:45.424912  8862 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:45.425968  8891 raft_consensus.cc:2468] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee13752324154b1293a47c9dcd8d6ba5 in term 12.
I20260709 13:03:45.430982  8332 leader_election.cc:304] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6, ee13752324154b1293a47c9dcd8d6ba5; no voters: ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:45.431793 13428 raft_consensus.cc:2804] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:45.432277 13428 raft_consensus.cc:697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Becoming Leader. State: Replica: ee13752324154b1293a47c9dcd8d6ba5, State: Running, Role: LEADER
I20260709 13:03:45.433068 13428 consensus_queue.cc:237] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:45.458437  8113 catalog_manager.cc:5697] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 reported cstate change: term changed from 11 to 12, leader changed from ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2) to ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3). New cstate: current_term: 12 leader_uuid: "ee13752324154b1293a47c9dcd8d6ba5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:45.476894  8331 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111) [suppressed 526 similar messages]
W20260709 13:03:45.495157  8331 consensus_peers.cc:597] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:45.506340  8331 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:45.592689  8862 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:45.600935  8331 consensus_peers.cc:597] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:45.628474  8362 raft_consensus.cc:1275] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Refusing update from remote peer 4a50f39e2d8e4886a79849938f2272a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:45.630710 13423 consensus_queue.cc:1048] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee13752324154b1293a47c9dcd8d6ba5" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:45.703903  8863 consensus_peers.cc:597] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:45.705775  8862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:41893, user_credentials={real_user=slave}} blocked reactor thread for 56534.5us
W20260709 13:03:45.731912  8331 consensus_peers.cc:597] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:45.769078  8891 raft_consensus.cc:1275] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:45.780661  8894 raft_consensus.cc:1275] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:03:45.781248  8332 consensus_peers.cc:597] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:45.782136  8332 consensus_peers.cc:597] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:45.796887 13400 consensus_queue.cc:1048] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:45.803731 13400 consensus_queue.cc:1048] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:45.808252  8862 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:45.831449  8894 raft_consensus.cc:1275] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:45.841574 13400 consensus_queue.cc:1048] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:45.860828  8862 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:45.871024  8332 consensus_peers.cc:597] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:45.919785  8332 consensus_peers.cc:597] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:45.922451  8863 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:45.934935  7088 tablet_server.cc:196] TabletServer@127.6.236.2:0 shutdown complete.
W20260709 13:03:45.972983  8331 consensus_peers.cc:597] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:45.974115  8332 consensus_peers.cc:597] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:45.978047  8894 raft_consensus.cc:1275] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Refusing update from remote peer ee13752324154b1293a47c9dcd8d6ba5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:45.979573 13378 consensus_queue.cc:1048] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:46.011439  8863 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.032984  8331 consensus_peers.cc:597] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:46.036305  8332 consensus_peers.cc:597] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.066176  8862 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:46.070449  8862 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:46.074584  7088 tablet_server.cc:179] TabletServer@127.6.236.3:0 shutting down...
W20260709 13:03:46.080865  8864 consensus_peers.cc:597] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.097975  8332 consensus_peers.cc:597] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.110782  8864 consensus_peers.cc:597] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.119261  8864 consensus_peers.cc:597] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.134032  8864 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.139336  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:46.140172  7088 tablet_replica.cc:333] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.140801  7088 raft_consensus.cc:2243] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.141391  7088 raft_consensus.cc:2272] T c777a0028400426e8927312e58b8d1c5 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.143694  7088 tablet_replica.cc:333] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.144533  7088 raft_consensus.cc:2243] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.145386  7088 raft_consensus.cc:2272] T 58573b7fd6d5467ea27aa5185d42aed7 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.147773  7088 tablet_replica.cc:333] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
W20260709 13:03:46.148387  8332 consensus_peers.cc:597] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:46.148546  7088 raft_consensus.cc:2243] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.149214  7088 raft_consensus.cc:2272] T 84f1d898d0e9492bbd25195dba3e62d4 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.151726  7088 tablet_replica.cc:333] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.152365  7088 raft_consensus.cc:2243] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.152927  7088 raft_consensus.cc:2272] T f6d613c8b7844e67ad3e2aa415a57d42 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.156267  7088 tablet_replica.cc:333] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.157053  7088 raft_consensus.cc:2243] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.158216  7088 raft_consensus.cc:2272] T 13996684f22f4504bbd9a98a387657e7 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.160211  7088 tablet_replica.cc:333] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.161055  7088 raft_consensus.cc:2243] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.161870  7088 raft_consensus.cc:2272] T ffe3e60c735644e380589d65b7850fd2 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.163856  7088 tablet_replica.cc:333] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.164386  7088 raft_consensus.cc:2243] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.165140  7088 raft_consensus.cc:2272] T 94f8a1b635cb4638922cb1dcf37e6e5b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.166742 13443 raft_consensus.cc:493] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:46.167339  7088 tablet_replica.cc:333] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.167291 13443 raft_consensus.cc:515] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:46.168236  7088 raft_consensus.cc:2243] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.169092  7088 raft_consensus.cc:2272] T 44115d987e9746a3b4f158acec40ce8f P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.171921  7088 tablet_replica.cc:333] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.172787  7088 raft_consensus.cc:2243] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:03:46.173333  8864 consensus_peers.cc:597] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.173732  7088 raft_consensus.cc:2272] T cc7fa1d719554be2a7a068962b4672d8 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.173779  8862 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:46.174904 13443 leader_election.cc:290] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:46.176604  7088 tablet_replica.cc:333] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.177258  7088 raft_consensus.cc:2243] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.177723  7088 raft_consensus.cc:2272] T fe403af31f9840f3b20788181ba23576 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.178930  8863 leader_election.cc:336] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:46.179399  8863 leader_election.cc:304] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:46.180094 13443 raft_consensus.cc:2749] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:46.180203  7088 tablet_replica.cc:333] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.181012  7088 raft_consensus.cc:2243] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.181716  7088 raft_consensus.cc:2272] T 3161be69a5b64eea9d078c61741b3db0 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.184053  7088 tablet_replica.cc:333] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.184638  7088 raft_consensus.cc:2243] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.185547  7088 raft_consensus.cc:2272] T 7d553c54f49c4cd1a7737e4136f02960 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.185915  8864 consensus_peers.cc:597] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.187805  7088 tablet_replica.cc:333] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.188469  7088 raft_consensus.cc:2243] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.189208  7088 raft_consensus.cc:2272] T 768b3b358c7c4b1fbbf348a322e1e144 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.190730  8864 consensus_peers.cc:597] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.191519  7088 tablet_replica.cc:333] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.192140  7088 raft_consensus.cc:2243] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.192919  7088 raft_consensus.cc:2272] T 9ab0986fac1e49b59f2c51d4cd50f2b8 P ee13752324154b1293a47c9dcd8d6ba5 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.194775  7088 tablet_replica.cc:333] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.195284  7088 raft_consensus.cc:2243] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.196007  7088 raft_consensus.cc:2272] T 028a77b252d249a6bef6c5f1f87a39e9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.198354  7088 tablet_replica.cc:333] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.198876  7088 raft_consensus.cc:2243] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.199473  7088 raft_consensus.cc:2272] T 60372205e52244a299cc381c5212f23b P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.201800  7088 tablet_replica.cc:333] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.202360  7088 raft_consensus.cc:2243] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.203241  7088 raft_consensus.cc:2272] T 3b137d34f34145b18037845635e297eb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.205011  7088 tablet_replica.cc:333] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.205567  7088 raft_consensus.cc:2243] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.206586  7088 raft_consensus.cc:2272] T c38bdb3838dd476fb824170ffe3fe5e2 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.209074  7088 tablet_replica.cc:333] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.209784  7088 raft_consensus.cc:2243] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.210928  7088 raft_consensus.cc:2272] T dd433d0931a84d969a77a1cd54cd32b5 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.213296  7088 tablet_replica.cc:333] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.213796  7088 raft_consensus.cc:2243] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.214576  7088 raft_consensus.cc:2272] T 410fe3c36e834265b4c3b139e453a76e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.216001  8862 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:46.216877  7088 tablet_replica.cc:333] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.217456  7088 raft_consensus.cc:2243] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.217955  7088 raft_consensus.cc:2272] T 893302ae4fac4d73945a8ad0a674a1e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.220255  7088 tablet_replica.cc:333] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.220789  7088 raft_consensus.cc:2243] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.221727  7088 raft_consensus.cc:2272] T be07a93f3c5547ebbcf1319de3133c06 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.223675  7088 tablet_replica.cc:333] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.224207  7088 raft_consensus.cc:2243] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.224648  7088 raft_consensus.cc:2272] T 7effd0faf2d846cea5b8e82ac737b7e5 P ee13752324154b1293a47c9dcd8d6ba5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.226852  7088 tablet_replica.cc:333] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.227563  7088 raft_consensus.cc:2243] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.228461  7088 raft_consensus.cc:2272] T a41c46760f54470bb49d3fd515fb4414 P ee13752324154b1293a47c9dcd8d6ba5 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.230261  8331 consensus_peers.cc:597] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:46.230764  7088 tablet_replica.cc:333] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.231333  7088 raft_consensus.cc:2243] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.232235  7088 raft_consensus.cc:2272] T 931eba945dfb4e34aae782648072e6ea P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.234519  7088 tablet_replica.cc:333] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.235108  7088 raft_consensus.cc:2243] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.235728  7088 raft_consensus.cc:2272] T 30a1960353b84e25a3e3faea11a1f4fb P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.238001  7088 tablet_replica.cc:333] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.238528  7088 raft_consensus.cc:2243] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.239358  7088 raft_consensus.cc:2272] T 8e3ae0ec4e2b4f60b8666dc0d97b4c1b P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.241300  7088 tablet_replica.cc:333] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.241824  7088 raft_consensus.cc:2243] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.242316  7088 raft_consensus.cc:2272] T fe6af4737faf47919cb8e012e72bb44e P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.244006  7088 tablet_replica.cc:333] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.244496  7088 raft_consensus.cc:2243] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.244962  7088 raft_consensus.cc:2272] T 2384ae06cadc456cb351a6dbe8483639 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.246742  7088 tablet_replica.cc:333] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.247241  7088 raft_consensus.cc:2243] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.247757  7088 raft_consensus.cc:2272] T b44a898a39ca4aef88c7fc182072ddac P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.249656  7088 tablet_replica.cc:333] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.250193  7088 raft_consensus.cc:2243] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.250978  7088 raft_consensus.cc:2272] T 73508a52a1594a38badce805866b753e P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.253350  7088 tablet_replica.cc:333] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.254048  7088 raft_consensus.cc:2243] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.256129  7088 raft_consensus.cc:2272] T c253a65d080e4e3f8185f6278cc7b6f9 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.259213  7088 tablet_replica.cc:333] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.259771  7088 raft_consensus.cc:2243] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.260577  7088 raft_consensus.cc:2272] T f676e8a33e184058b1fda69dd2836ce6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.262498  7088 tablet_replica.cc:333] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.263062  7088 raft_consensus.cc:2243] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.263890  7088 raft_consensus.cc:2272] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.266300  7088 tablet_replica.cc:333] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.266865  7088 raft_consensus.cc:2243] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.267369  7088 raft_consensus.cc:2272] T 6a377c652f93483693fc4684f03ffac4 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.269191  7088 tablet_replica.cc:333] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.270201  7088 raft_consensus.cc:2243] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.271060  7088 raft_consensus.cc:2272] T 9f17336652094c69a7e70a69b68a335d P ee13752324154b1293a47c9dcd8d6ba5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.273357  7088 tablet_replica.cc:333] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.273877  7088 raft_consensus.cc:2243] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.274339  7088 raft_consensus.cc:2272] T d7d3b2e6d3394d178e2db304c3767659 P ee13752324154b1293a47c9dcd8d6ba5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.276283  7088 tablet_replica.cc:333] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.276764  7088 raft_consensus.cc:2243] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.278353  7088 raft_consensus.cc:2272] T b3069684e0be469dba5b83137f0c4e62 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.280970  7088 tablet_replica.cc:333] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.281625  7088 raft_consensus.cc:2243] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.282559  7088 raft_consensus.cc:2272] T a28b8f6279ab44fcb0de6caac309a961 P ee13752324154b1293a47c9dcd8d6ba5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.284525  7088 tablet_replica.cc:333] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.284968  7088 raft_consensus.cc:2243] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.285677  7088 raft_consensus.cc:2272] T c8c00c17016841839312c823fcffaf82 P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.287364  7088 tablet_replica.cc:333] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.287896  7088 raft_consensus.cc:2243] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.288282  7088 raft_consensus.cc:2272] T f92a5d6830044936958a95556af24660 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.290032  7088 tablet_replica.cc:333] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.290483  7088 raft_consensus.cc:2243] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.290926  7088 raft_consensus.cc:2272] T d19654c841264233b661225cdb0ef14b P ee13752324154b1293a47c9dcd8d6ba5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.292663  7088 tablet_replica.cc:333] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.293560  7088 raft_consensus.cc:2243] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.294100  7088 raft_consensus.cc:2272] T 8fe31b6ada204d4fab7c4cbe1912fff6 P ee13752324154b1293a47c9dcd8d6ba5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.296036  7088 tablet_replica.cc:333] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.296501  7088 raft_consensus.cc:2243] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.296948  7088 raft_consensus.cc:2272] T 0545ed3bf21c4b3489c11d21d7796f22 P ee13752324154b1293a47c9dcd8d6ba5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.298727  7088 tablet_replica.cc:333] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5: stopping tablet replica
I20260709 13:03:46.299120  7088 raft_consensus.cc:2243] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.299603  7088 raft_consensus.cc:2272] T aee8a45d39bb4537bebf44a3d479ebd4 P ee13752324154b1293a47c9dcd8d6ba5 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:46.307337  8864 consensus_peers.cc:597] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.313030  8101 catalog_manager.cc:4755] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a41c46760f54470bb49d3fd515fb4414: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:46.328194  8864 consensus_peers.cc:597] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.329205  8862 consensus_peers.cc:597] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:46.344226  8863 consensus_peers.cc:597] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.358506  8863 consensus_peers.cc:597] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:46.437263 13443 raft_consensus.cc:493] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:46.437904 13443 raft_consensus.cc:515] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:46.440048 13443 leader_election.cc:290] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:46.444840  8863 leader_election.cc:336] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:46.445554  8862 leader_election.cc:336] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:46.445942  8862 leader_election.cc:304] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:46.446647 13443 raft_consensus.cc:2749] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:46.456223  8864 consensus_peers.cc:597] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:37337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.475643  8863 consensus_peers.cc:597] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:46.477897 13396 raft_consensus.cc:493] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:46.478499 13396 raft_consensus.cc:515] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:46.480619 13396 leader_election.cc:290] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:46.482563  8864 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:37337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.493238  8863 leader_election.cc:336] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:46.493866  8863 consensus_peers.cc:597] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.494571  8862 leader_election.cc:336] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:46.495081  8864 consensus_peers.cc:597] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:37337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.495018  8862 leader_election.cc:304] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:46.496055 13396 raft_consensus.cc:2749] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:46.504563  8864 consensus_peers.cc:597] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:37337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.522042  8864 consensus_peers.cc:597] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:37337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.524475 13396 raft_consensus.cc:493] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:46.524940 13396 raft_consensus.cc:515] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:46.526825 13396 leader_election.cc:290] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:46.530129  8862 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
W20260709 13:03:46.531616  8863 leader_election.cc:336] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:46.531942  8863 leader_election.cc:304] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:46.532500 13396 raft_consensus.cc:2749] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:46.541802  8864 consensus_peers.cc:597] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:37337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.594923  8863 consensus_peers.cc:597] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.606256  8864 consensus_peers.cc:597] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ee13752324154b1293a47c9dcd8d6ba5 (127.6.236.3:37337): Couldn't send request to peer ee13752324154b1293a47c9dcd8d6ba5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:37337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:46.653240  8862 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:46.656025 13396 raft_consensus.cc:493] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:46.666337 13396 raft_consensus.cc:515] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:46.668350 13396 leader_election.cc:290] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:46.673497  8863 leader_election.cc:336] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:46.676393  8862 leader_election.cc:336] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:46.676823  8862 leader_election.cc:304] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:46.677914 13396 raft_consensus.cc:2749] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:46.721834  8863 consensus_peers.cc:597] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Couldn't send request to peer ecc8d80ac6df4f5b95c8befae4d08ed0. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:46.731261  8862 consensus_peers.cc:597] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:46.816210  7088 tablet_server.cc:196] TabletServer@127.6.236.3:0 shutdown complete.
I20260709 13:03:46.898885 13396 raft_consensus.cc:493] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:46.900357 13396 raft_consensus.cc:515] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
W20260709 13:03:46.910708  8862 leader_election.cc:336] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:46.913331 13396 leader_election.cc:290] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:46.917639  8863 leader_election.cc:336] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
I20260709 13:03:46.918134  8863 leader_election.cc:304] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:46.918895 13396 raft_consensus.cc:2749] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:46.931468  7088 tablet_server.cc:179] TabletServer@127.6.236.4:0 shutting down...
I20260709 13:03:46.974977 13396 raft_consensus.cc:493] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:46.975811 13423 raft_consensus.cc:493] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecc8d80ac6df4f5b95c8befae4d08ed0)
I20260709 13:03:46.976706 13423 raft_consensus.cc:515] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:46.975860 13396 raft_consensus.cc:515] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca43983edda443fa9d74c1f80252f1fc" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 41893 } } peers { permanent_uuid: "ecc8d80ac6df4f5b95c8befae4d08ed0" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 39859 } } peers { permanent_uuid: "4a50f39e2d8e4886a79849938f2272a6" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 42929 } attrs { promote: false } }
I20260709 13:03:46.979744 13423 leader_election.cc:290] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
W20260709 13:03:46.980579  8862 consensus_peers.cc:597] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:46.981951 13396 leader_election.cc:290] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893), ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859)
I20260709 13:03:46.987977  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:46.988054  8863 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:46.988713  8863 leader_election.cc:336] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecc8d80ac6df4f5b95c8befae4d08ed0 (127.6.236.2:39859): Network error: Client connection negotiation failed: client connection to 127.6.236.2:39859: connect: Connection refused (error 111)
W20260709 13:03:46.989939  8862 leader_election.cc:336] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:46.990562  7088 tablet_replica.cc:333] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:46.990495  8862 leader_election.cc:304] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:46.991215 13396 raft_consensus.cc:2749] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:46.991313  7088 raft_consensus.cc:2243] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:03:46.991371  8862 leader_election.cc:336] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:46.991899  8862 leader_election.cc:304] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a50f39e2d8e4886a79849938f2272a6; no voters: ca43983edda443fa9d74c1f80252f1fc, ecc8d80ac6df4f5b95c8befae4d08ed0
I20260709 13:03:46.992364  7088 raft_consensus.cc:2272] T 410fe3c36e834265b4c3b139e453a76e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.992542 13396 raft_consensus.cc:2749] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:46.995081  7088 tablet_replica.cc:333] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:46.995949  7088 raft_consensus.cc:2243] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:46.996536  7088 raft_consensus.cc:2272] T 54b37780d9694d53a9aa75ce1f7515b4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.999331  7088 tablet_replica.cc:333] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.000051  7088 raft_consensus.cc:2243] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.001173  7088 raft_consensus.cc:2272] T c777a0028400426e8927312e58b8d1c5 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.003136  7088 tablet_replica.cc:333] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.003672  7088 raft_consensus.cc:2243] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.004129  7088 raft_consensus.cc:2272] T c38bdb3838dd476fb824170ffe3fe5e2 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.005961  7088 tablet_replica.cc:333] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.006685  7088 raft_consensus.cc:2243] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.007772  7088 raft_consensus.cc:2272] T b44a898a39ca4aef88c7fc182072ddac P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.010226  7088 tablet_replica.cc:333] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.011065  7088 raft_consensus.cc:2243] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.011693  7088 raft_consensus.cc:2272] T c1b1759fd5564511bf32b2e51ed1404c P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:47.012192  8862 consensus_peers.cc:597] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 -> Peer ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): Couldn't send request to peer ca43983edda443fa9d74c1f80252f1fc. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:47.013937  7088 tablet_replica.cc:333] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.014588  7088 raft_consensus.cc:2243] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.015067  7088 raft_consensus.cc:2272] T 3b137d34f34145b18037845635e297eb P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.017009  7088 tablet_replica.cc:333] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.017544  7088 raft_consensus.cc:2243] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.018395  7088 raft_consensus.cc:2272] T 44115d987e9746a3b4f158acec40ce8f P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.020233  7088 tablet_replica.cc:333] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.020761  7088 raft_consensus.cc:2243] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.021342  7088 raft_consensus.cc:2272] T 37fc7732f1124e04b9a47402ad544464 P 4a50f39e2d8e4886a79849938f2272a6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.023144  7088 tablet_replica.cc:333] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.023672  7088 raft_consensus.cc:2243] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.024422  7088 raft_consensus.cc:2272] T 84f1d898d0e9492bbd25195dba3e62d4 P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.026372  7088 tablet_replica.cc:333] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.026881  7088 raft_consensus.cc:2243] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.027341  7088 raft_consensus.cc:2272] T 8b6a07d8346e4fd5a54166e1cb3b1660 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.029235  7088 tablet_replica.cc:333] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.029769  7088 raft_consensus.cc:2243] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.030272  7088 raft_consensus.cc:2272] T 73508a52a1594a38badce805866b753e P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.032238  7088 tablet_replica.cc:333] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.032814  7088 raft_consensus.cc:2243] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.033308  7088 raft_consensus.cc:2272] T 0356bb50f97540f48a0cb08e1407eb57 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.035244  7088 tablet_replica.cc:333] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.035787  7088 raft_consensus.cc:2243] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.036190  7088 raft_consensus.cc:2272] T a41c46760f54470bb49d3fd515fb4414 P 4a50f39e2d8e4886a79849938f2272a6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.037976  7088 tablet_replica.cc:333] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.038530  7088 raft_consensus.cc:2243] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.038923  7088 raft_consensus.cc:2272] T 931eba945dfb4e34aae782648072e6ea P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.040627  7088 tablet_replica.cc:333] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.041145  7088 raft_consensus.cc:2243] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.041623  7088 raft_consensus.cc:2272] T 58573b7fd6d5467ea27aa5185d42aed7 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.043620  7088 tablet_replica.cc:333] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.044130  7088 raft_consensus.cc:2243] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.044804  7088 raft_consensus.cc:2272] T 0e16f2ade8444f2c95d17cae4d4654c2 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.046710  7088 tablet_replica.cc:333] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.047240  7088 raft_consensus.cc:2243] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.047672  7088 raft_consensus.cc:2272] T 9f17336652094c69a7e70a69b68a335d P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.049489  7088 tablet_replica.cc:333] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.050133  7088 raft_consensus.cc:2243] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.050892  7088 raft_consensus.cc:2272] T e437f18bf26d472eba0aa8ed4b920b7e P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.052660  7088 tablet_replica.cc:333] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.053158  7088 raft_consensus.cc:2243] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.053952  7088 raft_consensus.cc:2272] T 3161be69a5b64eea9d078c61741b3db0 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.055879  7088 tablet_replica.cc:333] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.056396  7088 raft_consensus.cc:2243] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.057149  7088 raft_consensus.cc:2272] T aee8a45d39bb4537bebf44a3d479ebd4 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.059142  7088 tablet_replica.cc:333] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.059675  7088 raft_consensus.cc:2243] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.060544  7088 raft_consensus.cc:2272] T f92a5d6830044936958a95556af24660 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.063011  7088 tablet_replica.cc:333] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.063732  7088 raft_consensus.cc:2243] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.064816  7088 raft_consensus.cc:2272] T d01b1e9908444e55b2b779bb7a18324a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.067122  7088 tablet_replica.cc:333] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.067674  7088 raft_consensus.cc:2243] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.068125  7088 raft_consensus.cc:2272] T b3069684e0be469dba5b83137f0c4e62 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.070093  7088 tablet_replica.cc:333] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.070776  7088 raft_consensus.cc:2243] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.071699  7088 raft_consensus.cc:2272] T 52604c43ccee4ddca5408d7cc08e134a P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.073593  7088 tablet_replica.cc:333] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.074120  7088 raft_consensus.cc:2243] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.074677  7088 raft_consensus.cc:2272] T 864d288163824eac975181159a2708d9 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.076443  7088 tablet_replica.cc:333] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.076917  7088 raft_consensus.cc:2243] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.077318  7088 raft_consensus.cc:2272] T f676e8a33e184058b1fda69dd2836ce6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.079073  7088 tablet_replica.cc:333] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.079628  7088 raft_consensus.cc:2243] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.080021  7088 raft_consensus.cc:2272] T 1fb0cdb40f8b48a7a5b79a8bfe7c8fb6 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.081840  7088 tablet_replica.cc:333] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.082520  7088 raft_consensus.cc:2243] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.083379  7088 raft_consensus.cc:2272] T 2384ae06cadc456cb351a6dbe8483639 P 4a50f39e2d8e4886a79849938f2272a6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.086126  7088 tablet_replica.cc:333] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.086828  7088 raft_consensus.cc:2243] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.087695  7088 raft_consensus.cc:2272] T 5b726723bee647ec82d162a5cf1a6515 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.089649  7088 tablet_replica.cc:333] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.090188  7088 raft_consensus.cc:2243] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.090685  7088 raft_consensus.cc:2272] T b139f81eea56438e9aba32ed1941dedb P 4a50f39e2d8e4886a79849938f2272a6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.092585  7088 tablet_replica.cc:333] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.093068  7088 raft_consensus.cc:2243] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.093478  7088 raft_consensus.cc:2272] T 7d553c54f49c4cd1a7737e4136f02960 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.095273  7088 tablet_replica.cc:333] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.095781  7088 raft_consensus.cc:2243] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.096299  7088 raft_consensus.cc:2272] T 13996684f22f4504bbd9a98a387657e7 P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.098227  7088 tablet_replica.cc:333] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.098851  7088 raft_consensus.cc:2243] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.099673  7088 raft_consensus.cc:2272] T 893302ae4fac4d73945a8ad0a674a1e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.101905  7088 tablet_replica.cc:333] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.102437  7088 raft_consensus.cc:2243] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.103439  7088 raft_consensus.cc:2272] T c8c00c17016841839312c823fcffaf82 P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.105966  7088 tablet_replica.cc:333] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.106552  7088 raft_consensus.cc:2243] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.107379  7088 raft_consensus.cc:2272] T 0545ed3bf21c4b3489c11d21d7796f22 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.109547  7088 tablet_replica.cc:333] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.110059  7088 raft_consensus.cc:2243] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.110577  7088 raft_consensus.cc:2272] T d8e2862cbf8e4bfdb5395396ea06c348 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.112370  7088 tablet_replica.cc:333] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.112826  7088 raft_consensus.cc:2243] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.113227  7088 raft_consensus.cc:2272] T 94f8a1b635cb4638922cb1dcf37e6e5b P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.114997  7088 tablet_replica.cc:333] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.115465  7088 raft_consensus.cc:2243] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.116204  7088 raft_consensus.cc:2272] T d19654c841264233b661225cdb0ef14b P 4a50f39e2d8e4886a79849938f2272a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.118108  7088 tablet_replica.cc:333] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.118643  7088 raft_consensus.cc:2243] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.119395  7088 raft_consensus.cc:2272] T 8fe31b6ada204d4fab7c4cbe1912fff6 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.121312  7088 tablet_replica.cc:333] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.121759  7088 raft_consensus.cc:2243] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.122612  7088 raft_consensus.cc:2272] T f6d613c8b7844e67ad3e2aa415a57d42 P 4a50f39e2d8e4886a79849938f2272a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.124501  7088 tablet_replica.cc:333] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.124977  7088 raft_consensus.cc:2243] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:47.125694  7088 raft_consensus.cc:2272] T 7effd0faf2d846cea5b8e82ac737b7e5 P 4a50f39e2d8e4886a79849938f2272a6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.127493  7088 tablet_replica.cc:333] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.127918  7088 raft_consensus.cc:2243] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.128345  7088 raft_consensus.cc:2272] T 457d66c5ca7c4163a642765639bc4f3d P 4a50f39e2d8e4886a79849938f2272a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.130025  7088 tablet_replica.cc:333] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6: stopping tablet replica
I20260709 13:03:47.130463  7088 raft_consensus.cc:2243] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:47.130872  7088 raft_consensus.cc:2272] T ffe3e60c735644e380589d65b7850fd2 P 4a50f39e2d8e4886a79849938f2272a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:47.618134  7088 tablet_server.cc:196] TabletServer@127.6.236.4:0 shutdown complete.
I20260709 13:03:47.692909  7088 master.cc:562] Master@127.6.236.62:39147 shutting down...
W20260709 13:03:47.727372  8164 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:47.727676  8164 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:47.727882  8164 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:50.451928  8101 catalog_manager.cc:4755] TS ca43983edda443fa9d74c1f80252f1fc (127.6.236.1:41893): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a41c46760f54470bb49d3fd515fb4414: Network error: Client connection negotiation failed: client connection to 127.6.236.1:41893: connect: Connection refused (error 111)
I20260709 13:03:50.609318  7088 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.611629  7088 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.612043  7088 tablet_replica.cc:333] T 00000000000000000000000000000000 P 49ab8a0cd4ae4427b46500594085b384: stopping tablet replica
I20260709 13:03:50.810652  7088 master.cc:584] Master@127.6.236.62:39147 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (173809 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:03:50.927816  7088 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.236.62:37525
I20260709 13:03:50.928987  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:50.935845 13451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.935935 13452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.936239 13454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:50.937527  7088 server_base.cc:1061] running on GCE node
I20260709 13:03:50.940269  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:50.940490  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:50.940614  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602230940602 us; error 0 us; skew 500 ppm
I20260709 13:03:50.941121  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:50.943599  7088 webserver.cc:533] Webserver started at http://127.6.236.62:40067/ using document root <none> and password file <none>
I20260709 13:03:50.944061  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:50.944213  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:50.944437  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:50.945644  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/master-0-root/instance:
uuid: "8b4a5002f9c84c33adf22ac6ab2d36da"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-j4mc"
I20260709 13:03:50.950567  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:03:50.954030 13459 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.954977  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:03:50.955265  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/master-0-root
uuid: "8b4a5002f9c84c33adf22ac6ab2d36da"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-j4mc"
I20260709 13:03:50.955560  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:50.986131  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:50.987397  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:51.027596  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.62:37525
I20260709 13:03:51.027733 13510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.62:37525 every 8 connection(s)
I20260709 13:03:51.031610 13511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.042398 13511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da: Bootstrap starting.
I20260709 13:03:51.047291 13511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.051455 13511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da: No bootstrap required, opened a new log
I20260709 13:03:51.053596 13511 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4a5002f9c84c33adf22ac6ab2d36da" member_type: VOTER }
I20260709 13:03:51.054040 13511 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.054279 13511 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4a5002f9c84c33adf22ac6ab2d36da, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.054849 13511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4a5002f9c84c33adf22ac6ab2d36da" member_type: VOTER }
I20260709 13:03:51.055269 13511 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:51.055461 13511 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:51.055670 13511 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.060230 13511 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4a5002f9c84c33adf22ac6ab2d36da" member_type: VOTER }
I20260709 13:03:51.060716 13511 leader_election.cc:304] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b4a5002f9c84c33adf22ac6ab2d36da; no voters: 
I20260709 13:03:51.061784 13511 leader_election.cc:290] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:51.062105 13514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.063381 13514 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 1 LEADER]: Becoming Leader. State: Replica: 8b4a5002f9c84c33adf22ac6ab2d36da, State: Running, Role: LEADER
I20260709 13:03:51.064073 13514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4a5002f9c84c33adf22ac6ab2d36da" member_type: VOTER }
I20260709 13:03:51.064555 13511 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:51.070510 13515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b4a5002f9c84c33adf22ac6ab2d36da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4a5002f9c84c33adf22ac6ab2d36da" member_type: VOTER } }
I20260709 13:03:51.070369 13516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b4a5002f9c84c33adf22ac6ab2d36da. Latest consensus state: current_term: 1 leader_uuid: "8b4a5002f9c84c33adf22ac6ab2d36da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4a5002f9c84c33adf22ac6ab2d36da" member_type: VOTER } }
I20260709 13:03:51.071168 13515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:51.071380 13516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:51.073236 13523 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:51.077950 13523 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:51.080304  7088 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:51.087924 13523 catalog_manager.cc:1383] Generated new cluster ID: 710558d79ee34138b2f7f625db7fab5d
I20260709 13:03:51.088245 13523 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:51.104175 13523 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:51.105489 13523 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:51.129804 13523 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da: Generated new TSK 0
I20260709 13:03:51.130481 13523 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:51.147137  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:51.155347 13533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.155752 13532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.157490  7088 server_base.cc:1061] running on GCE node
W20260709 13:03:51.158192 13535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.159862  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:51.160049  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:51.160171  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602231160159 us; error 0 us; skew 500 ppm
I20260709 13:03:51.160646  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:51.162937  7088 webserver.cc:533] Webserver started at http://127.6.236.1:42637/ using document root <none> and password file <none>
I20260709 13:03:51.163396  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:51.163558  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:51.163769  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:51.164884  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/instance:
uuid: "816d755a8270492d88dac41d1d303c68"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:03:51.169611  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:03:51.173121 13540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.173985  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:51.174340  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "816d755a8270492d88dac41d1d303c68"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:03:51.174768  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:51.200682  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:51.201915  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:51.203509  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:51.206167  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:51.206385  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.206609  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:51.206774  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.249854  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:40147
I20260709 13:03:51.249971 13602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:40147 every 8 connection(s)
I20260709 13:03:51.255041  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:51.263010 13607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.264701 13608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.266556 13610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.267597  7088 server_base.cc:1061] running on GCE node
I20260709 13:03:51.269415  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:51.269629  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:51.269814  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602231269796 us; error 0 us; skew 500 ppm
I20260709 13:03:51.270491  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:51.271997 13603 heartbeater.cc:344] Connected to a master server at 127.6.236.62:37525
I20260709 13:03:51.272408 13603 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:51.273424 13603 heartbeater.cc:507] Master 127.6.236.62:37525 requested a full tablet report, sending...
I20260709 13:03:51.273821  7088 webserver.cc:533] Webserver started at http://127.6.236.2:36415/ using document root <none> and password file <none>
I20260709 13:03:51.274588  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:51.274787  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:51.275102  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:51.276072 13476 ts_manager.cc:194] Registered new tserver with Master: 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:51.276371  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/instance:
uuid: "e3683af201ac41948aaa81cea02de029"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:03:51.277908 13476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58030
I20260709 13:03:51.281543  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:03:51.285303 13615 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.286407  7088 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:51.286885  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-1-root
uuid: "e3683af201ac41948aaa81cea02de029"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:03:51.287348  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:51.305788  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:51.307032  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:51.308681  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:51.311295  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:51.311517  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.311738  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:51.311887  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.353722  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.2:37455
I20260709 13:03:51.353821 13677 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.2:37455 every 8 connection(s)
I20260709 13:03:51.358554  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:51.367139 13681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.372428 13682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.372745 13678 heartbeater.cc:344] Connected to a master server at 127.6.236.62:37525
I20260709 13:03:51.373281 13678 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:51.374321 13678 heartbeater.cc:507] Master 127.6.236.62:37525 requested a full tablet report, sending...
W20260709 13:03:51.375695 13684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.376612 13476 ts_manager.cc:194] Registered new tserver with Master: e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:51.378116 13476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58036
I20260709 13:03:51.378436  7088 server_base.cc:1061] running on GCE node
I20260709 13:03:51.379559  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:51.379769  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:51.379935  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602231379916 us; error 0 us; skew 500 ppm
I20260709 13:03:51.380435  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:51.382825  7088 webserver.cc:533] Webserver started at http://127.6.236.3:45639/ using document root <none> and password file <none>
I20260709 13:03:51.383327  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:51.383508  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:51.383749  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:51.384963  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/instance:
uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:03:51.389272  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:51.392657 13689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.393433  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:51.393777  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-2-root
uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:03:51.394062  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:51.411764  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:51.412948  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:51.414412  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:51.416735  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:51.416939  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.417158  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:51.417308  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.459029  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.3:45411
I20260709 13:03:51.459115 13751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.3:45411 every 8 connection(s)
I20260709 13:03:51.463814  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:51.470484 13755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.471407 13756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.473480  7088 server_base.cc:1061] running on GCE node
W20260709 13:03:51.474432 13758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.475250 13752 heartbeater.cc:344] Connected to a master server at 127.6.236.62:37525
I20260709 13:03:51.475407  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:51.475601 13752 heartbeater.cc:461] Registering TS with master...
W20260709 13:03:51.475705  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:51.475976  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602231475961 us; error 0 us; skew 500 ppm
I20260709 13:03:51.476588  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:51.476594 13752 heartbeater.cc:507] Master 127.6.236.62:37525 requested a full tablet report, sending...
I20260709 13:03:51.478863 13476 ts_manager.cc:194] Registered new tserver with Master: fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:51.479311  7088 webserver.cc:533] Webserver started at http://127.6.236.4:37617/ using document root <none> and password file <none>
I20260709 13:03:51.479816  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:51.479996  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:51.480230  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:51.480248 13476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58050
I20260709 13:03:51.481484  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-3-root/instance:
uuid: "da3d66493d2f419fb8eda6491ce13df0"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:03:51.485749  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:03:51.489236 13763 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.489974  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:51.490311  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-3-root
uuid: "da3d66493d2f419fb8eda6491ce13df0"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:03:51.490624  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:51.530761  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:51.532485  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:51.534488  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:51.537753  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:51.538026  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.538348  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:51.538595  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.581854  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.4:45577
I20260709 13:03:51.581948 13825 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.4:45577 every 8 connection(s)
I20260709 13:03:51.596165 13826 heartbeater.cc:344] Connected to a master server at 127.6.236.62:37525
I20260709 13:03:51.596541 13826 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:51.597323 13826 heartbeater.cc:507] Master 127.6.236.62:37525 requested a full tablet report, sending...
I20260709 13:03:51.599296 13476 ts_manager.cc:194] Registered new tserver with Master: da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:51.600298  7088 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015093982s
I20260709 13:03:51.600672 13476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58054
I20260709 13:03:51.628167 13476 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58066:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:03:51.870654 13713 tablet_service.cc:1511] Processing CreateTablet for tablet d381a014c4f543909a33453b71bff652 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:51.872303 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d381a014c4f543909a33453b71bff652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.872539 13715 tablet_service.cc:1511] Processing CreateTablet for tablet 320e88d5ea5446bf95970895e068d9b5 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:51.875294 13714 tablet_service.cc:1511] Processing CreateTablet for tablet 40fef40743044169b7338f2d22113320 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:51.875684 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 225960baa6af41d187116bada579f2f4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:51.876617 13715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320e88d5ea5446bf95970895e068d9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.877790 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225960baa6af41d187116bada579f2f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.871161 13716 tablet_service.cc:1511] Processing CreateTablet for tablet bc89eeba61904cf58fc52c2ef8809a70 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:51.877509 13717 tablet_service.cc:1511] Processing CreateTablet for tablet d44b221b69f84c5b92e7df2779fa16dc (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:51.878993 13716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc89eeba61904cf58fc52c2ef8809a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.879643 13566 tablet_service.cc:1511] Processing CreateTablet for tablet e32f0a6ac7f748819c2a4796bb279d80 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:51.879858 13567 tablet_service.cc:1511] Processing CreateTablet for tablet bc89eeba61904cf58fc52c2ef8809a70 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:51.881019 13566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32f0a6ac7f748819c2a4796bb279d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.882210 13564 tablet_service.cc:1511] Processing CreateTablet for tablet 93d68fc7290844b39bac589ab8ce83a3 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:51.883071 13717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44b221b69f84c5b92e7df2779fa16dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.883694 13564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d68fc7290844b39bac589ab8ce83a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.883381 13563 tablet_service.cc:1511] Processing CreateTablet for tablet d381a014c4f543909a33453b71bff652 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:51.884675 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d381a014c4f543909a33453b71bff652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.882197 13568 tablet_service.cc:1511] Processing CreateTablet for tablet d44b221b69f84c5b92e7df2779fa16dc (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:51.886016 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44b221b69f84c5b92e7df2779fa16dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.887384 13562 tablet_service.cc:1511] Processing CreateTablet for tablet f8e9ad8a90dd49fcbe84e5a6fd2cca45 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:51.888770 13562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e9ad8a90dd49fcbe84e5a6fd2cca45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.889989 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fef40743044169b7338f2d22113320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.890509 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc89eeba61904cf58fc52c2ef8809a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.881034 13565 tablet_service.cc:1511] Processing CreateTablet for tablet 40fef40743044169b7338f2d22113320 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:51.895411 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fef40743044169b7338f2d22113320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.929893 13711 tablet_service.cc:1511] Processing CreateTablet for tablet f8e9ad8a90dd49fcbe84e5a6fd2cca45 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:51.931541 13711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e9ad8a90dd49fcbe84e5a6fd2cca45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.950915 13846 tablet_bootstrap.cc:492] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:51.980428 13846 tablet_bootstrap.cc:654] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.983857 13847 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:51.996381 13563 tablet_service.cc:1511] Processing CreateTablet for tablet d226b35af23040529bd02af17994d615 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:51.997857 13847 tablet_bootstrap.cc:654] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.999770 13642 tablet_service.cc:1511] Processing CreateTablet for tablet e32f0a6ac7f748819c2a4796bb279d80 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:51.997890 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d226b35af23040529bd02af17994d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.001142 13642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32f0a6ac7f748819c2a4796bb279d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.004021 13641 tablet_service.cc:1511] Processing CreateTablet for tablet 320e88d5ea5446bf95970895e068d9b5 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:52.005695 13641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320e88d5ea5446bf95970895e068d9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.007467 13640 tablet_service.cc:1511] Processing CreateTablet for tablet 40fef40743044169b7338f2d22113320 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:52.010236 13639 tablet_service.cc:1511] Processing CreateTablet for tablet 93d68fc7290844b39bac589ab8ce83a3 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:52.015501 13643 tablet_service.cc:1511] Processing CreateTablet for tablet bc89eeba61904cf58fc52c2ef8809a70 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:52.019871 13638 tablet_service.cc:1511] Processing CreateTablet for tablet 225960baa6af41d187116bada579f2f4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:52.023015 13788 tablet_service.cc:1511] Processing CreateTablet for tablet 93d68fc7290844b39bac589ab8ce83a3 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:52.023452 13791 tablet_service.cc:1511] Processing CreateTablet for tablet d44b221b69f84c5b92e7df2779fa16dc (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:52.024653 13788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d68fc7290844b39bac589ab8ce83a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.026111 13790 tablet_service.cc:1511] Processing CreateTablet for tablet e32f0a6ac7f748819c2a4796bb279d80 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:52.027706 13790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32f0a6ac7f748819c2a4796bb279d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.031415 13789 tablet_service.cc:1511] Processing CreateTablet for tablet 320e88d5ea5446bf95970895e068d9b5 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:52.032979 13789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320e88d5ea5446bf95970895e068d9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.035400 13787 tablet_service.cc:1511] Processing CreateTablet for tablet d381a014c4f543909a33453b71bff652 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:52.038122 13785 tablet_service.cc:1511] Processing CreateTablet for tablet d226b35af23040529bd02af17994d615 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:52.040570 13786 tablet_service.cc:1511] Processing CreateTablet for tablet 225960baa6af41d187116bada579f2f4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:52.013754 13637 tablet_service.cc:1511] Processing CreateTablet for tablet f8e9ad8a90dd49fcbe84e5a6fd2cca45 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:52.043174 13846 tablet_bootstrap.cc:492] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:52.043766 13846 ts_tablet_manager.cc:1403] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.000s
I20260709 13:03:52.044473 13637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e9ad8a90dd49fcbe84e5a6fd2cca45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.045123 13640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fef40743044169b7338f2d22113320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.045783 13639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d68fc7290844b39bac589ab8ce83a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.047474 13846 raft_consensus.cc:359] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:52.048341 13846 raft_consensus.cc:385] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.048642 13846 raft_consensus.cc:740] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.043715 13636 tablet_service.cc:1511] Processing CreateTablet for tablet d226b35af23040529bd02af17994d615 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:52.049770 13638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225960baa6af41d187116bada579f2f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.049510 13846 consensus_queue.cc:260] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:52.050414 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc89eeba61904cf58fc52c2ef8809a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.043190 13847 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:52.051633 13847 ts_tablet_manager.cc:1403] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.068s	user 0.038s	sys 0.012s
I20260709 13:03:52.053520 13636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d226b35af23040529bd02af17994d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.055029 13847 raft_consensus.cc:359] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.055852 13847 raft_consensus.cc:385] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.056159 13847 raft_consensus.cc:740] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.057004 13847 consensus_queue.cc:260] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.057765 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d381a014c4f543909a33453b71bff652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.062444 13785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d226b35af23040529bd02af17994d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.066447 13786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225960baa6af41d187116bada579f2f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.070407 13791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44b221b69f84c5b92e7df2779fa16dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.071154 13714 tablet_service.cc:1511] Processing CreateTablet for tablet e1c0cb319af54e149630d921dcb04084 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:52.072459 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c0cb319af54e149630d921dcb04084. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:52.076279 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:52.111996 13784 tablet_service.cc:1511] Processing CreateTablet for tablet e1c0cb319af54e149630d921dcb04084 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:52.113387 13784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c0cb319af54e149630d921dcb04084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.146186 13563 tablet_service.cc:1511] Processing CreateTablet for tablet e1c0cb319af54e149630d921dcb04084 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:52.147719 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c0cb319af54e149630d921dcb04084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.170858 13635 tablet_service.cc:1511] Processing CreateTablet for tablet 30707476881c44db89b44a8a2e812372 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:52.172361 13635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30707476881c44db89b44a8a2e812372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.182150 13850 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:52.187080 13603 heartbeater.cc:499] Master 127.6.236.62:37525 was elected leader, sending a full tablet report...
I20260709 13:03:52.187548 13847 ts_tablet_manager.cc:1434] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.136s	user 0.032s	sys 0.036s
I20260709 13:03:52.188666 13847 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:52.189170 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 30707476881c44db89b44a8a2e812372 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:52.190587 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30707476881c44db89b44a8a2e812372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.199226 13847 tablet_bootstrap.cc:654] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.211113 13752 heartbeater.cc:499] Master 127.6.236.62:37525 was elected leader, sending a full tablet report...
I20260709 13:03:52.211640 13846 ts_tablet_manager.cc:1434] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.167s	user 0.029s	sys 0.049s
I20260709 13:03:52.212955 13846 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
W20260709 13:03:52.213372 13753 tablet.cc:2406] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:52.219739 13846 tablet_bootstrap.cc:654] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.222543 13847 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:52.223608 13847 ts_tablet_manager.cc:1403] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.006s
I20260709 13:03:52.227139 13847 raft_consensus.cc:359] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.228032 13847 raft_consensus.cc:385] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.228389 13847 raft_consensus.cc:740] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.229467 13847 consensus_queue.cc:260] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.231981 13847 ts_tablet_manager.cc:1434] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:03:52.232527 13790 tablet_service.cc:1511] Processing CreateTablet for tablet 30707476881c44db89b44a8a2e812372 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:52.233240 13847 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:52.237495 13563 tablet_service.cc:1511] Processing CreateTablet for tablet 00c0045f00654855a3d672f639e01b17 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:52.238963 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c0045f00654855a3d672f639e01b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.241139 13847 tablet_bootstrap.cc:654] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.251309 13852 raft_consensus.cc:493] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.252018 13852 raft_consensus.cc:515] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.254439 13847 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:52.255009 13847 ts_tablet_manager.cc:1403] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:03:52.258241 13847 raft_consensus.cc:359] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.258988 13847 raft_consensus.cc:385] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.259305 13847 raft_consensus.cc:740] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.259459 13853 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:52.262948 13847 consensus_queue.cc:260] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.261524 13641 tablet_service.cc:1511] Processing CreateTablet for tablet 00c0045f00654855a3d672f639e01b17 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:52.266677 13641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c0045f00654855a3d672f639e01b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.268924 13847 ts_tablet_manager.cc:1434] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:03:52.270004 13847 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:52.276203 13847 tablet_bootstrap.cc:654] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.286685 13852 leader_election.cc:290] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:52.291932 13850 tablet_bootstrap.cc:654] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.300288 13790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30707476881c44db89b44a8a2e812372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.301192 13714 tablet_service.cc:1511] Processing CreateTablet for tablet 00c0045f00654855a3d672f639e01b17 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:52.306005 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c0045f00654855a3d672f639e01b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.309345 13853 tablet_bootstrap.cc:654] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.302706 13791 tablet_service.cc:1511] Processing CreateTablet for tablet 87ba941f0f3547dab9f990d24133749f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:52.303617 13563 tablet_service.cc:1511] Processing CreateTablet for tablet 87ba941f0f3547dab9f990d24133749f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:52.317782 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 87ba941f0f3547dab9f990d24133749f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:52.318326 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ba941f0f3547dab9f990d24133749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.319213 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ba941f0f3547dab9f990d24133749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.331379 13791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ba941f0f3547dab9f990d24133749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.341427 13712 tablet_service.cc:1511] Processing CreateTablet for tablet b5c13150952941e18c09fb91de8dbaa7 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:52.342016 13785 tablet_service.cc:1511] Processing CreateTablet for tablet b5c13150952941e18c09fb91de8dbaa7 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:52.344697 13852 raft_consensus.cc:493] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.346525 13852 raft_consensus.cc:515] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.346891 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c13150952941e18c09fb91de8dbaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.348730 13852 leader_election.cc:290] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:52.346891 13785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c13150952941e18c09fb91de8dbaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.358784 13847 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:52.359344 13847 ts_tablet_manager.cc:1403] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.033s
I20260709 13:03:52.359390 13846 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:52.360093 13846 ts_tablet_manager.cc:1403] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.148s	user 0.036s	sys 0.060s
I20260709 13:03:52.362802 13847 raft_consensus.cc:359] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.363495 13846 raft_consensus.cc:359] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.367345 13853 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:52.363832 13847 raft_consensus.cc:385] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.368032 13853 ts_tablet_manager.cc:1403] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.109s	user 0.007s	sys 0.011s
I20260709 13:03:52.368739 13850 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:52.368498 13847 raft_consensus.cc:740] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.369274 13850 ts_tablet_manager.cc:1403] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.188s	user 0.016s	sys 0.003s
I20260709 13:03:52.369853 13847 consensus_queue.cc:260] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.371454 13853 raft_consensus.cc:359] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.371871 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:52.372310 13853 raft_consensus.cc:385] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.368489 13562 tablet_service.cc:1511] Processing CreateTablet for tablet b5c13150952941e18c09fb91de8dbaa7 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:52.373498 13562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c13150952941e18c09fb91de8dbaa7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:52.373806 13541 leader_election.cc:343] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.364702 13846 raft_consensus.cc:385] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.372663 13853 raft_consensus.cc:740] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.380393 13853 consensus_queue.cc:260] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.381070 13678 heartbeater.cc:499] Master 127.6.236.62:37525 was elected leader, sending a full tablet report...
I20260709 13:03:52.390563 13641 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1234620eb0424eb5ab654a8bb1dac9 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:52.391986 13641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1234620eb0424eb5ab654a8bb1dac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.394054 13789 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1234620eb0424eb5ab654a8bb1dac9 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:52.395430 13789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1234620eb0424eb5ab654a8bb1dac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.395520 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 5e95a37a01c349a08590fc8b4e1a355a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:52.397045 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e95a37a01c349a08590fc8b4e1a355a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.397898 13713 tablet_service.cc:1511] Processing CreateTablet for tablet 5e95a37a01c349a08590fc8b4e1a355a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:52.399319 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e95a37a01c349a08590fc8b4e1a355a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.400035 13787 tablet_service.cc:1511] Processing CreateTablet for tablet c288c22a5bfd4771bddaaf7a39264407 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:52.403218 13640 tablet_service.cc:1511] Processing CreateTablet for tablet 5e95a37a01c349a08590fc8b4e1a355a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:52.405630 13565 tablet_service.cc:1511] Processing CreateTablet for tablet c288c22a5bfd4771bddaaf7a39264407 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:52.407020 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c288c22a5bfd4771bddaaf7a39264407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.410408 13640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e95a37a01c349a08590fc8b4e1a355a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.379410 13846 raft_consensus.cc:740] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.414582 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:52.413949 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:52.418756 13542 leader_election.cc:343] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:52.419480 13542 leader_election.cc:343] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.419883 13542 leader_election.cc:304] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:52.421255 13852 raft_consensus.cc:2749] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.422287 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c288c22a5bfd4771bddaaf7a39264407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.412632 13846 consensus_queue.cc:260] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.429600 13846 ts_tablet_manager.cc:1434] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:03:52.430902 13846 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:52.433822 13847 ts_tablet_manager.cc:1434] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 13:03:52.427165 13714 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1234620eb0424eb5ab654a8bb1dac9 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:52.437309 13850 raft_consensus.cc:359] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.440305 13847 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:52.441264 13850 raft_consensus.cc:385] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.443009 13850 raft_consensus.cc:740] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.443929 13850 consensus_queue.cc:260] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.445240 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1234620eb0424eb5ab654a8bb1dac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.440986 13853 ts_tablet_manager.cc:1434] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.073s	user 0.023s	sys 0.023s
I20260709 13:03:52.451139 13853 tablet_bootstrap.cc:492] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:52.454386 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:52.455174 13653 raft_consensus.cc:2468] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:52.456703 13543 leader_election.cc:304] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:52.457657 13852 raft_consensus.cc:2804] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.458040 13852 raft_consensus.cc:493] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.458398 13852 raft_consensus.cc:3060] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.461874 13853 tablet_bootstrap.cc:654] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.479310 13846 tablet_bootstrap.cc:654] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.465694 13852 raft_consensus.cc:515] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.490165 13643 tablet_service.cc:1511] Processing CreateTablet for tablet c288c22a5bfd4771bddaaf7a39264407 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:52.490808 13852 leader_election.cc:290] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:52.491433 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:52.493438 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:52.494014 13653 raft_consensus.cc:3060] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.499338 13847 tablet_bootstrap.cc:654] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.501590 13653 raft_consensus.cc:2468] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
W20260709 13:03:52.502413 13542 leader_election.cc:343] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.503553 13852 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.503789 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c288c22a5bfd4771bddaaf7a39264407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.504106 13852 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.507718 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:52.508338 13801 raft_consensus.cc:2468] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:52.509672 13542 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:52.510603 13857 raft_consensus.cc:2804] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.510954 13857 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.511251 13857 raft_consensus.cc:3060] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.516428 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd55ddae5c64d3a9093174906446c68 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:52.517771 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd55ddae5c64d3a9093174906446c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.518590 13857 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.522828 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:52.523501 13801 raft_consensus.cc:3060] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.529536 13789 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd55ddae5c64d3a9093174906446c68 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:52.531169 13789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd55ddae5c64d3a9093174906446c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.533749 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
W20260709 13:03:52.535569 13543 leader_election.cc:343] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.535712 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd55ddae5c64d3a9093174906446c68 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:52.536198 13857 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:52.536816 13801 raft_consensus.cc:2468] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:52.537191 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd55ddae5c64d3a9093174906446c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.538098 13542 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:52.539382 13857 raft_consensus.cc:2804] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.541146 13851 raft_consensus.cc:493] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.541710 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:52.541631 13851 raft_consensus.cc:515] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
W20260709 13:03:52.543357 13543 leader_election.cc:343] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.543907 13852 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:52.546279 13851 leader_election.cc:290] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:52.546670 13857 raft_consensus.cc:697] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:52.546782 13851 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.547240 13851 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.547591 13857 consensus_queue.cc:237] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.563690 13853 tablet_bootstrap.cc:492] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:52.564348 13853 ts_tablet_manager.cc:1403] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.113s	user 0.052s	sys 0.048s
I20260709 13:03:52.564397 13851 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:52.568089 13853 raft_consensus.cc:359] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:52.568913 13853 raft_consensus.cc:385] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.569305 13853 raft_consensus.cc:740] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.570329 13853 consensus_queue.cc:260] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:52.579555 13853 ts_tablet_manager.cc:1434] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:03:52.579357 13474 catalog_manager.cc:5697] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.569099 13847 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:52.586048 13847 ts_tablet_manager.cc:1403] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.001s
I20260709 13:03:52.587182 13543 leader_election.cc:304] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:52.587651 13853 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:52.588582 13857 raft_consensus.cc:2804] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.589774 13826 heartbeater.cc:499] Master 127.6.236.62:37525 was elected leader, sending a full tablet report...
I20260709 13:03:52.594729 13853 tablet_bootstrap.cc:654] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.596078 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:52.597702 13691 leader_election.cc:343] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.600607 13857 raft_consensus.cc:697] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:52.601572 13857 consensus_queue.cc:237] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.601979 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:52.603838 13692 leader_election.cc:343] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.604570 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:52.605495 13850 ts_tablet_manager.cc:1434] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.236s	user 0.014s	sys 0.005s
W20260709 13:03:52.605921 13692 leader_election.cc:343] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.606557 13850 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:52.606400 13692 leader_election.cc:304] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:52.607594 13851 raft_consensus.cc:2749] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.610245 13641 tablet_service.cc:1511] Processing CreateTablet for tablet fe580baf6e25431f8421912ec7fcc66f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:52.611660 13641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe580baf6e25431f8421912ec7fcc66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.616794 13847 raft_consensus.cc:359] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.617538 13847 raft_consensus.cc:385] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.618052 13847 raft_consensus.cc:740] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.625869 13847 consensus_queue.cc:260] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.627943 13850 tablet_bootstrap.cc:654] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.629545 13857 raft_consensus.cc:493] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.630290 13857 raft_consensus.cc:515] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.637758 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:52.640213 13542 leader_election.cc:343] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.641278 13847 ts_tablet_manager.cc:1434] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.005s
I20260709 13:03:52.645620 13847 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:52.646416 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:03:52.647890 13541 leader_election.cc:343] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.648340 13541 leader_election.cc:304] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:52.639451 13857 leader_election.cc:290] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:52.649255 13852 raft_consensus.cc:2749] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.650357 13714 tablet_service.cc:1511] Processing CreateTablet for tablet fe580baf6e25431f8421912ec7fcc66f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:52.651731 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe580baf6e25431f8421912ec7fcc66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.651497 13787 tablet_service.cc:1511] Processing CreateTablet for tablet fe580baf6e25431f8421912ec7fcc66f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:52.652822 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe580baf6e25431f8421912ec7fcc66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.641279 13846 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:52.659353 13846 ts_tablet_manager.cc:1403] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.229s	user 0.030s	sys 0.049s
I20260709 13:03:52.664002 13846 raft_consensus.cc:359] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.664958 13846 raft_consensus.cc:385] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.665328 13846 raft_consensus.cc:740] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.666311 13846 consensus_queue.cc:260] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.674417 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:52.675968 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 72da2bb06f304ae68d7bc48e326c2b84 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:52.677340 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72da2bb06f304ae68d7bc48e326c2b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.677465 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 72da2bb06f304ae68d7bc48e326c2b84 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 13:03:52.677875 13693 leader_election.cc:343] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.678485 13693 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:03:52.678887 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72da2bb06f304ae68d7bc48e326c2b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.680009 13871 raft_consensus.cc:2749] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.682338 13846 ts_tablet_manager.cc:1434] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:03:52.690786 13846 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:52.693837 13853 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:52.694461 13853 ts_tablet_manager.cc:1403] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.022s
I20260709 13:03:52.694219 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 72da2bb06f304ae68d7bc48e326c2b84 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:52.695606 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72da2bb06f304ae68d7bc48e326c2b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.695343 13787 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9ef826114749218e503fce75ebe00b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:52.696799 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9ef826114749218e503fce75ebe00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.698128 13846 tablet_bootstrap.cc:654] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.697878 13853 raft_consensus.cc:359] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.690748 13847 tablet_bootstrap.cc:654] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.699972 13853 raft_consensus.cc:385] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.700676 13853 raft_consensus.cc:740] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.706404 13850 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:52.707051 13850 ts_tablet_manager.cc:1403] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.032s
I20260709 13:03:52.710187 13850 raft_consensus.cc:359] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.710978 13850 raft_consensus.cc:385] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.711314 13850 raft_consensus.cc:740] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.712237 13850 consensus_queue.cc:260] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.701794 13853 consensus_queue.cc:260] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.712728 13474 catalog_manager.cc:5697] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.714854 13850 ts_tablet_manager.cc:1434] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:52.716257 13853 ts_tablet_manager.cc:1434] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:52.717311 13853 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:52.717813 13850 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:52.731549 13640 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9ef826114749218e503fce75ebe00b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:52.732859 13640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9ef826114749218e503fce75ebe00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.729981 13565 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9ef826114749218e503fce75ebe00b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:52.737605 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9ef826114749218e503fce75ebe00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.755951 13846 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:52.764528 13847 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:52.765245 13847 ts_tablet_manager.cc:1403] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.120s	user 0.028s	sys 0.020s
I20260709 13:03:52.761848 13846 ts_tablet_manager.cc:1403] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.071s	user 0.004s	sys 0.011s
I20260709 13:03:52.768077 13850 tablet_bootstrap.cc:654] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.768646 13847 raft_consensus.cc:359] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.772045 13714 tablet_service.cc:1511] Processing CreateTablet for tablet e08d4a4a907f4921a9e03d12d58b8bb4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:52.772562 13847 raft_consensus.cc:385] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.775329 13847 raft_consensus.cc:740] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.776211 13847 consensus_queue.cc:260] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.778712 13847 ts_tablet_manager.cc:1434] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:03:52.769167 13846 raft_consensus.cc:359] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.780148 13846 raft_consensus.cc:385] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.761988 13853 tablet_bootstrap.cc:654] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.780416 13846 raft_consensus.cc:740] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.781760 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08d4a4a907f4921a9e03d12d58b8bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.779665 13850 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:52.784075 13850 ts_tablet_manager.cc:1403] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.006s
I20260709 13:03:52.789222 13846 consensus_queue.cc:260] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.779749 13847 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:52.792048 13857 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.792263 13787 tablet_service.cc:1511] Processing CreateTablet for tablet e08d4a4a907f4921a9e03d12d58b8bb4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:52.792625 13857 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.793563 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08d4a4a907f4921a9e03d12d58b8bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.794678 13857 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:52.795439 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:52.796151 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:52.796733 13727 raft_consensus.cc:2468] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
W20260709 13:03:52.796849 13543 leader_election.cc:343] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.797945 13541 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:52.799296 13846 ts_tablet_manager.cc:1434] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 13:03:52.799744 13857 raft_consensus.cc:2804] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.800217 13857 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.800377 13846 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:52.799431 13853 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:52.801178 13853 ts_tablet_manager.cc:1403] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.005s
I20260709 13:03:52.802165 13847 tablet_bootstrap.cc:654] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.801512 13857 raft_consensus.cc:3060] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.815459 13789 tablet_service.cc:1511] Processing CreateTablet for tablet 08af1fe4826543f6928324c919a96c4b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:52.816787 13789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08af1fe4826543f6928324c919a96c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.788357 13850 raft_consensus.cc:359] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.817375 13850 raft_consensus.cc:385] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.806247 13853 raft_consensus.cc:359] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.817736 13850 raft_consensus.cc:740] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.818028 13853 raft_consensus.cc:385] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.818434 13853 raft_consensus.cc:740] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.818558 13850 consensus_queue.cc:260] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.819789 13714 tablet_service.cc:1511] Processing CreateTablet for tablet 341bc78504924367be418f9f9efdce67 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:52.808353 13565 tablet_service.cc:1511] Processing CreateTablet for tablet e08d4a4a907f4921a9e03d12d58b8bb4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:52.811928 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 08af1fe4826543f6928324c919a96c4b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:52.822093 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 341bc78504924367be418f9f9efdce67 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:52.821319 13850 ts_tablet_manager.cc:1434] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:03:52.820909 13853 consensus_queue.cc:260] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.823343 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341bc78504924367be418f9f9efdce67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.824579 13846 tablet_bootstrap.cc:654] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.826510 13853 ts_tablet_manager.cc:1434] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:03:52.829281 13850 tablet_bootstrap.cc:492] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:52.822503 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341bc78504924367be418f9f9efdce67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.831477 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08af1fe4826543f6928324c919a96c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.831790 13641 tablet_service.cc:1511] Processing CreateTablet for tablet 94cfd7b05f864022974fc28bfacd9c0d (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:52.833127 13641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cfd7b05f864022974fc28bfacd9c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.833262 13562 tablet_service.cc:1511] Processing CreateTablet for tablet 94cfd7b05f864022974fc28bfacd9c0d (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:52.834627 13562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cfd7b05f864022974fc28bfacd9c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.835034 13713 tablet_service.cc:1511] Processing CreateTablet for tablet a0411d9d92994ad9be1464bd3c136064 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:52.836244 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0411d9d92994ad9be1464bd3c136064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.840021 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 341bc78504924367be418f9f9efdce67 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:52.841346 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341bc78504924367be418f9f9efdce67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.842151 13853 tablet_bootstrap.cc:492] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:52.843542 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08d4a4a907f4921a9e03d12d58b8bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.843107 13787 tablet_service.cc:1511] Processing CreateTablet for tablet 94cfd7b05f864022974fc28bfacd9c0d (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:52.848353 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cfd7b05f864022974fc28bfacd9c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.820931 13857 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.852463 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
W20260709 13:03:52.853922 13543 leader_election.cc:343] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.859699 13850 tablet_bootstrap.cc:654] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.870043 13853 tablet_bootstrap.cc:654] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.877324 13785 tablet_service.cc:1511] Processing CreateTablet for tablet a0411d9d92994ad9be1464bd3c136064 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:52.878719 13785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0411d9d92994ad9be1464bd3c136064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.810746 13640 tablet_service.cc:1511] Processing CreateTablet for tablet 08af1fe4826543f6928324c919a96c4b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:52.880743 13640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08af1fe4826543f6928324c919a96c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.880965 13864 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.881420 13864 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:52.882666 13850 tablet_bootstrap.cc:492] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:52.883224 13850 ts_tablet_manager.cc:1403] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.001s
I20260709 13:03:52.884590 13857 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:52.885198 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:52.885771 13727 raft_consensus.cc:3060] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.888121 13864 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:52.891332 13853 tablet_bootstrap.cc:492] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:52.891860 13853 ts_tablet_manager.cc:1403] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.000s
I20260709 13:03:52.893456 13727 raft_consensus.cc:2468] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:52.894811 13541 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:52.896204 13857 raft_consensus.cc:2804] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.897012 13857 raft_consensus.cc:697] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:52.897173 13850 raft_consensus.cc:359] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:52.898151 13857 consensus_queue.cc:237] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.900789 13853 raft_consensus.cc:359] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:52.901487 13853 raft_consensus.cc:385] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.901765 13853 raft_consensus.cc:740] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.897920 13850 raft_consensus.cc:385] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.904982 13850 raft_consensus.cc:740] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.906687 13850 consensus_queue.cc:260] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:52.911151 13865 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.911633 13865 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.913910 13563 tablet_service.cc:1511] Processing CreateTablet for tablet a0411d9d92994ad9be1464bd3c136064 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:52.915271 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0411d9d92994ad9be1464bd3c136064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.926620 13847 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:52.927198 13847 ts_tablet_manager.cc:1403] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.016s
I20260709 13:03:52.927889 13865 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:52.930061 13847 raft_consensus.cc:359] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.942749 13717 tablet_service.cc:1511] Processing CreateTablet for tablet c6d05fd940f54f5284d55861d78ae249 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:52.937717 13643 tablet_service.cc:1511] Processing CreateTablet for tablet c6d05fd940f54f5284d55861d78ae249 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:52.955519 13717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d05fd940f54f5284d55861d78ae249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.954618 13847 raft_consensus.cc:385] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.955606 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d05fd940f54f5284d55861d78ae249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.944458 13846 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:52.957007 13846 ts_tablet_manager.cc:1403] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.157s	user 0.012s	sys 0.013s
I20260709 13:03:52.943310 13474 catalog_manager.cc:5697] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.959357 13847 raft_consensus.cc:740] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.960016 13846 raft_consensus.cc:359] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:52.960716 13846 raft_consensus.cc:385] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.960315 13847 consensus_queue.cc:260] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:52.948348 13790 tablet_service.cc:1511] Processing CreateTablet for tablet c6d05fd940f54f5284d55861d78ae249 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:52.951614 13563 tablet_service.cc:1511] Processing CreateTablet for tablet 3d09546ee4ea492f8b5ebef6afa028f0 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:52.963295 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d09546ee4ea492f8b5ebef6afa028f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.963212 13847 ts_tablet_manager.cc:1434] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:03:52.952926 13637 tablet_service.cc:1511] Processing CreateTablet for tablet 3d09546ee4ea492f8b5ebef6afa028f0 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:52.967391 13637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d09546ee4ea492f8b5ebef6afa028f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.971706 13847 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:52.938627 13853 consensus_queue.cc:260] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:52.973793 13853 ts_tablet_manager.cc:1434] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.003s
I20260709 13:03:52.978338 13847 tablet_bootstrap.cc:654] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.980578 13790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d05fd940f54f5284d55861d78ae249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.987777 13853 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:52.988396 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:52.961045 13846 raft_consensus.cc:740] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.945726 13850 ts_tablet_manager.cc:1434] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 13:03:52.997862 13850 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:52.998809 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 399df00a17e541e98fae8d4664b4566c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:53.002126 13846 consensus_queue.cc:260] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.006134 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 399df00a17e541e98fae8d4664b4566c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:53.014935 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399df00a17e541e98fae8d4664b4566c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.015040 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399df00a17e541e98fae8d4664b4566c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.016683 13641 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae6ae2455024cde872a6cce314120f9 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:53.017988 13641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae6ae2455024cde872a6cce314120f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.018440 13857 consensus_queue.cc:1048] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.019702 13846 ts_tablet_manager.cc:1434] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.003s
I20260709 13:03:53.007040 13789 tablet_service.cc:1511] Processing CreateTablet for tablet 399df00a17e541e98fae8d4664b4566c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:53.008520 13714 tablet_service.cc:1511] Processing CreateTablet for tablet 35763cd4283147759ec2c744a06238e3 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:53.009219 13864 raft_consensus.cc:493] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.010296 13562 tablet_service.cc:1511] Processing CreateTablet for tablet 35763cd4283147759ec2c744a06238e3 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:53.010663 13785 tablet_service.cc:1511] Processing CreateTablet for tablet 35763cd4283147759ec2c744a06238e3 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:53.026854 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35763cd4283147759ec2c744a06238e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.026086 13864 raft_consensus.cc:515] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.028986 13864 leader_election.cc:290] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:53.031220 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:52.995504 13713 tablet_service.cc:1511] Processing CreateTablet for tablet 3d09546ee4ea492f8b5ebef6afa028f0 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:53.034889 13785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35763cd4283147759ec2c744a06238e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.037142 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d09546ee4ea492f8b5ebef6afa028f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.038595 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae6ae2455024cde872a6cce314120f9 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:53.039882 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae6ae2455024cde872a6cce314120f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.040210 13635 tablet_service.cc:1511] Processing CreateTablet for tablet 907d3c0b010e4d80b4aa0eeb2068b21b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:53.039019 13789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399df00a17e541e98fae8d4664b4566c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.040779 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:53.043391 13565 tablet_service.cc:1511] Processing CreateTablet for tablet 907d3c0b010e4d80b4aa0eeb2068b21b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:53.044081 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
W20260709 13:03:53.052678 13767 leader_election.cc:343] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.045033 13562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35763cd4283147759ec2c744a06238e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.043391 13787 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae6ae2455024cde872a6cce314120f9 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:53.039731 13617 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:53.057299 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae6ae2455024cde872a6cce314120f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.057410 13864 raft_consensus.cc:2749] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.047134 13865 raft_consensus.cc:493] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.058701 13865 raft_consensus.cc:515] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.049026 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.058795 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907d3c0b010e4d80b4aa0eeb2068b21b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:53.060725 13764 leader_election.cc:343] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.061156 13764 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:53.049677 13635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907d3c0b010e4d80b4aa0eeb2068b21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.063845 13857 consensus_queue.cc:1048] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.061434 13865 leader_election.cc:290] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:53.061774 13800 raft_consensus.cc:2468] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:53.071975 13846 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:53.071892 13871 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.074481 13865 raft_consensus.cc:2749] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.076041 13864 raft_consensus.cc:493] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.077340 13852 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.084679 13864 raft_consensus.cc:515] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:53.080260 13871 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.084730 13852 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.087219 13864 leader_election.cc:290] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:03:53.087826 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:53.089098 13850 tablet_bootstrap.cc:654] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.077312 13711 tablet_service.cc:1511] Processing CreateTablet for tablet 907d3c0b010e4d80b4aa0eeb2068b21b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:53.091138 13711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907d3c0b010e4d80b4aa0eeb2068b21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.091692 13847 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:53.092173 13847 ts_tablet_manager.cc:1403] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.125s	user 0.006s	sys 0.013s
I20260709 13:03:53.094530 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.095185 13871 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:53.095398 13727 raft_consensus.cc:2468] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:53.096539 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:53.097180 13578 raft_consensus.cc:2468] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:53.097826 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:53.098729 13693 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:53.101339 13541 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:53.102247 13857 raft_consensus.cc:2804] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.102757 13857 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:53.101483 13692 leader_election.cc:343] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.102900 13617 leader_election.cc:304] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:53.104115 13864 raft_consensus.cc:2804] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.104269 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.104573 13864 raft_consensus.cc:493] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.105068 13864 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.103128 13857 raft_consensus.cc:3060] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.095211 13847 raft_consensus.cc:359] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:53.108848 13847 raft_consensus.cc:385] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.109167 13847 raft_consensus.cc:740] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.108172 13853 tablet_bootstrap.cc:654] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.087775 13852 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:53.120772 13847 consensus_queue.cc:260] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:53.110482 13871 raft_consensus.cc:2804] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.124908 13568 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1fa6c68f5c4c54ad078f62fd387651 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:53.125602 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:53.126559 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1fa6c68f5c4c54ad078f62fd387651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.085813 13791 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1fa6c68f5c4c54ad078f62fd387651 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:53.127651 13791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1fa6c68f5c4c54ad078f62fd387651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.137580 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.137960 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1fa6c68f5c4c54ad078f62fd387651 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:03:53.139156 13616 leader_election.cc:343] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.125125 13871 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.141813 13871 raft_consensus.cc:3060] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.143102 13715 tablet_service.cc:1511] Processing CreateTablet for tablet 5d98df69890142c4894e28b58aefd8d8 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:53.144740 13786 tablet_service.cc:1511] Processing CreateTablet for tablet 5d98df69890142c4894e28b58aefd8d8 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:53.145990 13786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d98df69890142c4894e28b58aefd8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.147188 13715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d98df69890142c4894e28b58aefd8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.148923 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d226b35af23040529bd02af17994d615" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:53.149578 13578 raft_consensus.cc:2468] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:53.139247 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1fa6c68f5c4c54ad078f62fd387651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.170403 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d226b35af23040529bd02af17994d615" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:53.176103 13566 tablet_service.cc:1511] Processing CreateTablet for tablet 5d98df69890142c4894e28b58aefd8d8 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:53.176837 13640 tablet_service.cc:1511] Processing CreateTablet for tablet 635dc98fdf3042ecba64ee28b17f4713 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:53.177440 13566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d98df69890142c4894e28b58aefd8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.178136 13716 tablet_service.cc:1511] Processing CreateTablet for tablet 635dc98fdf3042ecba64ee28b17f4713 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:53.179327 13716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635dc98fdf3042ecba64ee28b17f4713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.180009 13857 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.183243 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:53.178056 13640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635dc98fdf3042ecba64ee28b17f4713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.190651 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:53.190935 13871 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.192169 13727 raft_consensus.cc:2393] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 816d755a8270492d88dac41d1d303c68 in current term 1: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:03:53.193202 13871 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:53.194504 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:53.195302 13578 raft_consensus.cc:2393] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:53.196729 13847 ts_tablet_manager.cc:1434] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.002s
I20260709 13:03:53.196888 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:53.203630 13847 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
W20260709 13:03:53.206211 13692 leader_election.cc:343] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.209283 13692 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
W20260709 13:03:53.169309 13764 leader_election.cc:343] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.182065 13857 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:53.215910 13900 raft_consensus.cc:493] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.226541 13900 raft_consensus.cc:515] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:03:53.228534 13764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 63143.8us
I20260709 13:03:53.219551 13864 raft_consensus.cc:515] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
W20260709 13:03:53.229553 13617 leader_election.cc:343] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.229768 13652 raft_consensus.cc:2393] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 1: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:03:53.232328 13766 leader_election.cc:304] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:53.233052 13847 tablet_bootstrap.cc:654] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.233506 13865 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.234587 13850 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:53.235167 13850 ts_tablet_manager.cc:1403] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.238s	user 0.010s	sys 0.035s
I20260709 13:03:53.238447 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:53.245507 13865 raft_consensus.cc:2749] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.250293 13864 leader_election.cc:290] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
W20260709 13:03:53.239886 13542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 99692.3us
I20260709 13:03:53.251574 13871 raft_consensus.cc:2749] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.252157 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:53.253237 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:53.260553 13846 tablet_bootstrap.cc:654] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.271620 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 11ab7e9fc8c34bc99d9f07c85304f21b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:53.273782 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ab7e9fc8c34bc99d9f07c85304f21b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:53.273931 13616 leader_election.cc:343] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.274701 13784 tablet_service.cc:1511] Processing CreateTablet for tablet c7b482cf0234463ea074fc05017ed5b4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:53.275918 13784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b482cf0234463ea074fc05017ed5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.278977 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 11ab7e9fc8c34bc99d9f07c85304f21b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:53.280252 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ab7e9fc8c34bc99d9f07c85304f21b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:53.271718 13543 leader_election.cc:343] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.257277 13850 raft_consensus.cc:359] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.283774 13850 raft_consensus.cc:385] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.284078 13850 raft_consensus.cc:740] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.284600 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:53.284828 13850 consensus_queue.cc:260] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.286676 13767 leader_election.cc:304] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:03:53.287039 13850 ts_tablet_manager.cc:1434] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:03:53.288058 13850 tablet_bootstrap.cc:492] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:53.288142 13568 tablet_service.cc:1511] Processing CreateTablet for tablet c7b482cf0234463ea074fc05017ed5b4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:53.289806 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b482cf0234463ea074fc05017ed5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.293205 13865 raft_consensus.cc:2749] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.294787 13850 tablet_bootstrap.cc:654] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.262877 13785 tablet_service.cc:1511] Processing CreateTablet for tablet 635dc98fdf3042ecba64ee28b17f4713 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:53.295996 13785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635dc98fdf3042ecba64ee28b17f4713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.283227 13900 leader_election.cc:290] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:53.334771 13565 tablet_service.cc:1511] Processing CreateTablet for tablet 11ab7e9fc8c34bc99d9f07c85304f21b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:53.336557 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ab7e9fc8c34bc99d9f07c85304f21b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:53.318419 13543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 50881.5us
I20260709 13:03:53.340615 13790 tablet_service.cc:1511] Processing CreateTablet for tablet 52ea8762178341d5a08d0758292d2a50 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:53.342228 13790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ea8762178341d5a08d0758292d2a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.341982 13619 leader_election.cc:304] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:53.343258 13864 raft_consensus.cc:2804] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.343626 13864 raft_consensus.cc:493] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.343948 13864 raft_consensus.cc:3060] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.344641 13635 tablet_service.cc:1511] Processing CreateTablet for tablet c7b482cf0234463ea074fc05017ed5b4 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:53.345945 13635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b482cf0234463ea074fc05017ed5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.345911 13652 raft_consensus.cc:3060] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.350507 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:53.340512 13563 tablet_service.cc:1511] Processing CreateTablet for tablet 52ea8762178341d5a08d0758292d2a50 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:53.352432 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ea8762178341d5a08d0758292d2a50. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:53.358371 13543 leader_election.cc:343] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.361495 13543 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:53.362360 13852 raft_consensus.cc:2749] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.365301 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 7e36c72e3a2641ba9cfeeedc71e853e6 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:53.366600 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e36c72e3a2641ba9cfeeedc71e853e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.366503 13716 tablet_service.cc:1511] Processing CreateTablet for tablet 7e36c72e3a2641ba9cfeeedc71e853e6 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:53.366901 13852 consensus_queue.cc:1048] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.340682 13853 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:53.369689 13853 ts_tablet_manager.cc:1403] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.382s	user 0.009s	sys 0.007s
I20260709 13:03:53.322163 13801 raft_consensus.cc:2468] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:53.382599 13847 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:53.382625 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 79c7c53b44db41d9a56cff5d00be5010 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:53.383720 13847 ts_tablet_manager.cc:1403] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.180s	user 0.019s	sys 0.024s
I20260709 13:03:53.384111 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c7c53b44db41d9a56cff5d00be5010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.386322 13852 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.386837 13852 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.388880 13852 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:53.357949 13864 raft_consensus.cc:515] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:53.403661 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.404417 13727 raft_consensus.cc:2468] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:53.405692 13541 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:53.407851 13801 raft_consensus.cc:3060] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.386262 13717 tablet_service.cc:1511] Processing CreateTablet for tablet 79c7c53b44db41d9a56cff5d00be5010 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:53.409775 13786 tablet_service.cc:1511] Processing CreateTablet for tablet 7e36c72e3a2641ba9cfeeedc71e853e6 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:53.410578 13852 consensus_queue.cc:1048] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.411221 13786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e36c72e3a2641ba9cfeeedc71e853e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.412053 13791 tablet_service.cc:1511] Processing CreateTablet for tablet 7303d87314c5440cbf299237115d818c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:53.413331 13791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7303d87314c5440cbf299237115d818c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.411257 13716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e36c72e3a2641ba9cfeeedc71e853e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.407687 13857 raft_consensus.cc:2804] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.415880 13857 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.416253 13857 raft_consensus.cc:3060] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.422526 13853 raft_consensus.cc:359] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.423307 13853 raft_consensus.cc:385] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.423590 13853 raft_consensus.cc:740] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.424269 13857 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.424325 13853 consensus_queue.cc:260] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.426373 13713 tablet_service.cc:1511] Processing CreateTablet for tablet 52ea8762178341d5a08d0758292d2a50 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:53.427788 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ea8762178341d5a08d0758292d2a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.429819 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:53.430563 13726 raft_consensus.cc:3060] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.436913 13871 raft_consensus.cc:493] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.437438 13871 raft_consensus.cc:515] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.445981 13847 raft_consensus.cc:359] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.446821 13847 raft_consensus.cc:385] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.447078 13847 raft_consensus.cc:740] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.448810 13717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c7c53b44db41d9a56cff5d00be5010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.451232 13864 leader_election.cc:290] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:53.451843 13864 raft_consensus.cc:493] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.452250 13864 raft_consensus.cc:515] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.455487 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.456128 13725 raft_consensus.cc:2468] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:53.456185 13852 consensus_queue.cc:1048] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.462602 13616 leader_election.cc:304] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:53.464794 13864 leader_election.cc:290] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:53.471741 13850 tablet_bootstrap.cc:492] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:53.443203 13726 raft_consensus.cc:2468] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:53.474459 13541 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:53.474762 13847 consensus_queue.cc:260] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.475898 13903 raft_consensus.cc:2804] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.476393 13903 raft_consensus.cc:697] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:53.477033 13847 ts_tablet_manager.cc:1434] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.000s
I20260709 13:03:53.477263 13903 consensus_queue.cc:237] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.467559 13871 leader_election.cc:290] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:53.469076 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:53.480763 13691 leader_election.cc:343] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.469367 13617 leader_election.cc:304] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:53.472281 13850 ts_tablet_manager.cc:1403] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.184s	user 0.023s	sys 0.028s
I20260709 13:03:53.483317 13912 raft_consensus.cc:2804] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.483776 13912 raft_consensus.cc:493] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.484081 13912 raft_consensus.cc:3060] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.487375 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d226b35af23040529bd02af17994d615" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:53.488022 13578 raft_consensus.cc:3060] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.492519 13846 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:53.492758 13563 tablet_service.cc:1511] Processing CreateTablet for tablet 7303d87314c5440cbf299237115d818c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:53.494154 13577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:53.494793 13577 raft_consensus.cc:2468] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:53.496040 13847 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:53.496594 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d226b35af23040529bd02af17994d615" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:53.496471 13635 tablet_service.cc:1511] Processing CreateTablet for tablet 79c7c53b44db41d9a56cff5d00be5010 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:53.497351 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:53.497829 13635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c7c53b44db41d9a56cff5d00be5010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.498412 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:53.498814 13617 leader_election.cc:343] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:53.499500 13617 leader_election.cc:343] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.499753 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:53.501034 13850 raft_consensus.cc:359] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.501820 13850 raft_consensus.cc:385] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:53.502135 13543 leader_election.cc:343] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.503691 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7303d87314c5440cbf299237115d818c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.506816 13693 leader_election.cc:304] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:53.507894 13871 raft_consensus.cc:2804] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.508247 13871 raft_consensus.cc:493] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.508569 13871 raft_consensus.cc:3060] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.511291 13846 ts_tablet_manager.cc:1403] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.445s	user 0.024s	sys 0.016s
I20260709 13:03:53.429883 13857 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:53.527217 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 7303d87314c5440cbf299237115d818c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:53.529342 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7303d87314c5440cbf299237115d818c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:53.529974 13543 leader_election.cc:343] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:53.531265 13543 consensus_peers.cc:597] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.502140 13850 raft_consensus.cc:740] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.533066 13850 consensus_queue.cc:260] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.535772 13850 ts_tablet_manager.cc:1434] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:03:53.536803 13850 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:53.538158 13846 raft_consensus.cc:359] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.538945 13846 raft_consensus.cc:385] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.524555 13864 raft_consensus.cc:2804] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.549625 13857 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.550261 13846 raft_consensus.cc:740] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.586884 13847 tablet_bootstrap.cc:654] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.603089 13790 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6632785442492484d7bd8e03442d29 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:53.603690 13713 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6632785442492484d7bd8e03442d29 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:53.604812 13790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6632785442492484d7bd8e03442d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.605090 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6632785442492484d7bd8e03442d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.587332 13857 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.601904 13846 consensus_queue.cc:260] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.613382 13565 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6632785442492484d7bd8e03442d29 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:53.614828 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6632785442492484d7bd8e03442d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.619089 13640 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1653f547204758a0cd6a122be125cc (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:53.635828 13640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1653f547204758a0cd6a122be125cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.635488 13912 raft_consensus.cc:515] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.626128 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1653f547204758a0cd6a122be125cc (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:53.640697 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1653f547204758a0cd6a122be125cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.639465 13578 raft_consensus.cc:2468] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:53.624265 13857 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:53.633673 13850 tablet_bootstrap.cc:654] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.640547 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:53.641011 13912 leader_election.cc:290] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:53.618053 13915 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.628842 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:53.662310 13619 leader_election.cc:304] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:53.663193 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 60c9f55bf0434c59813efb44039ba4ae (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:53.654359 13900 raft_consensus.cc:493] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.678393 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c9f55bf0434c59813efb44039ba4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.674151 13921 raft_consensus.cc:493] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.686856 13921 raft_consensus.cc:515] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.650472 13864 raft_consensus.cc:697] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:53.680330 13912 raft_consensus.cc:2804] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.680610 13801 raft_consensus.cc:2468] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:53.675455 13726 raft_consensus.cc:3060] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.694140 13912 raft_consensus.cc:697] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:53.685524 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 60c9f55bf0434c59813efb44039ba4ae (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:53.695454 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c9f55bf0434c59813efb44039ba4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.695065 13912 consensus_queue.cc:237] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:53.698328 13717 tablet_service.cc:1511] Processing CreateTablet for tablet 60c9f55bf0434c59813efb44039ba4ae (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:53.691537 13900 raft_consensus.cc:515] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.699688 13717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c9f55bf0434c59813efb44039ba4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.700843 13900 leader_election.cc:290] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:53.701460 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:53.702140 13799 raft_consensus.cc:3060] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.702353 13784 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfa4c53a9364ccf8cf7c241664c6538 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:53.703696 13784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfa4c53a9364ccf8cf7c241664c6538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.702543 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:53.706384 13801 raft_consensus.cc:2468] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:53.707690 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:53.708357 13578 raft_consensus.cc:2468] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:53.709733 13767 leader_election.cc:304] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:53.711436 13900 raft_consensus.cc:2804] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.711804 13900 raft_consensus.cc:493] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.712116 13900 raft_consensus.cc:3060] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.677325 13915 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.714705 13915 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:53.715533 13691 leader_election.cc:304] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:53.715762 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:53.715910 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.728235 13924 raft_consensus.cc:2804] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.729591 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.714326 13864 consensus_queue.cc:237] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.701025 13542 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:53.730674 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:53.662209 13473 catalog_manager.cc:5697] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.731611 13846 ts_tablet_manager.cc:1434] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.220s	user 0.016s	sys 0.028s
I20260709 13:03:53.715890 13871 raft_consensus.cc:515] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.745800 13871 leader_election.cc:290] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:03:53.746243 13542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 45326.9us
I20260709 13:03:53.746968 13903 raft_consensus.cc:2804] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.747397 13903 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.747777 13846 tablet_bootstrap.cc:492] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:53.745625 13635 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfa4c53a9364ccf8cf7c241664c6538 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:53.749235 13635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfa4c53a9364ccf8cf7c241664c6538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.747756 13903 raft_consensus.cc:3060] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.757773 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:53.758617 13578 raft_consensus.cc:2468] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:53.759719 13577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:53.760414 13577 raft_consensus.cc:3060] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.765357 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfa4c53a9364ccf8cf7c241664c6538 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:53.769259 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfa4c53a9364ccf8cf7c241664c6538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.740500 13853 ts_tablet_manager.cc:1434] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.361s	user 0.009s	sys 0.032s
I20260709 13:03:53.738194 13924 raft_consensus.cc:493] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.781507 13924 raft_consensus.cc:3060] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.777557 13786 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1653f547204758a0cd6a122be125cc (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:53.777814 13791 tablet_service.cc:1511] Processing CreateTablet for tablet 54e397de8fed4278ac1e623f0bb77e7c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:53.779090 13563 tablet_service.cc:1511] Processing CreateTablet for tablet 54e397de8fed4278ac1e623f0bb77e7c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:53.788069 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e397de8fed4278ac1e623f0bb77e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.793524 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 84008f69faa047d1b47f08ea114c506a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:03:53.779682 13918 log.cc:927] Time spent T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:03:53.780689 13616 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:53.790414 13786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1653f547204758a0cd6a122be125cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.740149 13921 leader_election.cc:290] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:53.800992 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84008f69faa047d1b47f08ea114c506a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.804785 13726 raft_consensus.cc:2468] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
W20260709 13:03:53.805413 13541 leader_election.cc:343] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.790570 13900 raft_consensus.cc:515] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.799952 13799 raft_consensus.cc:2468] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:53.807878 13617 leader_election.cc:304] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:53.808863 13922 raft_consensus.cc:2749] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.809253 13900 leader_election.cc:290] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:53.809547 13922 raft_consensus.cc:2804] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.810045 13922 raft_consensus.cc:697] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:53.810812 13903 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.812702 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:53.813302 13578 raft_consensus.cc:3060] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.810918 13922 consensus_queue.cc:237] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.831974 13791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e397de8fed4278ac1e623f0bb77e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.834179 13903 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:53.849248 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:53.850178 13785 tablet_service.cc:1511] Processing CreateTablet for tablet 84008f69faa047d1b47f08ea114c506a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:53.851020 13643 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9d6a51fea243bf921646c100c91f8b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:53.853304 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9d6a51fea243bf921646c100c91f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.853331 13853 tablet_bootstrap.cc:492] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:53.860927 13847 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:53.861471 13847 ts_tablet_manager.cc:1403] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.366s	user 0.023s	sys 0.013s
I20260709 13:03:53.861626 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:53.863364 13799 raft_consensus.cc:3060] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.863895 13785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84008f69faa047d1b47f08ea114c506a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.864293 13565 tablet_service.cc:1511] Processing CreateTablet for tablet a9f715bd53db44c9897c1bc9af541e5c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:53.864682 13787 tablet_service.cc:1511] Processing CreateTablet for tablet a9f715bd53db44c9897c1bc9af541e5c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:53.865685 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f715bd53db44c9897c1bc9af541e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.865939 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f715bd53db44c9897c1bc9af541e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.871266 13563 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9d6a51fea243bf921646c100c91f8b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:53.872541 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9d6a51fea243bf921646c100c91f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.875263 13847 raft_consensus.cc:359] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.876060 13847 raft_consensus.cc:385] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.876385 13847 raft_consensus.cc:740] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
W20260709 13:03:53.847991 13691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 140405us
I20260709 13:03:53.879437 13846 tablet_bootstrap.cc:654] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.880275 13476 catalog_manager.cc:5697] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.884622 13799 raft_consensus.cc:2468] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:53.887413 13542 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:53.888237 13903 raft_consensus.cc:2804] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.878378 13853 tablet_bootstrap.cc:654] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.885291 13577 raft_consensus.cc:2468] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:53.894891 13850 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:53.895004 13713 tablet_service.cc:1511] Processing CreateTablet for tablet 54e397de8fed4278ac1e623f0bb77e7c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:53.895344 13693 leader_election.cc:304] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:53.895597 13850 ts_tablet_manager.cc:1403] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.359s	user 0.042s	sys 0.054s
I20260709 13:03:53.896413 13930 raft_consensus.cc:2804] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.897204 13930 raft_consensus.cc:697] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:03:53.891700 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:53.902822 13930 consensus_queue.cc:237] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.896430 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e397de8fed4278ac1e623f0bb77e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.899578 13850 raft_consensus.cc:359] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.900249 13641 tablet_service.cc:1511] Processing CreateTablet for tablet a9f715bd53db44c9897c1bc9af541e5c (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:53.915427 13641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f715bd53db44c9897c1bc9af541e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.916496 13852 consensus_queue.cc:1048] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.892674 13578 raft_consensus.cc:2468] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:53.903316 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 570d47d923e646698c8d1cb50881806a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:53.913666 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:53.919260 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570d47d923e646698c8d1cb50881806a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:53.920516 13541 leader_election.cc:343] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.888885 13903 raft_consensus.cc:697] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:53.922835 13903 consensus_queue.cc:237] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.929035 13787 tablet_service.cc:1511] Processing CreateTablet for tablet 570d47d923e646698c8d1cb50881806a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:53.930416 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570d47d923e646698c8d1cb50881806a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.930612 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 84008f69faa047d1b47f08ea114c506a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:53.931782 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84008f69faa047d1b47f08ea114c506a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.896669 13847 consensus_queue.cc:260] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:53.936553 13850 raft_consensus.cc:385] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.956257 13767 leader_election.cc:304] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:53.962373 13846 tablet_bootstrap.cc:492] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:53.965099 13846 ts_tablet_manager.cc:1403] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.218s	user 0.012s	sys 0.005s
I20260709 13:03:53.965620 13717 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9d6a51fea243bf921646c100c91f8b (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:53.966969 13717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9d6a51fea243bf921646c100c91f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.968369 13640 tablet_service.cc:1511] Processing CreateTablet for tablet 6fe49ba6d20a41ebbd9b9b9f8b8f083a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:53.968633 13846 raft_consensus.cc:359] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:53.969393 13846 raft_consensus.cc:385] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.969660 13640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe49ba6d20a41ebbd9b9b9f8b8f083a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.970436 13847 ts_tablet_manager.cc:1434] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.002s
I20260709 13:03:53.971374 13847 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:53.895082 13924 raft_consensus.cc:515] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.974284 13900 raft_consensus.cc:2804] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.957871 13850 raft_consensus.cc:740] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.969699 13846 raft_consensus.cc:740] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.985652 13712 tablet_service.cc:1511] Processing CreateTablet for tablet 570d47d923e646698c8d1cb50881806a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:53.981421 13850 consensus_queue.cc:260] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:53.993094 13799 raft_consensus.cc:3060] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.999768 13716 tablet_service.cc:1511] Processing CreateTablet for tablet 6fe49ba6d20a41ebbd9b9b9f8b8f083a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:54.003731 13724 raft_consensus.cc:2393] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 1: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:03:54.004807 13567 tablet_service.cc:1511] Processing CreateTablet for tablet ebb2600ae8d741429738e3887b811cef (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:54.005986 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb2600ae8d741429738e3887b811cef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:54.008080 13543 consensus_peers.cc:597] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.001722 13790 tablet_service.cc:1511] Processing CreateTablet for tablet 6fe49ba6d20a41ebbd9b9b9f8b8f083a (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:53.988839 13712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570d47d923e646698c8d1cb50881806a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.011694 13643 tablet_service.cc:1511] Processing CreateTablet for tablet ebb2600ae8d741429738e3887b811cef (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:54.013038 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb2600ae8d741429738e3887b811cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.024318 13652 raft_consensus.cc:3060] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.025123 13787 tablet_service.cc:1511] Processing CreateTablet for tablet bceb1a953ae04c22a73b2911d54d6b10 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:54.025429 13716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe49ba6d20a41ebbd9b9b9f8b8f083a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.028846 13924 leader_election.cc:290] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:54.030120 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:54.031526 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:54.032279 13578 raft_consensus.cc:2393] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 1: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:03:54.044579 13790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe49ba6d20a41ebbd9b9b9f8b8f083a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.039724 13711 tablet_service.cc:1511] Processing CreateTablet for tablet ebb2600ae8d741429738e3887b811cef (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:54.058115 13563 tablet_service.cc:1511] Processing CreateTablet for tablet bceb1a953ae04c22a73b2911d54d6b10 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:54.038463 13900 raft_consensus.cc:697] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:54.060132 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bceb1a953ae04c22a73b2911d54d6b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.064944 13711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb2600ae8d741429738e3887b811cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.076212 13847 tablet_bootstrap.cc:654] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.078549 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bceb1a953ae04c22a73b2911d54d6b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.078369 13852 raft_consensus.cc:493] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.082338 13852 raft_consensus.cc:515] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.083437 13637 tablet_service.cc:1511] Processing CreateTablet for tablet bceb1a953ae04c22a73b2911d54d6b10 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:54.084435 13852 leader_election.cc:290] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:54.085034 13637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bceb1a953ae04c22a73b2911d54d6b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.087280 13900 consensus_queue.cc:237] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.088419 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:54.088864 13713 tablet_service.cc:1511] Processing CreateTablet for tablet be6cb9bb386e4e21b297137851efdc10 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:03:54.090027 13541 leader_election.cc:343] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.090158 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6cb9bb386e4e21b297137851efdc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.038007 13846 consensus_queue.cc:260] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.152149 13850 ts_tablet_manager.cc:1434] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.256s	user 0.014s	sys 0.024s
I20260709 13:03:54.153379 13850 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:54.155148 13846 ts_tablet_manager.cc:1434] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.190s	user 0.004s	sys 0.004s
I20260709 13:03:54.156250 13846 tablet_bootstrap.cc:492] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:54.130260 13799 raft_consensus.cc:2468] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:54.162655 13785 tablet_service.cc:1511] Processing CreateTablet for tablet be6cb9bb386e4e21b297137851efdc10 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:54.163965 13785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6cb9bb386e4e21b297137851efdc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.167474 13563 tablet_service.cc:1511] Processing CreateTablet for tablet be6cb9bb386e4e21b297137851efdc10 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:54.168853 13853 tablet_bootstrap.cc:492] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:54.169432 13853 ts_tablet_manager.cc:1403] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.328s	user 0.013s	sys 0.012s
W20260709 13:03:54.170449 13617 consensus_peers.cc:597] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 -> Peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Couldn't send request to peer da3d66493d2f419fb8eda6491ce13df0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.171669 13691 leader_election.cc:304] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:54.172884 13853 raft_consensus.cc:359] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.173866 13853 raft_consensus.cc:385] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.174206 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 4375b1ee962c4bdab7ed9a4744ac1abf (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:54.174244 13853 raft_consensus.cc:740] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.175527 13853 consensus_queue.cc:260] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.173722 13930 raft_consensus.cc:2749] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.176632 13920 raft_consensus.cc:493] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.177122 13920 raft_consensus.cc:515] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.177965 13853 ts_tablet_manager.cc:1434] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:54.179026 13853 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:54.179250 13920 leader_election.cc:290] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:54.180651 13850 tablet_bootstrap.cc:654] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.181025 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30707476881c44db89b44a8a2e812372" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:03:54.182760 13616 leader_election.cc:343] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.185441 13853 tablet_bootstrap.cc:654] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.187968 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30707476881c44db89b44a8a2e812372" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:54.175840 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:54.189805 13617 leader_election.cc:343] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.190188 13617 leader_election.cc:304] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
W20260709 13:03:54.191215 13543 leader_election.cc:343] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.191346 13864 raft_consensus.cc:2749] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.191766 13543 leader_election.cc:304] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:54.192865 13857 raft_consensus.cc:2749] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.194183 13726 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.195338 13787 tablet_service.cc:1511] Processing CreateTablet for tablet b764a88e92eb45b59fdd342348e09439 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:54.196458 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b764a88e92eb45b59fdd342348e09439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.198483 13563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6cb9bb386e4e21b297137851efdc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.200465 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4375b1ee962c4bdab7ed9a4744ac1abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.205341 13565 tablet_service.cc:1511] Processing CreateTablet for tablet b764a88e92eb45b59fdd342348e09439 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:54.206313 13565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b764a88e92eb45b59fdd342348e09439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.217854 13716 tablet_service.cc:1511] Processing CreateTablet for tablet 46592c7f545042849b442d72dcc3979f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:54.228739 13716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46592c7f545042849b442d72dcc3979f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.235690 13791 tablet_service.cc:1511] Processing CreateTablet for tablet 46592c7f545042849b442d72dcc3979f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:54.245298 13713 tablet_service.cc:1511] Processing CreateTablet for tablet 944b6716b88040be900d0421aa382a29 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:03:54.247061 13462 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 46646.4us
I20260709 13:03:54.250015 13643 tablet_service.cc:1511] Processing CreateTablet for tablet b764a88e92eb45b59fdd342348e09439 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:54.250229 13635 tablet_service.cc:1511] Processing CreateTablet for tablet 46592c7f545042849b442d72dcc3979f (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:54.246959 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944b6716b88040be900d0421aa382a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.256101 13568 tablet_service.cc:1511] Processing CreateTablet for tablet 944b6716b88040be900d0421aa382a29 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:54.266160 13643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b764a88e92eb45b59fdd342348e09439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.257452 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944b6716b88040be900d0421aa382a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.285089 13635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46592c7f545042849b442d72dcc3979f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.285530 13846 tablet_bootstrap.cc:654] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:54.287199 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:54.287949 13791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46592c7f545042849b442d72dcc3979f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.291102 13785 tablet_service.cc:1511] Processing CreateTablet for tablet 944b6716b88040be900d0421aa382a29 (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:54.292375 13785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944b6716b88040be900d0421aa382a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.257189 13641 tablet_service.cc:1511] Processing CreateTablet for tablet 4375b1ee962c4bdab7ed9a4744ac1abf (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:54.296424 13641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4375b1ee962c4bdab7ed9a4744ac1abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.264389 13475 catalog_manager.cc:5697] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.305109 13920 consensus_queue.cc:1048] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:54.310372 13853 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:54.310918 13853 ts_tablet_manager.cc:1403] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.132s	user 0.041s	sys 0.027s
I20260709 13:03:54.313488 13853 raft_consensus.cc:359] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.316059 13853 raft_consensus.cc:385] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.316349 13853 raft_consensus.cc:740] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.317164 13853 consensus_queue.cc:260] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.318898 13922 consensus_queue.cc:1048] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.326368 13864 consensus_queue.cc:1048] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.278226 13473 catalog_manager.cc:5697] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.337461 13853 ts_tablet_manager.cc:1434] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:03:54.341198 13474 catalog_manager.cc:5697] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.333904 13717 tablet_service.cc:1511] Processing CreateTablet for tablet 4375b1ee962c4bdab7ed9a4744ac1abf (DEFAULT_TABLE table=test-workload [id=369951f9b9e249d8987d4bf76c0258e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:54.343267 13717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4375b1ee962c4bdab7ed9a4744ac1abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.346408 13853 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:54.359257 13476 catalog_manager.cc:5697] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.360481 13476 catalog_manager.cc:5697] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.363703 13864 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.364393 13864 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.366317 13850 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:54.402292 13846 tablet_bootstrap.cc:492] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:54.403304 13846 ts_tablet_manager.cc:1403] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.247s	user 0.016s	sys 0.005s
I20260709 13:03:54.403594 13850 ts_tablet_manager.cc:1403] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.250s	user 0.014s	sys 0.021s
I20260709 13:03:54.409308 13847 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:54.409796 13847 ts_tablet_manager.cc:1403] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.439s	user 0.008s	sys 0.020s
I20260709 13:03:54.411679 13920 consensus_queue.cc:1048] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.415077 13920 consensus_queue.cc:1048] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.378273 13930 consensus_queue.cc:1048] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:03:54.416388 13853 tablet_bootstrap.cc:654] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.367354 13577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:54.418987 13577 raft_consensus.cc:2393] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:54.420032 13864 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:54.421644 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:54.422591 13727 raft_consensus.cc:2393] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:03:54.423995 13616 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:54.426247 13920 raft_consensus.cc:3060] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.427490 13846 raft_consensus.cc:359] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.428226 13846 raft_consensus.cc:385] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.428504 13846 raft_consensus.cc:740] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.429225 13846 consensus_queue.cc:260] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.435611 13850 raft_consensus.cc:359] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.436364 13850 raft_consensus.cc:385] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.436650 13850 raft_consensus.cc:740] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.437404 13850 consensus_queue.cc:260] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.437726 13847 raft_consensus.cc:359] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.439502 13850 ts_tablet_manager.cc:1434] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:03:54.439548 13847 raft_consensus.cc:385] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.440507 13847 raft_consensus.cc:740] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.442401 13847 consensus_queue.cc:260] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.446424 13847 ts_tablet_manager.cc:1434] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.005s
I20260709 13:03:54.447551 13847 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:54.453715 13847 tablet_bootstrap.cc:654] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.443186 13846 ts_tablet_manager.cc:1434] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:03:54.454938 13846 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:54.456007 13920 raft_consensus.cc:2749] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.440584 13850 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:54.466302 13857 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.466961 13857 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.475412 13846 tablet_bootstrap.cc:654] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.471201 13857 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:54.484467 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:54.485069 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:54.486189 13543 leader_election.cc:343] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:54.486784 13542 leader_election.cc:343] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.487218 13542 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:54.488233 13850 tablet_bootstrap.cc:654] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.488320 13857 raft_consensus.cc:2749] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.505752 13846 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:54.506366 13853 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:54.506369 13846 ts_tablet_manager.cc:1403] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.005s
I20260709 13:03:54.507084 13853 ts_tablet_manager.cc:1403] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.169s	user 0.028s	sys 0.033s
I20260709 13:03:54.508730 13924 raft_consensus.cc:493] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:03:54.514989 13924 raft_consensus.cc:515] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.518113 13846 raft_consensus.cc:359] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.518854 13846 raft_consensus.cc:385] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.519122 13846 raft_consensus.cc:740] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.519894 13846 consensus_queue.cc:260] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.529093 13924 leader_election.cc:290] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:54.524613 13847 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:54.533783 13847 ts_tablet_manager.cc:1403] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.005s
I20260709 13:03:54.536808 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:54.531091 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:54.544858 13799 raft_consensus.cc:3060] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.546584 13692 leader_election.cc:304] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:54.551143 13853 raft_consensus.cc:359] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.551527 13924 consensus_queue.cc:1048] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.551956 13853 raft_consensus.cc:385] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.552395 13853 raft_consensus.cc:740] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.553282 13853 consensus_queue.cc:260] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:03:54.553759 13541 consensus_peers.cc:597] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.556630 13853 ts_tablet_manager.cc:1434] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.002s
I20260709 13:03:54.559273 13853 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:54.560349 13847 raft_consensus.cc:359] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.552126 13850 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:54.561682 13850 ts_tablet_manager.cc:1403] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.014s
I20260709 13:03:54.552831 13924 raft_consensus.cc:2749] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:54.567898 13850 raft_consensus.cc:359] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.611008 13939 consensus_queue.cc:1048] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:03:54.619387 13852 consensus_queue.cc:1048] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.561087 13847 raft_consensus.cc:385] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.622954 13847 raft_consensus.cc:740] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.623811 13847 consensus_queue.cc:260] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.626880 13847 ts_tablet_manager.cc:1434] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.092s	user 0.003s	sys 0.011s
I20260709 13:03:54.627858 13847 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:54.610790 13853 tablet_bootstrap.cc:654] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.612041 13846 ts_tablet_manager.cc:1434] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.105s	user 0.011s	sys 0.004s
I20260709 13:03:54.633924 13846 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:54.633806 13900 consensus_queue.cc:1048] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.641214 13846 tablet_bootstrap.cc:654] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.616106 13850 raft_consensus.cc:385] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.646579 13850 raft_consensus.cc:740] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.648361 13850 consensus_queue.cc:260] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.655845 13850 ts_tablet_manager.cc:1434] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.013s
I20260709 13:03:54.656847 13850 tablet_bootstrap.cc:492] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:54.664162 13850 tablet_bootstrap.cc:654] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.667558 13853 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:54.667784 13847 tablet_bootstrap.cc:654] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.668108 13853 ts_tablet_manager.cc:1403] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.007s
I20260709 13:03:54.678965 13853 raft_consensus.cc:359] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.682940 13853 raft_consensus.cc:385] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.683188 13853 raft_consensus.cc:740] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.688616 13853 consensus_queue.cc:260] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.689320 13846 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:54.689841 13846 ts_tablet_manager.cc:1403] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.007s
I20260709 13:03:54.693295 13853 ts_tablet_manager.cc:1434] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:03:54.694284 13853 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:54.696344 13846 raft_consensus.cc:359] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.696887 13846 raft_consensus.cc:385] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.697167 13846 raft_consensus.cc:740] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.697777 13846 consensus_queue.cc:260] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.700132 13846 ts_tablet_manager.cc:1434] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:03:54.701608 13846 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:54.698596 13847 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:54.702850 13847 ts_tablet_manager.cc:1403] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.000s
I20260709 13:03:54.700102 13850 tablet_bootstrap.cc:492] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:54.703536 13850 ts_tablet_manager.cc:1403] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.004s
I20260709 13:03:54.702967 13853 tablet_bootstrap.cc:654] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.706427 13920 raft_consensus.cc:493] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.706947 13920 raft_consensus.cc:515] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.706418 13850 raft_consensus.cc:359] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.709759 13850 raft_consensus.cc:385] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.710013 13850 raft_consensus.cc:740] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.710731 13850 consensus_queue.cc:260] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.711264 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:54.711882 13578 raft_consensus.cc:2468] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:54.712481 13846 tablet_bootstrap.cc:654] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.712976 13850 ts_tablet_manager.cc:1434] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:54.713114 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:54.713735 13726 raft_consensus.cc:2468] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:54.713984 13850 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:54.705664 13847 raft_consensus.cc:359] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.715193 13847 raft_consensus.cc:385] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.715471 13847 raft_consensus.cc:740] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.716140 13847 consensus_queue.cc:260] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.718427 13847 ts_tablet_manager.cc:1434] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:03:54.718910 13616 leader_election.cc:304] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:54.719839 13864 raft_consensus.cc:2804] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.720221 13864 raft_consensus.cc:493] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.719336 13847 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:54.720556 13864 raft_consensus.cc:3060] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.721854 13853 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:54.722362 13853 ts_tablet_manager.cc:1403] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:03:54.725096 13853 raft_consensus.cc:359] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.725733 13853 raft_consensus.cc:385] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.725984 13853 raft_consensus.cc:740] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.726641 13847 tablet_bootstrap.cc:654] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.709059 13920 leader_election.cc:290] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:54.726652 13853 consensus_queue.cc:260] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.730041 13853 ts_tablet_manager.cc:1434] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:54.727844 13864 raft_consensus.cc:515] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.733704 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:54.734288 13578 raft_consensus.cc:3060] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.736550 13846 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:54.737054 13846 ts_tablet_manager.cc:1403] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.004s
I20260709 13:03:54.737998 13847 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:54.727883 13850 tablet_bootstrap.cc:654] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.738515 13847 ts_tablet_manager.cc:1403] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.005s
I20260709 13:03:54.740206 13578 raft_consensus.cc:2468] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:54.741158 13847 raft_consensus.cc:359] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.741451 13619 leader_election.cc:304] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:54.741839 13847 raft_consensus.cc:385] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.741935 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:54.742182 13847 raft_consensus.cc:740] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.742710 13726 raft_consensus.cc:3060] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.743372 13953 raft_consensus.cc:2804] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.743084 13847 consensus_queue.cc:260] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.743793 13953 raft_consensus.cc:697] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:54.744553 13953 consensus_queue.cc:237] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.745179 13847 ts_tablet_manager.cc:1434] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:54.746313 13847 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:54.749804 13726 raft_consensus.cc:2468] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:54.749856 13846 raft_consensus.cc:359] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.751024 13846 raft_consensus.cc:385] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.751282 13846 raft_consensus.cc:740] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.752041 13847 tablet_bootstrap.cc:654] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.752235 13864 leader_election.cc:290] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:54.753788 13853 tablet_bootstrap.cc:492] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:54.753438 13846 consensus_queue.cc:260] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.761893 13853 tablet_bootstrap.cc:654] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.764025 13846 ts_tablet_manager.cc:1434] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:54.764901 13847 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:54.765522 13847 ts_tablet_manager.cc:1403] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 13:03:54.765012 13846 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:54.769091 13850 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:54.768914 13847 raft_consensus.cc:359] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.769649 13850 ts_tablet_manager.cc:1403] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.002s
I20260709 13:03:54.769789 13847 raft_consensus.cc:385] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.770315 13847 raft_consensus.cc:740] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.771247 13847 consensus_queue.cc:260] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.772801 13846 tablet_bootstrap.cc:654] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.772719 13850 raft_consensus.cc:359] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.773502 13850 raft_consensus.cc:385] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.773785 13850 raft_consensus.cc:740] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.775153 13850 consensus_queue.cc:260] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.777581 13850 ts_tablet_manager.cc:1434] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:54.778865 13850 tablet_bootstrap.cc:492] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:54.789542 13850 tablet_bootstrap.cc:654] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.789884 13847 ts_tablet_manager.cc:1434] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:03:54.790915 13847 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:54.797515 13847 tablet_bootstrap.cc:654] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.803449 13853 tablet_bootstrap.cc:492] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:54.803941 13853 ts_tablet_manager.cc:1403] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.020s
I20260709 13:03:54.805104 13652 raft_consensus.cc:3060] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.807739 13853 raft_consensus.cc:359] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.808496 13853 raft_consensus.cc:385] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.808748 13853 raft_consensus.cc:740] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.809230 13846 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:54.809772 13846 ts_tablet_manager.cc:1403] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.004s
I20260709 13:03:54.809577 13853 consensus_queue.cc:260] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.811791 13965 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.812337 13965 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.813117 13846 raft_consensus.cc:359] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.813818 13846 raft_consensus.cc:385] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.814121 13846 raft_consensus.cc:740] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.814749 13846 consensus_queue.cc:260] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.812405 13475 catalog_manager.cc:5697] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.817399 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:54.818434 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:54.821066 13850 tablet_bootstrap.cc:492] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:54.821609 13850 ts_tablet_manager.cc:1403] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.005s
I20260709 13:03:54.824374 13850 raft_consensus.cc:359] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.827311 13846 ts_tablet_manager.cc:1434] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:03:54.827653 13691 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:54.829301 13850 raft_consensus.cc:385] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.814711 13965 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:54.829684 13850 raft_consensus.cc:740] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.830632 13850 consensus_queue.cc:260] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.811769 13853 ts_tablet_manager.cc:1434] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:03:54.836252 13850 ts_tablet_manager.cc:1434] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:03:54.836526 13853 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:54.836905 13847 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:54.837626 13847 ts_tablet_manager.cc:1403] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.019s
I20260709 13:03:54.837975 13850 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:54.840024 13852 raft_consensus.cc:493] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.840549 13852 raft_consensus.cc:515] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.841377 13846 tablet_bootstrap.cc:492] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:54.842653 13852 leader_election.cc:290] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:54.843303 13853 tablet_bootstrap.cc:654] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.843343 13850 tablet_bootstrap.cc:654] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.845118 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:54.845304 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:54.845801 13801 raft_consensus.cc:2468] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:54.845964 13726 raft_consensus.cc:2468] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:54.847260 13542 leader_election.cc:304] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:54.848688 13852 raft_consensus.cc:2804] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.849086 13852 raft_consensus.cc:493] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.849416 13852 raft_consensus.cc:3060] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.829653 13930 raft_consensus.cc:2749] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.856346 13930 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.857244 13853 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:54.856917 13930 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.858938 13847 raft_consensus.cc:359] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.859725 13847 raft_consensus.cc:385] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.860257 13847 raft_consensus.cc:740] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.859678 13930 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:54.860414 13853 ts_tablet_manager.cc:1403] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:03:54.861115 13847 consensus_queue.cc:260] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.861457 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:54.862246 13651 raft_consensus.cc:2468] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:54.863436 13847 ts_tablet_manager.cc:1434] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 13:03:54.863646 13853 raft_consensus.cc:359] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.859977 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:54.864800 13578 raft_consensus.cc:2468] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:54.865021 13847 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:54.863531 13692 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:54.869017 13846 tablet_bootstrap.cc:654] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.864248 13853 raft_consensus.cc:385] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.870428 13853 raft_consensus.cc:740] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.871467 13903 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.872992 13903 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.871961 13930 raft_consensus.cc:2804] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:54.874495 13930 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.874815 13930 raft_consensus.cc:3060] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.878820 13847 tablet_bootstrap.cc:654] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.878963 13903 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:54.880231 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:54.880996 13726 raft_consensus.cc:2468] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:54.882115 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:54.886492 13541 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:54.887485 13903 raft_consensus.cc:2804] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.885326 13853 consensus_queue.cc:260] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
W20260709 13:03:54.887584 13543 leader_election.cc:343] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.887921 13903 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.889827 13903 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.891662 13853 ts_tablet_manager.cc:1434] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.002s
I20260709 13:03:54.893386 13853 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:54.893824 13852 raft_consensus.cc:515] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.900185 13852 leader_election.cc:290] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:54.900596 13853 tablet_bootstrap.cc:654] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.901269 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:54.901580 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:54.901919 13726 raft_consensus.cc:3060] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.902140 13801 raft_consensus.cc:3060] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.905300 13965 raft_consensus.cc:493] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.905880 13965 raft_consensus.cc:515] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.908138 13965 leader_election.cc:290] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:54.909621 13726 raft_consensus.cc:2468] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:54.909960 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30707476881c44db89b44a8a2e812372" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:54.910959 13799 raft_consensus.cc:2468] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:54.912200 13691 leader_election.cc:304] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:54.912267 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30707476881c44db89b44a8a2e812372" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:54.912928 13651 raft_consensus.cc:2468] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:54.913254 13903 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.913174 13965 raft_consensus.cc:2804] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.914532 13965 raft_consensus.cc:493] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.914876 13965 raft_consensus.cc:3060] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.915634 13903 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:54.909561 13801 raft_consensus.cc:2468] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:54.919898 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:54.920195 13541 leader_election.cc:304] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:54.922559 13939 raft_consensus.cc:493] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.923085 13939 raft_consensus.cc:515] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.924708 13847 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:54.925149 13939 leader_election.cc:290] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:54.925910 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:54.926548 13726 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.928545 13930 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.926432 13850 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
W20260709 13:03:54.930445 13543 leader_election.cc:343] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.930860 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:54.925185 13847 ts_tablet_manager.cc:1403] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.003s
I20260709 13:03:54.931883 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:54.932215 13846 tablet_bootstrap.cc:492] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:54.932737 13846 ts_tablet_manager.cc:1403] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.010s
I20260709 13:03:54.934201 13853 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:54.934670 13853 ts_tablet_manager.cc:1403] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.015s
I20260709 13:03:54.930476 13850 ts_tablet_manager.cc:1403] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.093s	user 0.025s	sys 0.027s
I20260709 13:03:54.931493 13651 raft_consensus.cc:2468] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:54.935436 13846 raft_consensus.cc:359] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.936244 13846 raft_consensus.cc:385] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.936519 13846 raft_consensus.cc:740] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.931548 13965 raft_consensus.cc:515] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.937225 13846 consensus_queue.cc:260] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.934760 13847 raft_consensus.cc:359] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.939065 13847 raft_consensus.cc:385] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.939318 13847 raft_consensus.cc:740] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.940006 13847 consensus_queue.cc:260] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.940433 13930 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:54.939358 13846 ts_tablet_manager.cc:1434] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:03:54.941200 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30707476881c44db89b44a8a2e812372" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:54.941919 13965 leader_election.cc:290] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:54.941812 13846 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
W20260709 13:03:54.935210 13764 leader_election.cc:343] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.942605 13853 raft_consensus.cc:359] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.943500 13853 raft_consensus.cc:385] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.943773 13853 raft_consensus.cc:740] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.944417 13853 consensus_queue.cc:260] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.942499 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:54.945654 13578 raft_consensus.cc:3060] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.937992 13850 raft_consensus.cc:359] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.946252 13850 raft_consensus.cc:385] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.941790 13801 raft_consensus.cc:3060] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.942241 13847 ts_tablet_manager.cc:1434] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:54.947840 13847 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:54.948596 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:54.944890 13766 leader_election.cc:304] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:54.949189 13652 raft_consensus.cc:3060] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.949913 13939 raft_consensus.cc:2804] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.950335 13939 raft_consensus.cc:493] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.950665 13939 raft_consensus.cc:3060] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.952178 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30707476881c44db89b44a8a2e812372" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:54.952780 13651 raft_consensus.cc:3060] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.946559 13853 ts_tablet_manager.cc:1434] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:54.954893 13853 tablet_bootstrap.cc:492] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:54.942528 13903 raft_consensus.cc:2804] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.956566 13903 raft_consensus.cc:697] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:54.957792 13652 raft_consensus.cc:2468] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:03:54.958797 13903 consensus_queue.cc:237] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.961019 13853 tablet_bootstrap.cc:654] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.964178 13847 tablet_bootstrap.cc:654] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.953738 13801 raft_consensus.cc:2468] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:54.946514 13850 raft_consensus.cc:740] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.962771 13939 raft_consensus.cc:515] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.963003 13846 tablet_bootstrap.cc:654] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.967329 13691 leader_election.cc:304] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:54.968314 13965 raft_consensus.cc:2804] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.968789 13965 raft_consensus.cc:697] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:03:54.966619 13850 consensus_queue.cc:260] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:54.958958 13692 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:54.970927 13965 consensus_queue.cc:237] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:54.971861 13930 raft_consensus.cc:2804] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:54.972360 13930 raft_consensus.cc:697] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:03:54.973173 13578 raft_consensus.cc:2468] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:03:54.973133 13930 consensus_queue.cc:237] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:54.977906 13939 leader_election.cc:290] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:54.978372 13850 ts_tablet_manager.cc:1434] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:03:54.979367 13850 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:54.980351 13852 raft_consensus.cc:493] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.980867 13852 raft_consensus.cc:515] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:54.983213 13852 leader_election.cc:290] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:54.984325 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:54.984587 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:54.985026 13724 raft_consensus.cc:3060] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.985366 13649 raft_consensus.cc:2468] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:54.988081 13543 leader_election.cc:304] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:54.988246 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:54.988880 13652 raft_consensus.cc:3060] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.989169 13852 raft_consensus.cc:2804] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.989707 13852 raft_consensus.cc:493] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.990056 13852 raft_consensus.cc:3060] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.993429 13724 raft_consensus.cc:2468] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:55.014745 13764 leader_election.cc:304] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:55.015280 13652 raft_consensus.cc:2468] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:55.015655 13939 raft_consensus.cc:2804] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.016155 13939 raft_consensus.cc:697] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:55.016995 13939 consensus_queue.cc:237] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.020640 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:55.022330 13542 leader_election.cc:343] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.023545 13724 raft_consensus.cc:3060] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.006397 13651 raft_consensus.cc:2468] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:55.035038 13852 raft_consensus.cc:515] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.037290 13853 tablet_bootstrap.cc:492] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:55.037766 13853 ts_tablet_manager.cc:1403] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.006s
I20260709 13:03:55.033675 13726 raft_consensus.cc:2468] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:55.040032 13953 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.045105 13852 leader_election.cc:290] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:55.049445 13847 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:55.050813 13847 ts_tablet_manager.cc:1403] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.002s
I20260709 13:03:55.054229 13846 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:55.054715 13846 ts_tablet_manager.cc:1403] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.113s	user 0.028s	sys 0.033s
I20260709 13:03:55.057758 13846 raft_consensus.cc:359] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.058548 13846 raft_consensus.cc:385] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.057806 13476 catalog_manager.cc:5697] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.058846 13846 raft_consensus.cc:740] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.049117 13953 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.062314 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
W20260709 13:03:55.063653 13542 leader_election.cc:343] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.064075 13953 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:55.064293 13939 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.061213 13846 consensus_queue.cc:260] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.067554 13846 ts_tablet_manager.cc:1434] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:55.070354 13853 raft_consensus.cc:359] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.071205 13853 raft_consensus.cc:385] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.071497 13853 raft_consensus.cc:740] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.072806 13850 tablet_bootstrap.cc:654] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.082926 13846 tablet_bootstrap.cc:492] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:55.087121 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:55.087988 13578 raft_consensus.cc:2393] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:55.092417 13846 tablet_bootstrap.cc:654] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.094300 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:55.095147 13726 raft_consensus.cc:2393] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:55.096212 13616 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:55.097754 13956 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.066965 13541 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:55.104609 13847 raft_consensus.cc:359] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.105386 13847 raft_consensus.cc:385] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.105639 13847 raft_consensus.cc:740] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.106412 13903 raft_consensus.cc:2804] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.107021 13903 raft_consensus.cc:697] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:55.107919 13903 consensus_queue.cc:237] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.108129 13847 consensus_queue.cc:260] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.109766 13847 ts_tablet_manager.cc:1434] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.001s
I20260709 13:03:55.110658 13847 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:55.110940 13904 raft_consensus.cc:493] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.111505 13904 raft_consensus.cc:515] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.072044 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:55.114553 13651 raft_consensus.cc:3060] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.115996 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:55.113778 13904 leader_election.cc:290] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:55.117542 13476 catalog_manager.cc:5697] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:55.117575 13542 leader_election.cc:343] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.080216 13853 consensus_queue.cc:260] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.066641 13939 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.134269 13956 raft_consensus.cc:2749] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.138757 13846 tablet_bootstrap.cc:492] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:55.139038 13939 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:55.139300 13846 ts_tablet_manager.cc:1403] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.012s
I20260709 13:03:55.142016 13846 raft_consensus.cc:359] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.142481 13847 tablet_bootstrap.cc:654] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.142970 13853 ts_tablet_manager.cc:1434] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.002s
I20260709 13:03:55.143965 13853 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:55.146014 13846 raft_consensus.cc:385] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.146368 13846 raft_consensus.cc:740] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.146726 13651 raft_consensus.cc:2468] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:55.147076 13846 consensus_queue.cc:260] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.149727 13846 ts_tablet_manager.cc:1434] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:55.144728 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:55.070991 13473 catalog_manager.cc:5697] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 0 to 2, leader changed from <none> to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.155673 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:55.156323 13578 raft_consensus.cc:2468] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:55.156141 13473 catalog_manager.cc:5697] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.154345 13649 raft_consensus.cc:2468] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:55.155306 13543 leader_election.cc:304] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:55.157630 13767 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:55.159655 13846 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:55.161787 13900 raft_consensus.cc:2804] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.162186 13900 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.162518 13900 raft_consensus.cc:3060] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.163307 13903 raft_consensus.cc:2804] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.158294 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:55.166253 13846 tablet_bootstrap.cc:654] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.164129 13903 raft_consensus.cc:697] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:55.167294 13903 consensus_queue.cc:237] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.167632 13476 catalog_manager.cc:5697] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:55.172602 13543 leader_election.cc:343] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.173142 13543 leader_election.cc:304] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:55.175420 13852 raft_consensus.cc:2749] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.180685 13900 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.181981 14001 raft_consensus.cc:493] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.183200 14001 raft_consensus.cc:515] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.184158 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:55.184726 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:55.185382 13651 raft_consensus.cc:3060] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.185966 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:55.186688 13724 raft_consensus.cc:2468] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:55.188009 13541 leader_election.cc:304] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:55.185273 14001 leader_election.cc:290] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:55.184754 13578 raft_consensus.cc:3060] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.194097 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:55.194967 13801 raft_consensus.cc:2468] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:55.191239 13900 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:55.198575 14001 raft_consensus.cc:2804] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.202134 14001 raft_consensus.cc:493] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.202499 14001 raft_consensus.cc:3060] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.206125 13853 tablet_bootstrap.cc:654] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.207362 13578 raft_consensus.cc:2468] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:55.208629 13767 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:55.210718 13864 consensus_queue.cc:1048] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.216327 13850 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:55.216856 13850 ts_tablet_manager.cc:1403] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.005s
I20260709 13:03:55.217101 13846 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:55.217577 13846 ts_tablet_manager.cc:1403] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.020s
I20260709 13:03:55.219291 13651 raft_consensus.cc:2468] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:55.219465 13850 raft_consensus.cc:359] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.220188 13850 raft_consensus.cc:385] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.220470 13850 raft_consensus.cc:740] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.220384 13846 raft_consensus.cc:359] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.221360 13846 raft_consensus.cc:385] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.221692 13846 raft_consensus.cc:740] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.221432 13850 consensus_queue.cc:260] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.218919 13473 catalog_manager.cc:5697] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.222950 13853 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:55.222488 13846 consensus_queue.cc:260] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.223429 13853 ts_tablet_manager.cc:1403] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.001s
I20260709 13:03:55.214097 13900 raft_consensus.cc:2804] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.225767 13900 raft_consensus.cc:697] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:55.226231 13850 ts_tablet_manager.cc:1434] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:55.226760 13900 consensus_queue.cc:237] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.227597 13850 tablet_bootstrap.cc:492] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:55.233412 13846 ts_tablet_manager.cc:1434] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:03:55.235229 13853 raft_consensus.cc:359] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.237105 13853 raft_consensus.cc:385] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.237408 13853 raft_consensus.cc:740] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.220578 14001 raft_consensus.cc:515] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.238471 13850 tablet_bootstrap.cc:654] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.238984 13846 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:55.240978 14001 leader_election.cc:290] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:55.241689 13853 consensus_queue.cc:260] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.242260 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:55.242833 13801 raft_consensus.cc:3060] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.244167 13853 ts_tablet_manager.cc:1434] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:03:55.241585 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:55.248445 13853 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:55.248852 13724 raft_consensus.cc:3060] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.249583 13846 tablet_bootstrap.cc:654] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.252707 13920 consensus_queue.cc:1048] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.257891 13853 tablet_bootstrap.cc:654] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.272996 13476 catalog_manager.cc:5697] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.281361 13724 raft_consensus.cc:2468] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:55.282655 13541 leader_election.cc:304] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:55.283700 14001 raft_consensus.cc:2804] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.284178 14001 raft_consensus.cc:697] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:55.284772 13847 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:55.285261 13847 ts_tablet_manager.cc:1403] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.175s	user 0.011s	sys 0.000s
I20260709 13:03:55.284963 14001 consensus_queue.cc:237] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.287878 13847 raft_consensus.cc:359] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.288523 13847 raft_consensus.cc:385] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.288784 13847 raft_consensus.cc:740] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.282629 13801 raft_consensus.cc:2468] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:55.291733 13847 consensus_queue.cc:260] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.294673 13847 ts_tablet_manager.cc:1434] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:03:55.295837 13847 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:55.306391 13850 tablet_bootstrap.cc:492] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:55.306944 13850 ts_tablet_manager.cc:1403] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.003s
I20260709 13:03:55.309724 13850 raft_consensus.cc:359] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.313419 13850 raft_consensus.cc:385] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.313712 13850 raft_consensus.cc:740] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.314443 13850 consensus_queue.cc:260] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.316587 13850 ts_tablet_manager.cc:1434] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:55.317553 13847 tablet_bootstrap.cc:654] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.318184 13850 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:55.320995 13846 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:55.321712 13846 ts_tablet_manager.cc:1403] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.083s	user 0.032s	sys 0.013s
I20260709 13:03:55.330425 13920 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.331014 13920 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.333178 13920 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:55.334843 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:55.335520 13724 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:55.338383 13616 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:55.338891 13476 catalog_manager.cc:5697] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.336257 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:55.336844 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:55.339715 13956 raft_consensus.cc:2804] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.342139 13850 tablet_bootstrap.cc:654] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.342044 13956 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.342579 13956 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.345707 14001 raft_consensus.cc:493] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.346312 13801 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:55.346398 14001 raft_consensus.cc:515] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.351540 13956 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.352835 14001 leader_election.cc:290] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:55.354187 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:55.354470 13956 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:55.354907 13726 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.355530 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:55.356063 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:55.356189 13651 raft_consensus.cc:2468] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:55.356657 13801 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.357970 13543 leader_election.cc:304] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:55.359447 13903 raft_consensus.cc:2804] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.359797 13903 raft_consensus.cc:493] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.360128 13903 raft_consensus.cc:3060] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.362038 13904 consensus_queue.cc:1048] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.363713 13801 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:55.362103 13846 raft_consensus.cc:359] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.365257 13846 raft_consensus.cc:385] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.365469 13846 raft_consensus.cc:740] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.366129 13846 consensus_queue.cc:260] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.354063 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:55.367013 13724 raft_consensus.cc:2468] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:55.368741 13846 ts_tablet_manager.cc:1434] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:03:55.369519 13846 tablet_bootstrap.cc:492] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:55.367950 13617 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:55.372309 13956 raft_consensus.cc:2804] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.373073 13956 raft_consensus.cc:697] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:55.373944 13956 consensus_queue.cc:237] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.386011 13903 raft_consensus.cc:515] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.391458 13853 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:55.388353 13726 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:55.392009 13853 ts_tablet_manager.cc:1403] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.144s	user 0.025s	sys 0.015s
I20260709 13:03:55.395730 13853 raft_consensus.cc:359] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.396433 13853 raft_consensus.cc:385] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.396701 13853 raft_consensus.cc:740] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.397359 13853 consensus_queue.cc:260] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.397967 13900 raft_consensus.cc:493] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.398286 13846 tablet_bootstrap.cc:654] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.399384 13930 consensus_queue.cc:1048] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.400792 13853 ts_tablet_manager.cc:1434] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:55.404592 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:55.404645 13900 raft_consensus.cc:515] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.407500 13900 leader_election.cc:290] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:55.405360 13853 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:55.410342 13847 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:55.410899 13847 ts_tablet_manager.cc:1403] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.115s	user 0.018s	sys 0.020s
I20260709 13:03:55.412640 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:55.413456 13649 raft_consensus.cc:2393] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:55.414657 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:55.405352 13651 raft_consensus.cc:3060] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.419795 13767 leader_election.cc:304] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:03:55.422938 13847 raft_consensus.cc:359] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.423754 13847 raft_consensus.cc:385] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.424011 13847 raft_consensus.cc:740] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.424742 13847 consensus_queue.cc:260] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.427525 13847 ts_tablet_manager.cc:1434] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:03:55.430307 13900 raft_consensus.cc:3060] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.430757 13847 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:55.425625 13476 catalog_manager.cc:5697] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.440640 13853 tablet_bootstrap.cc:654] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.446208 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:55.446852 13727 raft_consensus.cc:3060] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.443439 13904 consensus_queue.cc:1048] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:55.451221 13651 raft_consensus.cc:2468] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:55.451978 13850 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:55.452495 13850 ts_tablet_manager.cc:1403] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.010s
I20260709 13:03:55.452780 13900 raft_consensus.cc:2749] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.455200 13850 raft_consensus.cc:359] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.455933 13850 raft_consensus.cc:385] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.456188 13850 raft_consensus.cc:740] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.452489 13543 leader_election.cc:304] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:55.457856 13847 tablet_bootstrap.cc:654] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.457653 13850 consensus_queue.cc:260] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.442654 13903 leader_election.cc:290] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:55.459250 13903 raft_consensus.cc:2804] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.459939 13903 raft_consensus.cc:697] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:55.464090 13850 ts_tablet_manager.cc:1434] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:55.465057 13850 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:55.464942 13846 tablet_bootstrap.cc:492] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:55.466755 13846 ts_tablet_manager.cc:1403] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.012s
I20260709 13:03:55.468648 13900 consensus_queue.cc:1048] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.472658 13850 tablet_bootstrap.cc:654] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.472362 13846 raft_consensus.cc:359] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.473062 13846 raft_consensus.cc:385] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.473359 13846 raft_consensus.cc:740] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.460803 13903 consensus_queue.cc:237] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.476207 13727 raft_consensus.cc:2468] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:55.474009 13846 consensus_queue.cc:260] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.487783 13846 ts_tablet_manager.cc:1434] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:03:55.489049 13846 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:55.500039 13846 tablet_bootstrap.cc:654] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.503696 13578 raft_consensus.cc:1275] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:55.506250 13960 consensus_queue.cc:1048] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:55.511937 13930 consensus_queue.cc:1048] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.527412 13649 raft_consensus.cc:1275] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:55.529211 13930 consensus_queue.cc:1048] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.544121 13853 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:55.544664 13853 ts_tablet_manager.cc:1403] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.140s	user 0.013s	sys 0.004s
I20260709 13:03:55.571545 13900 consensus_queue.cc:1048] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.566325 13853 raft_consensus.cc:359] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.575870 13850 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:55.576345 13853 raft_consensus.cc:385] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.576663 13853 raft_consensus.cc:740] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.577258 13850 ts_tablet_manager.cc:1403] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.112s	user 0.033s	sys 0.031s
I20260709 13:03:55.582317 13853 consensus_queue.cc:260] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.585347 13853 ts_tablet_manager.cc:1434] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:03:55.585943 13904 raft_consensus.cc:493] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.586612 13904 raft_consensus.cc:515] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.586493 13853 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:55.590147 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:55.591961 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:55.591522 13476 catalog_manager.cc:5697] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.592718 13727 raft_consensus.cc:2468] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:55.597802 13930 raft_consensus.cc:493] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.598414 13930 raft_consensus.cc:515] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.601100 13904 leader_election.cc:290] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:55.611521 13853 tablet_bootstrap.cc:654] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.613966 13850 raft_consensus.cc:359] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.614796 13850 raft_consensus.cc:385] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.615100 13850 raft_consensus.cc:740] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.618257 13846 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:55.619390 13846 ts_tablet_manager.cc:1403] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.008s
I20260709 13:03:55.622431 13850 consensus_queue.cc:260] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.612339 13541 leader_election.cc:304] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:55.626282 13852 raft_consensus.cc:2804] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.626199 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:55.626788 13852 raft_consensus.cc:493] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.627156 13852 raft_consensus.cc:3060] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.628829 13801 raft_consensus.cc:2468] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:55.630260 13904 raft_consensus.cc:493] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.630779 13904 raft_consensus.cc:515] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.618551 13930 leader_election.cc:290] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
W20260709 13:03:55.628751 13691 leader_election.cc:343] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.635485 13904 leader_election.cc:290] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:55.635782 13847 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:55.636410 13847 ts_tablet_manager.cc:1403] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.206s	user 0.019s	sys 0.038s
I20260709 13:03:55.626998 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:55.645987 13846 raft_consensus.cc:359] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.646855 13846 raft_consensus.cc:385] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.637390 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:55.647632 13850 ts_tablet_manager.cc:1434] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260709 13:03:55.647128 13846 raft_consensus.cc:740] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.650825 13846 consensus_queue.cc:260] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.642423 13953 raft_consensus.cc:493] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.656047 13692 leader_election.cc:343] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.656659 13692 leader_election.cc:304] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:55.660122 13846 ts_tablet_manager.cc:1434] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
I20260709 13:03:55.662774 13847 raft_consensus.cc:359] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.663537 13847 raft_consensus.cc:385] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:55.666549 13542 leader_election.cc:343] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.667959 13853 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:55.668447 13853 ts_tablet_manager.cc:1403] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 13:03:55.668699 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:55.663816 13847 raft_consensus.cc:740] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.658329 13965 raft_consensus.cc:2749] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.670508 13847 consensus_queue.cc:260] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.671103 13853 raft_consensus.cc:359] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.671831 13853 raft_consensus.cc:385] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.648343 14001 consensus_queue.cc:1048] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:03:55.672096 13853 raft_consensus.cc:740] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.673101 13853 consensus_queue.cc:260] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.676671 13850 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:55.676801 13853 ts_tablet_manager.cc:1434] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:55.679198 13846 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:55.673995 13904 consensus_queue.cc:1048] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:55.682824 13853 tablet_bootstrap.cc:492] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:55.661891 13953 raft_consensus.cc:515] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.682626 13965 raft_consensus.cc:493] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.688454 13965 raft_consensus.cc:515] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.686050 13847 ts_tablet_manager.cc:1434] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:03:55.692689 13847 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
W20260709 13:03:55.691744 13543 leader_election.cc:343] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.694041 13543 leader_election.cc:304] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:55.696621 13953 leader_election.cc:290] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:55.697364 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:55.698091 13578 raft_consensus.cc:2468] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:55.699302 13693 leader_election.cc:304] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:55.699832 13847 tablet_bootstrap.cc:654] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.700203 13930 raft_consensus.cc:2804] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.700485 13965 leader_election.cc:290] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:55.700078 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:55.702593 13801 raft_consensus.cc:2468] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:55.701995 13930 raft_consensus.cc:493] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.705363 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:55.703143 14001 consensus_queue.cc:1048] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.705845 13930 raft_consensus.cc:3060] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.709730 13852 raft_consensus.cc:515] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.710490 13617 leader_election.cc:304] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:55.704489 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:55.711501 13578 raft_consensus.cc:2468] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:55.711967 13846 tablet_bootstrap.cc:654] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.711458 13853 tablet_bootstrap.cc:654] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.716395 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:55.706090 13652 raft_consensus.cc:2468] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:55.711910 13852 leader_election.cc:290] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:55.718375 13920 raft_consensus.cc:2804] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.726720 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:55.727375 13799 raft_consensus.cc:3060] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.723110 13726 raft_consensus.cc:3060] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.731910 14038 raft_consensus.cc:2749] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.737069 13850 tablet_bootstrap.cc:654] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.739216 13847 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:55.739727 13847 ts_tablet_manager.cc:1403] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 13:03:55.741641 14038 raft_consensus.cc:493] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.742185 14038 raft_consensus.cc:515] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.744896 13847 raft_consensus.cc:359] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.745596 13847 raft_consensus.cc:385] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.745862 13847 raft_consensus.cc:740] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.745784 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:55.724594 13920 raft_consensus.cc:493] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.748966 13920 raft_consensus.cc:3060] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:55.749374 13541 leader_election.cc:343] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.751756 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:55.753145 13542 leader_election.cc:343] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.753580 13542 leader_election.cc:304] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:55.754197 14001 consensus_queue.cc:1048] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.754349 13904 raft_consensus.cc:2749] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.754407 14038 leader_election.cc:290] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:55.758160 13930 raft_consensus.cc:515] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.760730 13726 raft_consensus.cc:2468] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:55.747004 13847 consensus_queue.cc:260] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.765156 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:55.765854 13650 raft_consensus.cc:3060] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.766314 13847 ts_tablet_manager.cc:1434] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:03:55.767352 13847 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:55.772028 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:55.773326 13847 tablet_bootstrap.cc:654] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.765878 13541 leader_election.cc:304] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:55.775204 13578 raft_consensus.cc:3060] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.776762 13852 raft_consensus.cc:2804] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.784228 14001 consensus_queue.cc:1048] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.784557 13799 raft_consensus.cc:2468] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:55.767673 13930 leader_election.cc:290] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:55.781702 13852 raft_consensus.cc:697] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:55.797019 13650 raft_consensus.cc:2468] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:55.798507 13692 leader_election.cc:304] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:55.796751 13920 raft_consensus.cc:515] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.801008 13904 consensus_queue.cc:1048] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.804369 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:55.798521 13852 consensus_queue.cc:237] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.805631 13800 raft_consensus.cc:3060] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.804859 13920 leader_election.cc:290] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:55.806349 13930 raft_consensus.cc:2804] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.808283 13930 raft_consensus.cc:697] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:03:55.809090 13930 consensus_queue.cc:237] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.811237 13577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:55.811887 13577 raft_consensus.cc:3060] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.838554 13800 raft_consensus.cc:2468] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:55.838863 13846 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:55.841759 13846 ts_tablet_manager.cc:1403] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.005s
I20260709 13:03:55.842801 13617 leader_election.cc:304] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:55.843782 13920 raft_consensus.cc:2804] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.844329 13920 raft_consensus.cc:697] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:55.844498 13846 raft_consensus.cc:359] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.852301 13864 consensus_queue.cc:1048] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:55.855036 13920 consensus_queue.cc:237] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:55.856290 13577 raft_consensus.cc:2468] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:55.843945 13900 consensus_queue.cc:1048] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:03:55.854950 13846 raft_consensus.cc:385] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.860643 13846 raft_consensus.cc:740] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.861442 13846 consensus_queue.cc:260] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.862149 13850 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:55.862650 13850 ts_tablet_manager.cc:1403] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.187s	user 0.010s	sys 0.019s
I20260709 13:03:55.872414 13846 ts_tablet_manager.cc:1434] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:03:55.872098 13850 raft_consensus.cc:359] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.872844 13850 raft_consensus.cc:385] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.873147 13850 raft_consensus.cc:740] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.874444 13846 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:55.879643 13847 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:55.880173 13847 ts_tablet_manager.cc:1403] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.002s
I20260709 13:03:55.882688 13847 raft_consensus.cc:359] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.883327 13847 raft_consensus.cc:385] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.883576 13847 raft_consensus.cc:740] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.884213 13847 consensus_queue.cc:260] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.884334 13474 catalog_manager.cc:5697] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.886718 13853 tablet_bootstrap.cc:492] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:55.887224 13853 ts_tablet_manager.cc:1403] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.208s	user 0.015s	sys 0.001s
I20260709 13:03:55.888094 13847 ts_tablet_manager.cc:1434] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:03:55.889263 13847 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:55.893909 13846 tablet_bootstrap.cc:654] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.891074 13850 consensus_queue.cc:260] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:55.896411 13853 raft_consensus.cc:359] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.897260 13853 raft_consensus.cc:385] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.897535 13853 raft_consensus.cc:740] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.902769 13853 consensus_queue.cc:260] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.913551 13853 ts_tablet_manager.cc:1434] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 13:03:55.914732 13853 tablet_bootstrap.cc:492] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:55.915167 13900 consensus_queue.cc:1048] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.920126 13850 ts_tablet_manager.cc:1434] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 13:03:55.921348 13850 tablet_bootstrap.cc:492] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:55.925540 13578 raft_consensus.cc:2468] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:55.931568 13847 tablet_bootstrap.cc:654] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.939744 13956 raft_consensus.cc:493] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.944334 13956 raft_consensus.cc:515] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:55.946580 13956 leader_election.cc:290] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:55.947470 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:55.948527 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:55.952934 13616 leader_election.cc:343] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.959465 13864 consensus_queue.cc:1048] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.961244 13474 catalog_manager.cc:5697] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.968660 13903 consensus_queue.cc:1048] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.969565 13852 raft_consensus.cc:493] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.970089 13852 raft_consensus.cc:515] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:55.972110 13852 leader_election.cc:290] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:03:55.979722 13617 leader_election.cc:343] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.980751 13617 leader_election.cc:304] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:55.981782 13846 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:55.982312 13846 ts_tablet_manager.cc:1403] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.108s	user 0.022s	sys 0.002s
I20260709 13:03:55.985493 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:03:55.988179 13541 leader_election.cc:343] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.989712 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:55.990864 13956 raft_consensus.cc:2749] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.988188 13473 catalog_manager.cc:5697] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.992053 13850 tablet_bootstrap.cc:654] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.995319 13853 tablet_bootstrap.cc:654] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.998793 13965 raft_consensus.cc:493] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.999348 13965 raft_consensus.cc:515] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.005002 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:56.005750 13801 raft_consensus.cc:2468] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:56.015583 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
W20260709 13:03:56.009498 13543 leader_election.cc:343] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.016337 13576 raft_consensus.cc:2468] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:56.016295 13543 leader_election.cc:304] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:56.015590 13691 leader_election.cc:304] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:56.038144 14057 raft_consensus.cc:2804] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.033336 13852 raft_consensus.cc:2749] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.004343 13965 leader_election.cc:290] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.045637 13903 consensus_queue.cc:1048] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.038695 14057 raft_consensus.cc:493] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.048537 14057 raft_consensus.cc:3060] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.058408 13846 raft_consensus.cc:359] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.059563 13846 raft_consensus.cc:385] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.059844 13846 raft_consensus.cc:740] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.060694 13846 consensus_queue.cc:260] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.063161 13846 ts_tablet_manager.cc:1434] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 13:03:56.064177 13846 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:56.057103 14057 raft_consensus.cc:515] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.068265 14057 leader_election.cc:290] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.072520 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:56.073175 13801 raft_consensus.cc:3060] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.075084 13847 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:56.075577 13847 ts_tablet_manager.cc:1403] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.187s	user 0.011s	sys 0.016s
I20260709 13:03:56.076331 13853 tablet_bootstrap.cc:492] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:56.076822 13853 ts_tablet_manager.cc:1403] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.011s
I20260709 13:03:56.078641 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:56.079319 13576 raft_consensus.cc:3060] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.086621 13853 raft_consensus.cc:359] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.087365 13853 raft_consensus.cc:385] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.087630 13853 raft_consensus.cc:740] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.088263 13853 consensus_queue.cc:260] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.088805 13850 tablet_bootstrap.cc:492] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.089296 13850 ts_tablet_manager.cc:1403] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.168s	user 0.034s	sys 0.020s
I20260709 13:03:56.090754 13846 tablet_bootstrap.cc:654] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.092470 13850 raft_consensus.cc:359] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.093197 13850 raft_consensus.cc:385] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.093479 13850 raft_consensus.cc:740] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.094337 13850 consensus_queue.cc:260] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.096650 13850 ts_tablet_manager.cc:1434] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:03:56.096812 13853 ts_tablet_manager.cc:1434] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:03:56.097571 13850 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.097707 13853 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:56.101665 13953 raft_consensus.cc:493] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.102389 13953 raft_consensus.cc:515] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.104231 13853 tablet_bootstrap.cc:654] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.105165 13850 tablet_bootstrap.cc:654] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.106318 13846 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:56.106215 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:56.106827 13846 ts_tablet_manager.cc:1403] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:03:56.106904 13578 raft_consensus.cc:2468] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:56.108335 13619 leader_election.cc:304] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:56.109267 13956 raft_consensus.cc:2804] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.109656 13956 raft_consensus.cc:493] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.110095 13956 raft_consensus.cc:3060] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.109519 13846 raft_consensus.cc:359] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.110569 13846 raft_consensus.cc:385] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.110852 13846 raft_consensus.cc:740] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.111647 13846 consensus_queue.cc:260] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.112432 13801 raft_consensus.cc:2468] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:56.113755 13691 leader_election.cc:304] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:56.114688 13965 raft_consensus.cc:2804] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.111567 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:56.115250 13965 raft_consensus.cc:697] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:03:56.115777 13953 leader_election.cc:290] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.116125 13965 consensus_queue.cc:237] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:03:56.116890 13617 leader_election.cc:343] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.120965 13956 raft_consensus.cc:515] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.122884 13846 ts_tablet_manager.cc:1434] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:03:56.124009 13846 tablet_bootstrap.cc:492] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:56.124388 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:56.125592 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
W20260709 13:03:56.125902 13617 leader_election.cc:343] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.126303 13578 raft_consensus.cc:3060] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.108271 13576 raft_consensus.cc:2468] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:56.078661 13847 raft_consensus.cc:359] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.127822 13847 raft_consensus.cc:385] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.128080 13847 raft_consensus.cc:740] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.132000 13847 consensus_queue.cc:260] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.134534 13847 ts_tablet_manager.cc:1434] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.003s
I20260709 13:03:56.134665 13956 leader_election.cc:290] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.134557 13578 raft_consensus.cc:2468] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:56.135774 13847 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:56.135829 13853 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:56.137521 13619 leader_election.cc:304] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:56.138185 13853 ts_tablet_manager.cc:1403] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 13:03:56.140754 13853 raft_consensus.cc:359] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.141417 13853 raft_consensus.cc:385] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.141877 13956 raft_consensus.cc:2804] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.142143 13853 raft_consensus.cc:740] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.142902 13853 consensus_queue.cc:260] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.143285 13956 raft_consensus.cc:697] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:56.144222 13956 consensus_queue.cc:237] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.145334 13853 ts_tablet_manager.cc:1434] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:56.146404 13853 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:56.147415 13850 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.147907 13850 ts_tablet_manager.cc:1403] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.051s	user 0.004s	sys 0.007s
I20260709 13:03:56.151332 13850 raft_consensus.cc:359] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.153159 13850 raft_consensus.cc:385] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.153509 13850 raft_consensus.cc:740] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.154146 13850 consensus_queue.cc:260] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.156172 13847 tablet_bootstrap.cc:654] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.156394 13850 ts_tablet_manager.cc:1434] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:56.157605 13850 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.158380 13939 raft_consensus.cc:493] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.157773 13476 catalog_manager.cc:5697] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.158877 13939 raft_consensus.cc:515] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.159519 13853 tablet_bootstrap.cc:654] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.161103 13939 leader_election.cc:290] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.163414 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:56.164279 13846 tablet_bootstrap.cc:654] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.164220 13727 raft_consensus.cc:2468] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:56.165328 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:56.166026 13965 raft_consensus.cc:493] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.166581 13965 raft_consensus.cc:515] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.170419 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
W20260709 13:03:56.171680 13693 leader_election.cc:343] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.172204 13764 leader_election.cc:304] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:56.173169 13965 leader_election.cc:290] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.173305 13939 raft_consensus.cc:2804] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.173770 13939 raft_consensus.cc:493] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.165977 13650 raft_consensus.cc:2468] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:56.175038 13939 raft_consensus.cc:3060] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.178562 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:56.179992 13691 leader_election.cc:343] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.180734 13691 leader_election.cc:304] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:56.181625 13965 raft_consensus.cc:2749] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.185600 13850 tablet_bootstrap.cc:654] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.188212 13939 raft_consensus.cc:515] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.191380 13853 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:56.192035 13853 ts_tablet_manager.cc:1403] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.011s
I20260709 13:03:56.195539 13853 raft_consensus.cc:359] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.196745 13853 raft_consensus.cc:385] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.196979 13850 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.197248 13853 raft_consensus.cc:740] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.197710 13850 ts_tablet_manager.cc:1403] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:03:56.198438 13853 consensus_queue.cc:260] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.201140 13853 ts_tablet_manager.cc:1434] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:56.201112 13850 raft_consensus.cc:359] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.202055 13850 raft_consensus.cc:385] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.202625 13850 raft_consensus.cc:740] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.203291 13853 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:56.203475 13850 consensus_queue.cc:260] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.205801 13850 ts_tablet_manager.cc:1434] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:03:56.207108 13850 tablet_bootstrap.cc:492] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.209939 13853 tablet_bootstrap.cc:654] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.212807 13850 tablet_bootstrap.cc:654] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.221752 13853 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:56.222366 13853 ts_tablet_manager.cc:1403] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:03:56.223562 13850 tablet_bootstrap.cc:492] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.224097 13850 ts_tablet_manager.cc:1403] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.017s	user 0.002s	sys 0.011s
I20260709 13:03:56.224234 13475 catalog_manager.cc:5697] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.225436 13853 raft_consensus.cc:359] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.226155 13853 raft_consensus.cc:385] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.226432 13853 raft_consensus.cc:740] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.227103 13853 consensus_queue.cc:260] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.227056 13850 raft_consensus.cc:359] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.229687 13850 raft_consensus.cc:385] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.229972 13850 raft_consensus.cc:740] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.230777 13850 consensus_queue.cc:260] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.233801 13965 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.234169 13850 ts_tablet_manager.cc:1434] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:03:56.235149 13850 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.235857 13852 raft_consensus.cc:493] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.236367 13852 raft_consensus.cc:515] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.238457 13852 leader_election.cc:290] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.239801 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:56.241848 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:56.242532 13649 raft_consensus.cc:2468] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
W20260709 13:03:56.243824 13541 leader_election.cc:343] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.244683 13543 leader_election.cc:304] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:56.245932 13852 raft_consensus.cc:2804] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.246304 13852 raft_consensus.cc:493] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.246590 13850 tablet_bootstrap.cc:654] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.246623 13852 raft_consensus.cc:3060] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.250337 13965 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.252596 13965 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.253624 13847 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:56.254249 13847 ts_tablet_manager.cc:1403] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.008s
I20260709 13:03:56.254644 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:56.256965 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:56.257042 13693 leader_election.cc:343] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:56.258970 13691 leader_election.cc:343] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.259389 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:56.259502 13691 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:56.260298 13649 raft_consensus.cc:3060] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.261013 13965 raft_consensus.cc:2749] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.262794 13850 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.263432 13850 ts_tablet_manager.cc:1403] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.001s
I20260709 13:03:56.268288 13850 raft_consensus.cc:359] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.268978 13850 raft_consensus.cc:385] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.269342 13850 raft_consensus.cc:740] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.269973 13850 consensus_queue.cc:260] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.272486 13850 ts_tablet_manager.cc:1434] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:56.273450 13850 tablet_bootstrap.cc:492] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.275105 13953 consensus_queue.cc:1048] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.279546 13649 raft_consensus.cc:2468] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:56.279892 13850 tablet_bootstrap.cc:654] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.281185 13766 leader_election.cc:304] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:56.282223 13900 raft_consensus.cc:2804] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.282783 13900 raft_consensus.cc:697] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:56.283718 13900 consensus_queue.cc:237] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.291085 13850 tablet_bootstrap.cc:492] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.291661 13850 ts_tablet_manager.cc:1403] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 13:03:56.292501 13903 raft_consensus.cc:493] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.293026 13903 raft_consensus.cc:515] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.293738 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:56.294458 13727 raft_consensus.cc:3060] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.302773 13903 leader_election.cc:290] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:56.296018 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:56.303231 13956 consensus_queue.cc:1048] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:56.304383 13542 leader_election.cc:343] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.307863 13727 raft_consensus.cc:2468] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:56.309533 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:56.308507 13939 leader_election.cc:290] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.310259 13650 raft_consensus.cc:2468] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:56.311582 13850 raft_consensus.cc:359] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.312716 13850 raft_consensus.cc:385] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.312995 13850 raft_consensus.cc:740] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.313781 13543 leader_election.cc:304] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:56.313665 13850 consensus_queue.cc:260] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.314716 13903 raft_consensus.cc:2804] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.315089 13903 raft_consensus.cc:493] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.257064 13847 raft_consensus.cc:359] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.315524 13903 raft_consensus.cc:3060] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.315764 13847 raft_consensus.cc:385] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.316026 13850 ts_tablet_manager.cc:1434] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:03:56.285598 13852 raft_consensus.cc:515] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.316051 13847 raft_consensus.cc:740] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.317502 13847 consensus_queue.cc:260] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.315932 13853 ts_tablet_manager.cc:1434] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.000s
I20260709 13:03:56.320969 13850 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.322817 13476 catalog_manager.cc:5697] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.323566 14038 consensus_queue.cc:1048] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.324463 13903 raft_consensus.cc:515] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.323549 13846 tablet_bootstrap.cc:492] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:56.327401 13846 ts_tablet_manager.cc:1403] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.204s	user 0.058s	sys 0.060s
I20260709 13:03:56.327955 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
W20260709 13:03:56.329309 13542 leader_election.cc:343] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.330325 13903 leader_election.cc:290] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:56.328729 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:56.331395 13649 raft_consensus.cc:3060] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.332466 13846 raft_consensus.cc:359] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.333154 13846 raft_consensus.cc:385] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.333415 13846 raft_consensus.cc:740] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.333791 13939 raft_consensus.cc:493] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.334061 13846 consensus_queue.cc:260] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.334470 13939 raft_consensus.cc:515] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.334856 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:56.335460 13650 raft_consensus.cc:3060] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.336475 13846 ts_tablet_manager.cc:1434] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:03:56.337487 13846 tablet_bootstrap.cc:492] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:56.338343 13853 tablet_bootstrap.cc:492] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:56.338523 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:56.338960 13900 raft_consensus.cc:493] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.339265 13578 raft_consensus.cc:2393] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 1: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:03:56.339556 13900 raft_consensus.cc:515] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.341346 13939 leader_election.cc:290] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:56.341681 13900 leader_election.cc:290] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.342379 13847 ts_tablet_manager.cc:1434] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.002s
I20260709 13:03:56.343312 13846 tablet_bootstrap.cc:654] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.344457 13847 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:56.345311 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:56.345954 13651 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:56.346755 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:56.347843 13766 leader_election.cc:304] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
W20260709 13:03:56.348829 13764 leader_election.cc:343] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.350625 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:56.352434 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:56.352641 13900 raft_consensus.cc:2804] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.353276 13900 raft_consensus.cc:493] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.353626 13900 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:56.355728 13541 leader_election.cc:343] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.352479 13766 leader_election.cc:304] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:03:56.361604 13650 raft_consensus.cc:2468] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:56.362991 13939 raft_consensus.cc:3060] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.367057 13543 leader_election.cc:304] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:56.368798 14038 consensus_queue.cc:1048] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.370455 14001 raft_consensus.cc:2804] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.370994 14001 raft_consensus.cc:697] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:56.371840 14001 consensus_queue.cc:237] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.357997 13850 tablet_bootstrap.cc:654] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.392728 13649 raft_consensus.cc:2468] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:56.392927 13847 tablet_bootstrap.cc:654] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.398664 13930 consensus_queue.cc:1048] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:56.402307 13543 leader_election.cc:304] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:56.405707 13903 raft_consensus.cc:2804] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.406253 13903 raft_consensus.cc:697] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:56.407058 13903 consensus_queue.cc:237] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.412150 13953 raft_consensus.cc:493] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.412919 13953 raft_consensus.cc:515] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.415936 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:56.416772 13850 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.388387 13852 leader_election.cc:290] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.417296 13850 ts_tablet_manager.cc:1403] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.000s
I20260709 13:03:56.416620 13801 raft_consensus.cc:2468] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:56.419694 13617 leader_election.cc:304] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:56.420447 14038 raft_consensus.cc:493] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.420984 14038 raft_consensus.cc:515] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.409484 13900 raft_consensus.cc:515] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.420569 13956 raft_consensus.cc:2804] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.430433 13965 consensus_queue.cc:1048] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:03:56.437477 13850 raft_consensus.cc:359] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.438294 13850 raft_consensus.cc:385] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.438560 13850 raft_consensus.cc:740] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.439870 13953 leader_election.cc:290] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.441682 13850 consensus_queue.cc:260] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.428591 13956 raft_consensus.cc:493] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.470633 14038 leader_election.cc:290] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:56.471066 13900 leader_election.cc:290] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.471369 14005 raft_consensus.cc:493] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.471925 14005 raft_consensus.cc:515] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.473397 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:56.474023 13650 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.465675 13956 raft_consensus.cc:3060] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.475293 13853 tablet_bootstrap.cc:654] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.478065 13846 tablet_bootstrap.cc:492] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:56.478590 13846 ts_tablet_manager.cc:1403] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.141s	user 0.030s	sys 0.016s
I20260709 13:03:56.479339 14005 leader_election.cc:290] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:56.485121 13846 raft_consensus.cc:359] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.486765 13577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:56.487239 13956 raft_consensus.cc:515] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.485884 13846 raft_consensus.cc:385] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.489450 13850 ts_tablet_manager.cc:1434] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:03:56.489377 13846 raft_consensus.cc:740] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.491142 13850 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.494855 13846 consensus_queue.cc:260] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.488138 13939 raft_consensus.cc:2749] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.501053 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:56.502216 13652 raft_consensus.cc:2393] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:56.504381 13846 ts_tablet_manager.cc:1434] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:03:56.505391 13847 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:56.505911 13847 ts_tablet_manager.cc:1403] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.162s	user 0.029s	sys 0.014s
I20260709 13:03:56.507534 13846 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:56.487908 13650 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:56.516098 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:56.531955 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:56.532660 13727 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.535643 13766 leader_election.cc:304] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:03:56.536906 13766 leader_election.cc:304] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:56.537040 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:56.538211 13650 raft_consensus.cc:2393] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 816d755a8270492d88dac41d1d303c68 in current term 1: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:03:56.540911 13900 raft_consensus.cc:3060] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.541323 14005 raft_consensus.cc:2804] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.541839 14005 raft_consensus.cc:697] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:56.542259 13800 raft_consensus.cc:2468] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:56.542665 14005 consensus_queue.cc:237] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.544328 13965 consensus_queue.cc:1048] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.544926 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:56.545567 13799 raft_consensus.cc:3060] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.557673 13542 leader_election.cc:304] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:56.562729 14086 raft_consensus.cc:2804] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.563161 14086 raft_consensus.cc:493] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.563580 14086 raft_consensus.cc:3060] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.570902 13847 raft_consensus.cc:359] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.571668 13847 raft_consensus.cc:385] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.571934 13847 raft_consensus.cc:740] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.563165 13850 tablet_bootstrap.cc:654] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.577756 13847 consensus_queue.cc:260] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.588886 14093 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.595862 13847 ts_tablet_manager.cc:1434] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.001s
I20260709 13:03:56.597182 13847 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:56.586768 13956 leader_election.cc:290] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.589885 14093 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.609021 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
W20260709 13:03:56.610812 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:56.614949 13799 raft_consensus.cc:2468] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:56.616398 13617 leader_election.cc:304] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:56.617261 13920 raft_consensus.cc:2804] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.617743 13920 raft_consensus.cc:697] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:56.618541 13920 consensus_queue.cc:237] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.619589 13847 tablet_bootstrap.cc:654] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.627635 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:56.629277 13766 leader_election.cc:343] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.629793 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:56.630771 13725 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
W20260709 13:03:56.618522 14092 log.cc:927] Time spent T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:03:56.632601 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:56.627481 14093 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.641506 13764 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:56.643211 14093 raft_consensus.cc:2804] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.643481 13846 tablet_bootstrap.cc:654] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.644060 14093 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.644510 14093 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.645421 14086 raft_consensus.cc:515] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.629678 13900 raft_consensus.cc:2749] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.632679 13727 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:56.662551 13853 tablet_bootstrap.cc:492] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:56.663038 13853 ts_tablet_manager.cc:1403] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.325s	user 0.020s	sys 0.002s
I20260709 13:03:56.652931 13953 consensus_queue.cc:1048] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:03:56.666671 13956 consensus_queue.cc:1048] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.667425 13846 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:56.667905 13846 ts_tablet_manager.cc:1403] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.161s	user 0.009s	sys 0.005s
I20260709 13:03:56.666992 13576 raft_consensus.cc:2393] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:56.677873 14086 leader_election.cc:290] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:56.682865 13853 raft_consensus.cc:359] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.683722 13853 raft_consensus.cc:385] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.684046 13853 raft_consensus.cc:740] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.684796 13853 consensus_queue.cc:260] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.687120 13846 raft_consensus.cc:359] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.687690 13846 raft_consensus.cc:385] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.687976 13846 raft_consensus.cc:740] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.688694 13846 consensus_queue.cc:260] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.689416 13847 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:56.690186 13847 ts_tablet_manager.cc:1403] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.037s
I20260709 13:03:56.682510 14093 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.694252 14095 raft_consensus.cc:493] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.694896 14095 raft_consensus.cc:515] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.697310 14095 leader_election.cc:290] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.698315 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:56.699086 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:56.699757 13727 raft_consensus.cc:2468] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:56.701368 13764 leader_election.cc:304] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:56.702265 13900 raft_consensus.cc:2804] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.702623 13900 raft_consensus.cc:493] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.703346 13853 ts_tablet_manager.cc:1434] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:03:56.702966 13900 raft_consensus.cc:3060] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.699117 13799 raft_consensus.cc:2393] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 816d755a8270492d88dac41d1d303c68 in current term 1: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:03:56.704277 13853 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:56.710983 13850 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.711452 13850 ts_tablet_manager.cc:1403] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.221s	user 0.022s	sys 0.000s
I20260709 13:03:56.712095 13846 ts_tablet_manager.cc:1434] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 13:03:56.712925 13846 tablet_bootstrap.cc:492] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:56.713639 13965 consensus_queue.cc:1048] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.709448 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:56.714823 13576 raft_consensus.cc:2468] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:56.717890 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:56.719586 13543 leader_election.cc:304] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:56.722810 13847 raft_consensus.cc:359] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.723438 13847 raft_consensus.cc:385] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.723635 13847 raft_consensus.cc:740] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.726356 13475 catalog_manager.cc:5697] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.724406 13847 consensus_queue.cc:260] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.727154 14001 raft_consensus.cc:2749] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.744225 13847 ts_tablet_manager.cc:1434] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 13:03:56.746507 13847 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:56.748476 13846 tablet_bootstrap.cc:654] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.757583 13850 raft_consensus.cc:359] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.758350 13850 raft_consensus.cc:385] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.758633 13850 raft_consensus.cc:740] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.759434 13847 tablet_bootstrap.cc:654] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.759310 13850 consensus_queue.cc:260] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.761518 13850 ts_tablet_manager.cc:1434] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.000s
I20260709 13:03:56.744153 13853 tablet_bootstrap.cc:654] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.767948 14093 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.768311 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:56.768937 13650 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.775120 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:56.775887 13727 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.749491 13900 raft_consensus.cc:515] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.778739 13900 leader_election.cc:290] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:56.778967 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:56.779577 13725 raft_consensus.cc:3060] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.779793 13850 tablet_bootstrap.cc:492] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.780005 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:56.780654 13574 raft_consensus.cc:3060] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.786291 13850 tablet_bootstrap.cc:654] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.790422 13650 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:56.793823 13727 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:56.775857 13846 tablet_bootstrap.cc:492] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:56.796602 13846 ts_tablet_manager.cc:1403] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.002s
I20260709 13:03:56.799058 13764 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:56.797806 13574 raft_consensus.cc:2468] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:56.800066 14093 raft_consensus.cc:2804] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.800536 14093 raft_consensus.cc:697] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:56.800732 13767 leader_election.cc:304] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:56.801739 13900 raft_consensus.cc:2804] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.801553 14093 consensus_queue.cc:237] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.802307 13900 raft_consensus.cc:697] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:56.803241 13900 consensus_queue.cc:237] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.807499 13725 raft_consensus.cc:2468] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:56.809149 13846 raft_consensus.cc:359] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.812445 13846 raft_consensus.cc:385] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.812819 13846 raft_consensus.cc:740] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.814203 13846 consensus_queue.cc:260] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.815963 13853 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:56.815977 13847 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:56.821928 13847 ts_tablet_manager.cc:1403] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.002s
I20260709 13:03:56.816182 13472 catalog_manager.cc:5697] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.818317 13853 ts_tablet_manager.cc:1403] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.114s	user 0.025s	sys 0.016s
I20260709 13:03:56.824855 13847 raft_consensus.cc:359] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.825588 13847 raft_consensus.cc:385] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.825898 13847 raft_consensus.cc:740] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.826771 13853 raft_consensus.cc:359] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.826833 13847 consensus_queue.cc:260] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.827745 13853 raft_consensus.cc:385] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.828058 13853 raft_consensus.cc:740] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.828712 13853 consensus_queue.cc:260] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.830672 13853 ts_tablet_manager.cc:1434] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:56.830799 13847 ts_tablet_manager.cc:1434] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:56.831599 13853 tablet_bootstrap.cc:492] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:56.831781 13847 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:56.833822 13850 tablet_bootstrap.cc:492] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.834316 13850 ts_tablet_manager.cc:1403] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.011s
I20260709 13:03:56.836932 13850 raft_consensus.cc:359] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.836534 13472 catalog_manager.cc:5697] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.837623 13850 raft_consensus.cc:385] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.837973 13850 raft_consensus.cc:740] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.837864 14093 consensus_queue.cc:1048] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.838234 13847 tablet_bootstrap.cc:654] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.838786 13850 consensus_queue.cc:260] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.840816 13850 ts_tablet_manager.cc:1434] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:56.841436 13853 tablet_bootstrap.cc:654] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.856305 13850 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:56.862696 13850 tablet_bootstrap.cc:654] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.862396 14093 consensus_queue.cc:1048] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.864209 14086 consensus_queue.cc:1048] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.866014 13475 catalog_manager.cc:5697] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.819443 13846 ts_tablet_manager.cc:1434] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:56.873767 13903 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.874300 13903 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.876307 13903 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:56.877741 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:56.877972 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:56.878559 13727 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:56.878767 13801 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:56.879999 13541 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:56.881547 13903 raft_consensus.cc:2804] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.881950 13903 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.882306 13903 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.882913 14093 raft_consensus.cc:493] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.883414 14093 raft_consensus.cc:515] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.885526 14093 leader_election.cc:290] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.886380 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:56.887272 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:03:56.887939 13766 leader_election.cc:343] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.888054 13727 raft_consensus.cc:2468] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:56.889523 13764 leader_election.cc:304] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:56.891036 14093 raft_consensus.cc:2804] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.891413 14093 raft_consensus.cc:493] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.891757 14093 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.904644 13846 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:56.911747 13727 raft_consensus.cc:3060] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.922377 13847 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:56.923019 13847 ts_tablet_manager.cc:1403] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.091s	user 0.006s	sys 0.011s
I20260709 13:03:56.926208 13847 raft_consensus.cc:359] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.926959 13847 raft_consensus.cc:385] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.905663 14093 raft_consensus.cc:515] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:56.927260 13847 raft_consensus.cc:740] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.928329 13847 consensus_queue.cc:260] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.929986 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:56.930294 13847 ts_tablet_manager.cc:1434] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:56.931355 13847 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
W20260709 13:03:56.931617 13766 leader_election.cc:343] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.936064 13956 raft_consensus.cc:493] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.936702 13956 raft_consensus.cc:515] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:56.939939 13956 leader_election.cc:290] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.948962 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:56.944550 14093 leader_election.cc:290] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:56.914572 13903 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:56.951540 13850 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:56.952081 13850 ts_tablet_manager.cc:1403] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.111s	user 0.007s	sys 0.032s
W20260709 13:03:56.951928 13616 leader_election.cc:343] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.954712 13853 tablet_bootstrap.cc:492] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:56.955214 13853 ts_tablet_manager.cc:1403] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.124s	user 0.029s	sys 0.055s
I20260709 13:03:56.956073 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:56.956843 13578 raft_consensus.cc:2468] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:56.958094 13619 leader_election.cc:304] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:56.959023 13850 raft_consensus.cc:359] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.959709 13850 raft_consensus.cc:385] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.959961 13850 raft_consensus.cc:740] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.960605 13850 consensus_queue.cc:260] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:56.961438 14001 consensus_queue.cc:1048] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.961916 13920 raft_consensus.cc:2804] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.962349 13920 raft_consensus.cc:493] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.962713 13920 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.947585 13846 tablet_bootstrap.cc:654] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.943864 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:56.967303 13903 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:56.964769 13472 catalog_manager.cc:5697] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.968561 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:56.999439 13724 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.999948 13472 catalog_manager.cc:5697] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.000974 13847 tablet_bootstrap.cc:654] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.974320 14089 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.983255 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:56.980888 14090 consensus_queue.cc:1048] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:03:56.969575 13853 raft_consensus.cc:359] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.003762 14089 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.004202 13801 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.981594 14005 consensus_queue.cc:1048] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:03:57.005163 14086 consensus_queue.cc:1048] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.993557 13920 raft_consensus.cc:515] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.004534 13853 raft_consensus.cc:385] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.008865 13853 raft_consensus.cc:740] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.962977 13850 ts_tablet_manager.cc:1434] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:03:57.010550 13853 consensus_queue.cc:260] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.013118 13853 ts_tablet_manager.cc:1434] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.001s
I20260709 13:03:56.965155 13726 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.011170 13920 leader_election.cc:290] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:57.016930 13853 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:57.016762 13723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:03:57.019552 13541 leader_election.cc:343] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.013892 14089 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:57.012310 13801 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:57.030742 13542 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:57.032903 14086 raft_consensus.cc:2804] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.033473 14086 raft_consensus.cc:697] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:57.034395 14086 consensus_queue.cc:237] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.042286 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:57.042900 13578 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.044808 13847 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:57.045331 13847 ts_tablet_manager.cc:1403] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.009s
I20260709 13:03:57.048044 13847 raft_consensus.cc:359] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.048422 13726 raft_consensus.cc:2468] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:57.048729 13847 raft_consensus.cc:385] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.049130 13724 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:57.050405 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
W20260709 13:03:57.052033 13616 leader_election.cc:343] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.053361 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:57.049067 13847 raft_consensus.cc:740] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.055732 13850 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:57.055387 13847 consensus_queue.cc:260] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.058488 14005 consensus_queue.cc:1048] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.058995 13764 leader_election.cc:304] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.059940 14005 raft_consensus.cc:2804] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.060407 14005 raft_consensus.cc:697] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:57.060472 13847 ts_tablet_manager.cc:1434] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:03:57.061959 13847 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:57.064790 14005 consensus_queue.cc:237] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
W20260709 13:03:57.073601 13542 leader_election.cc:343] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.074122 13542 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:57.076376 13903 raft_consensus.cc:2749] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.077755 13847 tablet_bootstrap.cc:654] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.092854 13578 raft_consensus.cc:2468] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:57.094633 13619 leader_election.cc:304] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:57.095510 13920 raft_consensus.cc:2804] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.095992 13920 raft_consensus.cc:697] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:57.097184 13853 tablet_bootstrap.cc:654] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.097474 13920 consensus_queue.cc:237] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.121377 13846 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:57.123831 13846 ts_tablet_manager.cc:1403] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.254s	user 0.041s	sys 0.030s
I20260709 13:03:57.123489 13476 catalog_manager.cc:5697] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.122859 13847 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:57.125439 13847 ts_tablet_manager.cc:1403] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.004s
I20260709 13:03:57.142655 13850 tablet_bootstrap.cc:654] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.143692 13847 raft_consensus.cc:359] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.144411 13847 raft_consensus.cc:385] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.144681 13847 raft_consensus.cc:740] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.145717 14095 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.146304 14095 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.148494 14095 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:57.150156 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:57.145404 13847 consensus_queue.cc:260] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.152786 13578 raft_consensus.cc:2468] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:57.156594 13767 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:57.157864 14095 raft_consensus.cc:2804] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.158051 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:57.160326 13766 leader_election.cc:343] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.160506 14095 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.160928 14095 raft_consensus.cc:3060] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.161625 13473 catalog_manager.cc:5697] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.162886 14090 raft_consensus.cc:493] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.168385 13846 raft_consensus.cc:359] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.169082 13846 raft_consensus.cc:385] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.169354 13846 raft_consensus.cc:740] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.170325 13847 ts_tablet_manager.cc:1434] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:03:57.171355 13847 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:57.165673 14090 raft_consensus.cc:515] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.175352 14090 leader_election.cc:290] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:57.177212 13847 tablet_bootstrap.cc:654] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.177407 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:57.179001 13542 leader_election.cc:343] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.179499 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:57.190480 13846 consensus_queue.cc:260] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.192836 13846 ts_tablet_manager.cc:1434] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.002s
I20260709 13:03:57.193749 13846 tablet_bootstrap.cc:492] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
W20260709 13:03:57.201977 13543 leader_election.cc:343] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.202497 13543 leader_election.cc:304] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.210887 14005 consensus_queue.cc:1048] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.201159 14095 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.212484 13846 tablet_bootstrap.cc:654] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.221716 13850 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:57.223280 13850 ts_tablet_manager.cc:1403] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.213s	user 0.019s	sys 0.021s
I20260709 13:03:57.227262 13853 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:57.227859 13853 ts_tablet_manager.cc:1403] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.214s	user 0.016s	sys 0.007s
I20260709 13:03:57.228317 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:57.228945 13574 raft_consensus.cc:3060] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.230783 13853 raft_consensus.cc:359] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.231504 13853 raft_consensus.cc:385] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.231810 13853 raft_consensus.cc:740] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.232437 13853 consensus_queue.cc:260] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.235177 13853 ts_tablet_manager.cc:1434] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:03:57.236297 13853 tablet_bootstrap.cc:492] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:57.217813 14086 raft_consensus.cc:2749] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.243942 13853 tablet_bootstrap.cc:654] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.244833 13920 consensus_queue.cc:1048] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:57.253599 13920 consensus_queue.cc:1048] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.225991 13850 raft_consensus.cc:359] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.255959 13850 raft_consensus.cc:385] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.256306 13850 raft_consensus.cc:740] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.259455 13574 raft_consensus.cc:2468] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:57.260673 13767 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:57.261473 14005 raft_consensus.cc:2804] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.262349 14005 raft_consensus.cc:697] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:57.263334 14005 consensus_queue.cc:237] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.264444 13850 consensus_queue.cc:260] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.267011 13850 ts_tablet_manager.cc:1434] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:03:57.267958 13850 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:57.270609 13930 raft_consensus.cc:493] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.271366 13930 raft_consensus.cc:515] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.272169 13847 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:57.272675 13847 ts_tablet_manager.cc:1403] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.040s
I20260709 13:03:57.273813 13853 tablet_bootstrap.cc:492] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:57.275537 13847 raft_consensus.cc:359] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.275561 13853 ts_tablet_manager.cc:1403] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.003s
I20260709 13:03:57.276345 13847 raft_consensus.cc:385] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.276886 13847 raft_consensus.cc:740] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.277156 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:57.276396 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:57.278147 13847 consensus_queue.cc:260] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.269582 14095 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:57.275835 13930 leader_election.cc:290] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:57.279431 14090 raft_consensus.cc:493] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.279924 14090 raft_consensus.cc:515] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.280464 13846 tablet_bootstrap.cc:492] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:57.281035 13846 ts_tablet_manager.cc:1403] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.087s	user 0.035s	sys 0.018s
I20260709 13:03:57.282838 14090 leader_election.cc:290] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:57.284677 13574 raft_consensus.cc:2393] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 1: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:03:57.284809 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:57.284018 13846 raft_consensus.cc:359] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.285790 13846 raft_consensus.cc:385] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.286235 13846 raft_consensus.cc:740] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.289837 13650 raft_consensus.cc:2468] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:57.294436 13543 leader_election.cc:304] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:57.295472 14090 raft_consensus.cc:2804] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.295920 14090 raft_consensus.cc:493] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.296280 14090 raft_consensus.cc:3060] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.295560 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:57.296461 13693 leader_election.cc:304] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.297672 13930 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:57.297802 13541 leader_election.cc:343] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.303574 13847 ts_tablet_manager.cc:1434] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:03:57.304859 13847 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:57.306843 13846 consensus_queue.cc:260] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.320252 14095 consensus_queue.cc:1048] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.306121 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:57.328495 13853 raft_consensus.cc:359] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.329239 13853 raft_consensus.cc:385] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.329528 13853 raft_consensus.cc:740] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.332751 13846 ts_tablet_manager.cc:1434] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.002s
I20260709 13:03:57.338140 13847 tablet_bootstrap.cc:654] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.340981 13846 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:57.338820 13853 consensus_queue.cc:260] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.325958 14090 raft_consensus.cc:515] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.363066 14090 leader_election.cc:290] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:57.371477 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:57.372162 13649 raft_consensus.cc:3060] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:57.354880 13766 leader_election.cc:343] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.374349 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
W20260709 13:03:57.383503 13541 leader_election.cc:343] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.385835 13475 catalog_manager.cc:5697] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.387400 13853 ts_tablet_manager.cc:1434] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.110s	user 0.015s	sys 0.010s
I20260709 13:03:57.391750 13853 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:57.396075 13930 raft_consensus.cc:2749] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.400741 14005 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.401307 14005 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.403290 14005 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:57.404446 14095 consensus_queue.cc:1048] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.411924 13846 tablet_bootstrap.cc:654] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.411773 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:57.421777 13574 raft_consensus.cc:2468] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:57.407974 13850 tablet_bootstrap.cc:654] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.423836 13767 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:57.425194 13900 raft_consensus.cc:2804] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.407469 13476 catalog_manager.cc:5697] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.425556 13900 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.425909 13900 raft_consensus.cc:3060] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.415109 14093 consensus_queue.cc:1048] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:03:57.441919 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:57.445670 13920 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.446753 13920 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.405714 13649 raft_consensus.cc:2468] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:57.476436 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:03:57.448681 13764 leader_election.cc:343] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.477180 13726 raft_consensus.cc:2468] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:57.476438 13920 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:57.488462 13616 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:57.488533 13543 leader_election.cc:304] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:57.493666 13847 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:57.492923 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:57.493939 13956 raft_consensus.cc:2804] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.494463 13900 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.494921 13956 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.495332 13956 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.496670 13900 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:57.452354 13853 tablet_bootstrap.cc:654] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.497773 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:57.498430 13578 raft_consensus.cc:3060] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.466058 13846 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:57.499948 13846 ts_tablet_manager.cc:1403] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.159s	user 0.019s	sys 0.011s
I20260709 13:03:57.502648 13846 raft_consensus.cc:359] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.503311 13846 raft_consensus.cc:385] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.503561 13846 raft_consensus.cc:740] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.494177 13847 ts_tablet_manager.cc:1403] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.190s	user 0.021s	sys 0.017s
I20260709 13:03:57.504866 14089 raft_consensus.cc:2804] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.505716 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:57.505900 14089 raft_consensus.cc:697] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:57.507300 14089 consensus_queue.cc:237] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.509933 13578 raft_consensus.cc:2468] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:57.510285 13847 raft_consensus.cc:359] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.511010 13847 raft_consensus.cc:385] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.511060 13767 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:57.511381 13847 raft_consensus.cc:740] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.511978 13846 consensus_queue.cc:260] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.512503 14005 raft_consensus.cc:2804] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.513056 14005 raft_consensus.cc:697] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:57.514132 13846 ts_tablet_manager.cc:1434] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:57.513849 14005 consensus_queue.cc:237] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.515237 13846 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:57.516191 14140 consensus_queue.cc:1048] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.518512 13847 consensus_queue.cc:260] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.519997 13847 ts_tablet_manager.cc:1434] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:03:57.520682 13847 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:57.525648 13853 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:57.529027 13853 ts_tablet_manager.cc:1403] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.138s	user 0.010s	sys 0.001s
I20260709 13:03:57.529764 13847 tablet_bootstrap.cc:654] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.530941 13846 tablet_bootstrap.cc:654] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.533367 13853 raft_consensus.cc:359] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.534159 13853 raft_consensus.cc:385] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.536839 13853 raft_consensus.cc:740] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.537568 13853 consensus_queue.cc:260] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.539536 13846 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:57.540231 13846 ts_tablet_manager.cc:1403] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.009s
I20260709 13:03:57.503856 13920 raft_consensus.cc:493] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.543557 13846 raft_consensus.cc:359] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.544281 13846 raft_consensus.cc:385] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.544597 13846 raft_consensus.cc:740] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
W20260709 13:03:57.546363 13617 leader_election.cc:343] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.526263 13850 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:57.550601 13850 ts_tablet_manager.cc:1403] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.283s	user 0.013s	sys 0.010s
I20260709 13:03:57.553157 13850 raft_consensus.cc:359] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.553792 13850 raft_consensus.cc:385] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.549775 14147 consensus_queue.cc:1048] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.521308 13956 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.560216 13956 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:57.560644 13846 consensus_queue.cc:260] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.561945 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:57.562942 13847 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:57.564520 13727 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.539637 13853 ts_tablet_manager.cc:1434] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:57.565735 13846 ts_tablet_manager.cc:1434] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 13:03:57.566745 13846 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:57.567423 14086 consensus_queue.cc:1048] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.544086 13920 raft_consensus.cc:515] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.570679 13649 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.572347 13846 tablet_bootstrap.cc:654] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.564229 13850 raft_consensus.cc:740] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.572682 13853 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:57.564879 13847 ts_tablet_manager.cc:1403] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.020s
I20260709 13:03:57.575953 13847 raft_consensus.cc:359] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.579027 13847 raft_consensus.cc:385] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.579356 13847 raft_consensus.cc:740] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.579741 13850 consensus_queue.cc:260] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.584739 13853 tablet_bootstrap.cc:654] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.583563 13846 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:57.579998 13847 consensus_queue.cc:260] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.584086 13727 raft_consensus.cc:2468] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:57.585949 13846 ts_tablet_manager.cc:1403] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:03:57.586849 13850 ts_tablet_manager.cc:1434] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:03:57.587188 13616 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:57.587569 13847 ts_tablet_manager.cc:1434] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:03:57.587836 13850 tablet_bootstrap.cc:492] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:57.588153 14154 raft_consensus.cc:2804] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.588539 13847 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:57.589284 14154 raft_consensus.cc:697] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:57.590113 13846 raft_consensus.cc:359] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.593711 13846 raft_consensus.cc:385] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.594116 13846 raft_consensus.cc:740] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.594547 13850 tablet_bootstrap.cc:654] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.594933 13846 consensus_queue.cc:260] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.595018 13847 tablet_bootstrap.cc:654] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.597530 13846 ts_tablet_manager.cc:1434] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:03:57.590324 14154 consensus_queue.cc:237] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.602839 13846 tablet_bootstrap.cc:492] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:57.603315 13847 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:57.603844 13847 ts_tablet_manager.cc:1403] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
W20260709 13:03:57.606884 13764 leader_election.cc:343] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.610684 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:57.610826 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:57.611543 13727 raft_consensus.cc:2393] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:03:57.611841 14093 consensus_queue.cc:1048] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.615677 13846 tablet_bootstrap.cc:654] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.619822 14090 consensus_queue.cc:1048] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.627566 13847 raft_consensus.cc:359] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.628284 13847 raft_consensus.cc:385] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.628562 13847 raft_consensus.cc:740] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.629262 13847 consensus_queue.cc:260] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.606949 13853 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:57.640571 13853 ts_tablet_manager.cc:1403] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 13:03:57.641223 13930 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.641776 13930 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.643564 13853 raft_consensus.cc:359] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.644260 13853 raft_consensus.cc:385] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.644320 13930 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:57.644599 13853 raft_consensus.cc:740] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.645527 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:57.647982 13853 consensus_queue.cc:260] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.648568 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:57.649501 13574 raft_consensus.cc:2393] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 1: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:03:57.650619 14090 raft_consensus.cc:493] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.651124 14090 raft_consensus.cc:515] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.652493 13920 leader_election.cc:290] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:57.653221 14090 leader_election.cc:290] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:57.653436 13693 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:57.654649 13853 ts_tablet_manager.cc:1434] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
W20260709 13:03:57.655472 13617 leader_election.cc:343] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.655915 13930 raft_consensus.cc:3060] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.654903 13847 ts_tablet_manager.cc:1434] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 13:03:57.658025 13847 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:57.660218 13846 tablet_bootstrap.cc:492] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:57.660759 13846 ts_tablet_manager.cc:1403] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.000s
I20260709 13:03:57.661650 13850 tablet_bootstrap.cc:492] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:57.667501 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:57.666778 13850 ts_tablet_manager.cc:1403] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.015s
I20260709 13:03:57.670401 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:57.670509 13846 raft_consensus.cc:359] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.671254 13846 raft_consensus.cc:385] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.671542 13846 raft_consensus.cc:740] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.672210 13846 consensus_queue.cc:260] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.665632 13930 raft_consensus.cc:2749] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.674690 13850 raft_consensus.cc:359] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.676509 13850 raft_consensus.cc:385] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.676860 13850 raft_consensus.cc:740] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.677709 13850 consensus_queue.cc:260] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.679764 13850 ts_tablet_manager.cc:1434] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:03:57.683473 13617 leader_election.cc:304] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:57.679764 13846 ts_tablet_manager.cc:1434] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:03:57.686674 13956 raft_consensus.cc:2749] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.687942 13850 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:57.687227 13846 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
W20260709 13:03:57.688086 13543 leader_election.cc:343] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.691103 13847 tablet_bootstrap.cc:654] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:57.693747 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:57.697304 13846 tablet_bootstrap.cc:654] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.698105 13850 tablet_bootstrap.cc:654] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.698239 13847 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:57.698861 13847 ts_tablet_manager.cc:1403] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 13:03:57.706485 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:57.707259 13724 raft_consensus.cc:2468] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:57.709266 13846 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:57.709935 13846 ts_tablet_manager.cc:1403] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 13:03:57.710903 13472 catalog_manager.cc:5697] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.655726 13853 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:57.711937 13900 consensus_queue.cc:1048] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.712919 13846 raft_consensus.cc:359] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.713716 13846 raft_consensus.cc:385] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.714035 13846 raft_consensus.cc:740] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.714893 13846 consensus_queue.cc:260] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.716954 13850 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:57.717327 13846 ts_tablet_manager.cc:1434] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:57.717473 13850 ts_tablet_manager.cc:1403] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 13:03:57.718443 13846 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:57.724639 13847 raft_consensus.cc:359] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.725386 13847 raft_consensus.cc:385] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.725651 13847 raft_consensus.cc:740] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.720276 13850 raft_consensus.cc:359] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.727234 13850 raft_consensus.cc:385] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.727605 13850 raft_consensus.cc:740] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.727349 13847 consensus_queue.cc:260] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.728400 13850 consensus_queue.cc:260] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.729460 13847 ts_tablet_manager.cc:1434] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.001s
I20260709 13:03:57.730429 13847 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:57.730677 13850 ts_tablet_manager.cc:1434] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:03:57.731698 13850 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:57.732461 13541 leader_election.cc:304] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.733291 14089 raft_consensus.cc:2804] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.733676 14089 raft_consensus.cc:493] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.734019 14089 raft_consensus.cc:3060] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.726536 13846 tablet_bootstrap.cc:654] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.738281 13850 tablet_bootstrap.cc:654] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.743836 13475 catalog_manager.cc:5697] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.741604 14089 raft_consensus.cc:515] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.746897 13847 tablet_bootstrap.cc:654] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.749012 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
W20260709 13:03:57.750792 13543 leader_election.cc:343] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.751947 14089 leader_election.cc:290] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:57.755155 13850 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:57.730955 13473 catalog_manager.cc:5697] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.755667 13850 ts_tablet_manager.cc:1403] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 13:03:57.758543 13850 raft_consensus.cc:359] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.759204 13850 raft_consensus.cc:385] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.759469 13850 raft_consensus.cc:740] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.760115 13850 consensus_queue.cc:260] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.762219 13850 ts_tablet_manager.cc:1434] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:57.763115 13850 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:57.768684 13850 tablet_bootstrap.cc:654] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.774549 13850 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:57.775034 13850 ts_tablet_manager.cc:1403] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:03:57.774828 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:57.775619 13724 raft_consensus.cc:3060] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.777549 13850 raft_consensus.cc:359] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.778154 13850 raft_consensus.cc:385] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.778359 13850 raft_consensus.cc:740] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.778927 13850 consensus_queue.cc:260] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.781014 13850 ts_tablet_manager.cc:1434] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:57.781729 13850 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:57.784608 13724 raft_consensus.cc:2468] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:57.786952 13850 tablet_bootstrap.cc:654] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.805275 13541 leader_election.cc:304] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.806245 14089 raft_consensus.cc:2804] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.806762 14089 raft_consensus.cc:697] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:57.807639 14089 consensus_queue.cc:237] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.816803 13853 tablet_bootstrap.cc:654] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.817178 13846 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:57.818480 13846 ts_tablet_manager.cc:1403] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.100s	user 0.025s	sys 0.015s
I20260709 13:03:57.821074 13846 raft_consensus.cc:359] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.821733 13846 raft_consensus.cc:385] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.821976 13846 raft_consensus.cc:740] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.822602 13846 consensus_queue.cc:260] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.826453 13847 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:57.824846 13846 ts_tablet_manager.cc:1434] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:57.827521 13846 tablet_bootstrap.cc:492] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:57.826611 13900 consensus_queue.cc:1048] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:57.830377 13965 raft_consensus.cc:493] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.831032 13847 ts_tablet_manager.cc:1403] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.018s
I20260709 13:03:57.830955 13965 raft_consensus.cc:515] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:57.833061 13965 leader_election.cc:290] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:57.833828 13847 raft_consensus.cc:359] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.834124 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:57.834551 13847 raft_consensus.cc:385] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:57.835758 13691 leader_election.cc:343] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.836570 13847 raft_consensus.cc:740] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.837287 13847 consensus_queue.cc:260] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.840003 13847 ts_tablet_manager.cc:1434] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:57.840876 13847 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:57.847280 13846 tablet_bootstrap.cc:654] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.847122 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:57.848433 14089 raft_consensus.cc:493] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.849102 14089 raft_consensus.cc:515] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.852095 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:57.853809 13543 leader_election.cc:343] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.854578 13847 tablet_bootstrap.cc:654] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.854537 13965 raft_consensus.cc:493] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.857519 13965 raft_consensus.cc:515] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:57.860430 13965 leader_election.cc:290] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:57.861501 14089 leader_election.cc:290] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:57.846752 13472 catalog_manager.cc:5697] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.872476 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:57.874025 14089 raft_consensus.cc:493] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.876071 14089 raft_consensus.cc:515] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:57.878051 14001 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.878727 14001 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.880861 14001 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:57.882625 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:57.883284 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:57.884007 13800 raft_consensus.cc:2468] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
W20260709 13:03:57.884389 13543 leader_election.cc:343] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.885707 13542 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.888765 13649 raft_consensus.cc:3060] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.890264 14086 raft_consensus.cc:2804] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.890717 14086 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.891049 14086 raft_consensus.cc:3060] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.903015 14089 leader_election.cc:290] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:57.904716 13900 raft_consensus.cc:493] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.914558 13900 raft_consensus.cc:515] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.920027 13900 leader_election.cc:290] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:57.921686 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:57.920325 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:57.922399 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:57.924419 13574 raft_consensus.cc:2468] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:57.927258 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:57.928121 13652 raft_consensus.cc:2393] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:57.928658 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:57.929436 13724 raft_consensus.cc:2468] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:57.905164 14086 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.934381 13956 raft_consensus.cc:493] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.935074 13956 raft_consensus.cc:515] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:57.937151 14086 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:57.938297 13956 leader_election.cc:290] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:57.941056 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:57.941727 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
W20260709 13:03:57.943415 13692 leader_election.cc:343] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.943886 13692 leader_election.cc:304] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.944618 13965 raft_consensus.cc:2749] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.946223 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:57.947032 13576 raft_consensus.cc:2468] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
W20260709 13:03:57.948114 13543 leader_election.cc:343] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.953539 13619 leader_election.cc:304] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:57.955564 13853 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:57.956203 13853 ts_tablet_manager.cc:1403] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.301s	user 0.011s	sys 0.000s
I20260709 13:03:57.956337 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
W20260709 13:03:57.956569 13542 leader_election.cc:343] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:57.957278 13799 raft_consensus.cc:3060] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.959367 13692 leader_election.cc:304] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.962570 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:57.962024 13956 raft_consensus.cc:2804] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.969393 13930 raft_consensus.cc:3060] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.971832 13956 raft_consensus.cc:493] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.965521 13767 leader_election.cc:304] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:57.968389 13800 raft_consensus.cc:2468] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:57.985054 14005 raft_consensus.cc:2804] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:57.983700 13541 leader_election.cc:304] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:57.986339 13850 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:57.987425 13850 ts_tablet_manager.cc:1403] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.206s	user 0.066s	sys 0.107s
I20260709 13:03:57.985471 14005 raft_consensus.cc:493] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.990585 14005 raft_consensus.cc:3060] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.986418 13956 raft_consensus.cc:3060] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:58.006449 13541 leader_election.cc:343] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.006884 13541 leader_election.cc:304] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:58.011183 14089 raft_consensus.cc:2804] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.017642 14089 raft_consensus.cc:493] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.018033 14089 raft_consensus.cc:3060] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.995713 14001 consensus_queue.cc:1048] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
W20260709 13:03:58.014364 13766 leader_election.cc:343] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.041074 14086 raft_consensus.cc:2749] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.043517 14180 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.065024 13847 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:58.067931 13846 tablet_bootstrap.cc:492] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:58.079512 13847 ts_tablet_manager.cc:1403] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.239s	user 0.051s	sys 0.038s
I20260709 13:03:58.079792 13846 ts_tablet_manager.cc:1403] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.252s	user 0.028s	sys 0.038s
I20260709 13:03:58.068746 14154 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.067834 13900 consensus_queue.cc:1048] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:58.083462 13850 raft_consensus.cc:359] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.091861 13850 raft_consensus.cc:385] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.092162 13850 raft_consensus.cc:740] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.084426 13853 raft_consensus.cc:359] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.092727 13853 raft_consensus.cc:385] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.093008 13853 raft_consensus.cc:740] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.085083 14180 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.086114 13800 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.088258 13847 raft_consensus.cc:359] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.095592 13847 raft_consensus.cc:385] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.096052 13847 raft_consensus.cc:740] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.080111 14089 raft_consensus.cc:515] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.095178 14154 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.094462 13850 consensus_queue.cc:260] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.103758 13847 consensus_queue.cc:260] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:03:58.107915 13766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 53238.2us
I20260709 13:03:58.109020 14188 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.109683 14188 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.111368 13847 ts_tablet_manager.cc:1434] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:03:58.111296 13799 raft_consensus.cc:2468] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:58.112450 13847 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:58.113972 13853 consensus_queue.cc:260] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.116369 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.117029 13725 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:58.118085 13930 raft_consensus.cc:2749] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.102581 14095 consensus_queue.cc:1048] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:03:58.100642 14180 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:58.123245 13541 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:58.130263 13846 raft_consensus.cc:359] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.130664 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.115198 14005 raft_consensus.cc:515] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.131063 13846 raft_consensus.cc:385] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.132057 13846 raft_consensus.cc:740] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.134559 13853 ts_tablet_manager.cc:1434] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.164s	user 0.006s	sys 0.000s
I20260709 13:03:58.136976 14089 leader_election.cc:290] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.138973 14090 raft_consensus.cc:2804] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.105367 13956 raft_consensus.cc:515] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.150436 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:58.151207 13578 raft_consensus.cc:2468] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:58.157582 13847 tablet_bootstrap.cc:654] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.123533 14188 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:58.153285 14090 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.148810 14180 consensus_queue.cc:1048] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:03:58.175002 14154 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:58.175817 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:58.177778 13956 leader_election.cc:290] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:58.178889 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:58.165220 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:58.179849 13724 raft_consensus.cc:3060] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.184665 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:58.163491 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:58.186100 13578 raft_consensus.cc:3060] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.170636 14090 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:58.187675 13543 leader_election.cc:343] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.194499 13846 consensus_queue.cc:260] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.164745 13767 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:58.197332 14189 raft_consensus.cc:2804] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.197731 14189 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.198041 14189 raft_consensus.cc:3060] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.198607 14005 leader_election.cc:290] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:58.204910 13724 raft_consensus.cc:2468] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:58.206473 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:58.234500 13576 raft_consensus.cc:3060] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.234954 13578 raft_consensus.cc:2468] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:58.237531 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:58.209332 13542 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:58.240043 14089 raft_consensus.cc:2804] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.240538 14089 raft_consensus.cc:697] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:58.241305 14089 consensus_queue.cc:237] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.247471 13541 leader_election.cc:304] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:58.248816 14182 raft_consensus.cc:2804] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.249321 14182 raft_consensus.cc:697] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:58.250131 14182 consensus_queue.cc:237] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.255173 13847 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:58.255815 13847 ts_tablet_manager.cc:1403] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.000s
I20260709 13:03:58.258849 13956 consensus_queue.cc:1048] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.210038 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:58.259819 13798 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
W20260709 13:03:58.210731 13764 leader_election.cc:343] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:58.262552 13764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 83937.4us
I20260709 13:03:58.264067 13617 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:58.265051 13576 raft_consensus.cc:2468] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:58.220510 13853 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:58.228413 14189 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.309060 14189 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:58.229898 14185 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.232043 13850 ts_tablet_manager.cc:1434] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.244s	user 0.026s	sys 0.049s
I20260709 13:03:58.310045 14185 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.310739 13850 tablet_bootstrap.cc:492] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:58.232554 14090 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:03:58.266120 13766 leader_election.cc:343] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.266860 13900 consensus_queue.cc:1048] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.267958 13619 leader_election.cc:304] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:58.274374 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:58.275147 14139 consensus_queue.cc:1048] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:58.197965 13846 ts_tablet_manager.cc:1434] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.118s	user 0.008s	sys 0.000s
I20260709 13:03:58.294008 13956 raft_consensus.cc:2749] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:58.295302 14196 raft_consensus.cc:493] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.314059 14185 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.325757 14196 raft_consensus.cc:515] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.327910 14196 leader_election.cc:290] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:58.328791 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.329357 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:58.330741 13691 leader_election.cc:343] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.331076 13846 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:58.333238 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:58.301101 13847 raft_consensus.cc:359] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.334276 13847 raft_consensus.cc:385] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.334559 13847 raft_consensus.cc:740] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.335165 13847 consensus_queue.cc:260] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.337059 13847 ts_tablet_manager.cc:1434] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 13:03:58.337886 13847 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:58.316083 14090 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:58.350404 13846 tablet_bootstrap.cc:654] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.318014 13853 tablet_bootstrap.cc:654] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:58.316339 13766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 50303.6us
I20260709 13:03:58.323148 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:58.351500 13727 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.324978 14139 raft_consensus.cc:2804] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.354444 14139 raft_consensus.cc:697] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:58.355365 14139 consensus_queue.cc:237] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.317029 13767 leader_election.cc:304] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:58.358139 13847 tablet_bootstrap.cc:654] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:58.358826 13767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 51858.1us
I20260709 13:03:58.359786 13727 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:58.360785 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:58.361179 14095 raft_consensus.cc:2804] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.361347 13576 raft_consensus.cc:3060] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.354516 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:58.362555 13797 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.366148 13541 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:58.367159 14184 raft_consensus.cc:2804] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.367724 14184 raft_consensus.cc:697] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:03:58.361712 14095 raft_consensus.cc:697] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:58.367733 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:58.371462 13847 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:58.371971 13847 ts_tablet_manager.cc:1403] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:03:58.372773 13576 raft_consensus.cc:2468] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:58.324337 13800 raft_consensus.cc:3060] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.386175 13797 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:58.323561 13649 raft_consensus.cc:3060] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:58.344847 13764 leader_election.cc:343] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:58.324290 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 56484.4us
I20260709 13:03:58.392174 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:58.394088 13692 leader_election.cc:343] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.394565 13692 leader_election.cc:304] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:58.395299 14196 raft_consensus.cc:2749] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.375327 13846 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:58.377169 13472 catalog_manager.cc:5697] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.368778 14095 consensus_queue.cc:237] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.401693 13846 ts_tablet_manager.cc:1403] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.005s
I20260709 13:03:58.322198 13850 tablet_bootstrap.cc:654] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.402477 13472 catalog_manager.cc:5697] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.403508 13767 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:58.404371 14185 raft_consensus.cc:2804] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.404819 14185 raft_consensus.cc:697] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:58.405598 14185 consensus_queue.cc:237] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.392297 13800 raft_consensus.cc:2468] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:58.379470 13766 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:58.408955 13900 raft_consensus.cc:2749] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:58.374855 13847 raft_consensus.cc:359] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.368691 14184 consensus_queue.cc:237] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.420200 13847 raft_consensus.cc:385] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.420560 13847 raft_consensus.cc:740] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.427699 13847 consensus_queue.cc:260] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.429536 13853 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:58.429827 13847 ts_tablet_manager.cc:1434] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:03:58.430298 14090 consensus_queue.cc:1048] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.431342 14180 consensus_queue.cc:1048] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.432921 13847 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:58.439703 13847 tablet_bootstrap.cc:654] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.440369 13853 ts_tablet_manager.cc:1403] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.220s	user 0.020s	sys 0.012s
I20260709 13:03:58.406734 13846 raft_consensus.cc:359] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.446131 13846 raft_consensus.cc:385] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.446465 13846 raft_consensus.cc:740] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.447311 13846 consensus_queue.cc:260] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.448697 13853 raft_consensus.cc:359] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.451157 13853 raft_consensus.cc:385] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.452000 13853 raft_consensus.cc:740] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.449817 13846 ts_tablet_manager.cc:1434] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:03:58.453025 13850 tablet_bootstrap.cc:492] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:58.453518 13846 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:58.453544 13850 ts_tablet_manager.cc:1403] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.004s
I20260709 13:03:58.456350 14182 raft_consensus.cc:493] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.456864 14182 raft_consensus.cc:515] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.459079 14182 leader_election.cc:290] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.453519 13853 consensus_queue.cc:260] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.462154 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.463140 13846 tablet_bootstrap.cc:654] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:58.463526 13541 leader_election.cc:343] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.463193 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:58.466141 13543 leader_election.cc:343] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.466604 13543 leader_election.cc:304] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:58.467664 14182 raft_consensus.cc:2749] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.468703 13853 ts_tablet_manager.cc:1434] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:03:58.469589 13847 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:58.469993 13853 tablet_bootstrap.cc:492] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:58.470132 13847 ts_tablet_manager.cc:1403] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:03:58.474042 13847 raft_consensus.cc:359] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.474957 13847 raft_consensus.cc:385] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.475347 13847 raft_consensus.cc:740] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.475426 13850 raft_consensus.cc:359] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.476174 13850 raft_consensus.cc:385] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.476271 13846 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:58.476419 13847 consensus_queue.cc:260] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.477171 13846 ts_tablet_manager.cc:1403] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:03:58.477231 13850 raft_consensus.cc:740] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.478178 13850 consensus_queue.cc:260] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.479140 13847 ts_tablet_manager.cc:1434] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:58.480104 13847 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:58.480566 13850 ts_tablet_manager.cc:1434] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:03:58.482790 13846 raft_consensus.cc:359] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.483502 13846 raft_consensus.cc:385] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.483763 13846 raft_consensus.cc:740] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.484860 13853 tablet_bootstrap.cc:654] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.481564 13850 tablet_bootstrap.cc:492] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:58.485705 13847 tablet_bootstrap.cc:654] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.484524 13846 consensus_queue.cc:260] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.491078 13846 ts_tablet_manager.cc:1434] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:58.493022 13846 tablet_bootstrap.cc:492] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:58.494566 13853 tablet_bootstrap.cc:492] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:58.499112 13853 ts_tablet_manager.cc:1403] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 13:03:58.499198 13846 tablet_bootstrap.cc:654] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.498577 13850 tablet_bootstrap.cc:654] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.504841 13853 raft_consensus.cc:359] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.505707 13853 raft_consensus.cc:385] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.506023 13853 raft_consensus.cc:740] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.506894 13853 consensus_queue.cc:260] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.508426 13846 tablet_bootstrap.cc:492] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:58.508911 13846 ts_tablet_manager.cc:1403] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:03:58.509665 13853 ts_tablet_manager.cc:1434] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:58.510835 13853 tablet_bootstrap.cc:492] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:58.511973 13846 raft_consensus.cc:359] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.507485 13847 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:58.512686 13846 raft_consensus.cc:385] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.513115 13847 ts_tablet_manager.cc:1403] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.002s
I20260709 13:03:58.513106 13846 raft_consensus.cc:740] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.514180 13846 consensus_queue.cc:260] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.516577 13846 ts_tablet_manager.cc:1434] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:58.517570 13846 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:58.518513 13847 raft_consensus.cc:359] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.519201 13847 raft_consensus.cc:385] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.519443 13847 raft_consensus.cc:740] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.522377 13847 consensus_queue.cc:260] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.523860 13846 tablet_bootstrap.cc:654] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.527958 13853 tablet_bootstrap.cc:654] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.532312 14196 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.532825 14196 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.534286 13847 ts_tablet_manager.cc:1434] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:03:58.535449 13847 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:58.539546 14196 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:58.540890 13847 tablet_bootstrap.cc:654] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.541198 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:03:58.542586 13691 leader_election.cc:343] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.543217 14184 raft_consensus.cc:493] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.543763 14184 raft_consensus.cc:515] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.546720 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:58.547220 14184 leader_election.cc:290] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:03:58.548046 13543 leader_election.cc:343] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.548755 13853 tablet_bootstrap.cc:492] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:58.549259 13853 ts_tablet_manager.cc:1403] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.001s
I20260709 13:03:58.549541 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.549893 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:03:58.551298 13692 leader_election.cc:343] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.551694 13692 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:58.551939 13853 raft_consensus.cc:359] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.552632 13853 raft_consensus.cc:385] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.552914 13853 raft_consensus.cc:740] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.552968 13965 raft_consensus.cc:2749] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:58.553642 13541 leader_election.cc:343] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.553558 13853 consensus_queue.cc:260] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.554102 13541 leader_election.cc:304] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:58.555686 13853 ts_tablet_manager.cc:1434] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:58.556926 14182 raft_consensus.cc:2749] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.557052 13853 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:58.609673 14095 raft_consensus.cc:493] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.610394 14095 raft_consensus.cc:515] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.649271 13846 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:58.649596 14139 raft_consensus.cc:493] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.652311 13850 tablet_bootstrap.cc:492] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:58.652098 14139 raft_consensus.cc:515] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.652786 13850 ts_tablet_manager.cc:1403] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.171s	user 0.019s	sys 0.019s
I20260709 13:03:58.652930 13853 tablet_bootstrap.cc:654] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.654167 14139 leader_election.cc:290] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:58.656339 13850 raft_consensus.cc:359] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.656816 14139 raft_consensus.cc:493] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.656656 14095 leader_election.cc:290] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.657305 14139 raft_consensus.cc:515] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.658231 13850 raft_consensus.cc:385] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.658526 13850 raft_consensus.cc:740] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.658898 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.650653 13965 raft_consensus.cc:493] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.659267 14139 leader_election.cc:290] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.659163 13850 consensus_queue.cc:260] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.659699 13727 raft_consensus.cc:2468] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:58.666111 13965 raft_consensus.cc:515] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.668239 13965 leader_election.cc:290] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:58.669232 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:58.670866 13853 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:58.671386 13853 ts_tablet_manager.cc:1403] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.115s	user 0.027s	sys 0.032s
I20260709 13:03:58.672781 13850 ts_tablet_manager.cc:1434] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:03:58.674049 13853 raft_consensus.cc:359] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.674902 13853 raft_consensus.cc:385] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.675181 13853 raft_consensus.cc:740] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.675376 13850 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:58.676103 13853 consensus_queue.cc:260] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.675566 13764 leader_election.cc:304] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:58.677189 14189 raft_consensus.cc:2804] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.677542 14189 raft_consensus.cc:493] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.677861 14189 raft_consensus.cc:3060] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.678207 13853 ts_tablet_manager.cc:1434] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:03:58.679113 13853 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
W20260709 13:03:58.670894 13691 leader_election.cc:343] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.686877 14189 raft_consensus.cc:515] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.687845 13853 tablet_bootstrap.cc:654] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.689028 14189 leader_election.cc:290] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.692502 14095 raft_consensus.cc:493] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.692984 14095 raft_consensus.cc:515] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.695072 13846 ts_tablet_manager.cc:1403] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.007s
I20260709 13:03:58.696245 14095 leader_election.cc:290] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.695904 13473 catalog_manager.cc:5697] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.698486 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:58.699105 13800 raft_consensus.cc:2468] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:58.699401 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:58.699920 13727 raft_consensus.cc:3060] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.700457 13853 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:58.700930 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.701541 13725 raft_consensus.cc:2468] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:58.700894 13853 ts_tablet_manager.cc:1403] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.005s
I20260709 13:03:58.697516 13473 catalog_manager.cc:5697] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.704479 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.705054 13726 raft_consensus.cc:2468] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:58.707338 13727 raft_consensus.cc:2468] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:58.710186 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.710561 14090 raft_consensus.cc:493] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.711010 13724 raft_consensus.cc:2393] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:03:58.711151 14090 raft_consensus.cc:515] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.714726 13475 catalog_manager.cc:5697] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.722180 13617 leader_election.cc:304] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:58.727048 14147 raft_consensus.cc:2804] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.727526 14147 raft_consensus.cc:493] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.727873 14147 raft_consensus.cc:3060] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.720414 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:58.761111 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:58.764645 13846 raft_consensus.cc:359] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.765355 13846 raft_consensus.cc:385] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.765614 13846 raft_consensus.cc:740] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.752139 13649 raft_consensus.cc:2468] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:58.770713 13853 raft_consensus.cc:359] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.771441 13853 raft_consensus.cc:385] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:58.772277 13541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 44859.5us
I20260709 13:03:58.771720 13853 raft_consensus.cc:740] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.775187 13846 consensus_queue.cc:260] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.773304 13853 consensus_queue.cc:260] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.769862 14179 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.772456 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:58.783344 13853 ts_tablet_manager.cc:1434] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.002s
I20260709 13:03:58.783810 13651 raft_consensus.cc:3060] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.780922 14179 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.785578 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:58.786849 14179 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:58.781162 14090 leader_election.cc:290] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:58.790635 13764 leader_election.cc:304] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:58.802879 13764 leader_election.cc:304] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:58.806823 14147 raft_consensus.cc:515] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.809919 14095 raft_consensus.cc:2804] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.810065 14188 raft_consensus.cc:2804] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.810400 14095 raft_consensus.cc:493] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.810770 14095 raft_consensus.cc:3060] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.811833 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:58.812752 14188 raft_consensus.cc:697] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:58.813990 13647 raft_consensus.cc:2393] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 1: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:03:58.814338 14196 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.814816 14196 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.816820 14196 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:58.797446 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:58.813611 14188 consensus_queue.cc:237] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.820891 14139 consensus_queue.cc:1048] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.793548 13616 leader_election.cc:304] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:58.793826 13920 raft_consensus.cc:493] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.826215 13920 raft_consensus.cc:515] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.826612 14147 leader_election.cc:290] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:58.795878 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:58.831895 13574 raft_consensus.cc:2468] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:58.796497 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:58.787034 13652 raft_consensus.cc:3060] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.835184 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:58.835392 14139 raft_consensus.cc:2749] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:58.834712 13543 leader_election.cc:343] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.836834 13853 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:58.828923 13472 catalog_manager.cc:5697] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.830296 13920 leader_election.cc:290] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:03:58.829739 13541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 46866us
I20260709 13:03:58.801949 13846 ts_tablet_manager.cc:1434] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.106s	user 0.004s	sys 0.002s
I20260709 13:03:58.836974 13727 raft_consensus.cc:3060] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:58.839998 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:58.840483 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:58.841355 13578 raft_consensus.cc:2393] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 1: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
W20260709 13:03:58.841987 13543 leader_election.cc:343] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.842554 13847 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:58.843048 13847 ts_tablet_manager.cc:1403] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.308s	user 0.012s	sys 0.000s
I20260709 13:03:58.845727 13727 raft_consensus.cc:2468] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:58.845950 13850 tablet_bootstrap.cc:654] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.846575 13846 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:58.852118 13575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:58.852779 13575 raft_consensus.cc:2468] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:58.850620 14090 consensus_queue.cc:1048] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:58.850850 13693 leader_election.cc:304] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:58.856561 14196 raft_consensus.cc:2804] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.856930 14196 raft_consensus.cc:493] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.857262 14196 raft_consensus.cc:3060] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.862916 13619 leader_election.cc:304] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:58.869577 14147 raft_consensus.cc:2804] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.870086 14147 raft_consensus.cc:493] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.870471 14147 raft_consensus.cc:3060] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.833788 14095 raft_consensus.cc:515] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.881341 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.882093 13727 raft_consensus.cc:2468] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:58.882696 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:58.879278 14089 consensus_queue.cc:1048] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:58.888707 13652 raft_consensus.cc:2468] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:58.890062 13616 leader_election.cc:304] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:03:58.891604 14139 raft_consensus.cc:2804] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:58.891963 13900 consensus_queue.cc:1048] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.892369 14139 raft_consensus.cc:697] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:58.893250 14139 consensus_queue.cc:237] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:03:58.895212 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:58.897769 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:58.902494 13691 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:58.903820 14232 raft_consensus.cc:3060] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:58.905066 13543 consensus_peers.cc:597] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.906953 13846 tablet_bootstrap.cc:654] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.909468 13847 raft_consensus.cc:359] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.919611 13847 raft_consensus.cc:385] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.919971 13847 raft_consensus.cc:740] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.921025 13800 raft_consensus.cc:2393] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:03:58.920862 13847 consensus_queue.cc:260] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.906864 14193 raft_consensus.cc:493] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.924337 14193 raft_consensus.cc:515] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.928143 13472 catalog_manager.cc:5697] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.937894 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:58.938694 13726 raft_consensus.cc:2393] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 1: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:03:58.941787 14196 raft_consensus.cc:515] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:58.942744 13853 tablet_bootstrap.cc:654] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.945428 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:58.946061 13576 raft_consensus.cc:2468] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:03:58.948194 14147 raft_consensus.cc:515] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.950923 13847 ts_tablet_manager.cc:1434] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.001s
I20260709 13:03:58.951928 13847 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:58.955139 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:58.929165 14193 leader_election.cc:290] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.935772 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:58.957084 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:58.963536 13619 leader_election.cc:304] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:58.923840 14095 leader_election.cc:290] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.958236 13850 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:58.964608 13850 ts_tablet_manager.cc:1403] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.290s	user 0.011s	sys 0.001s
I20260709 13:03:58.964900 14241 raft_consensus.cc:2804] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:58.965432 14241 raft_consensus.cc:493] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.965860 14241 raft_consensus.cc:3060] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:58.967346 13850 raft_consensus.cc:359] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.968036 13850 raft_consensus.cc:385] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:58.968290 13850 raft_consensus.cc:740] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:58.968961 13850 consensus_queue.cc:260] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:58.975499 14241 raft_consensus.cc:515] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:58.978858 14241 leader_election.cc:290] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.981731 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:58.982776 13574 raft_consensus.cc:3060] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:58.983975 13616 leader_election.cc:343] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.929776 14232 raft_consensus.cc:2749] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:58.959848 13847 tablet_bootstrap.cc:654] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.961479 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:58.986625 13576 raft_consensus.cc:3060] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:58.958606 13691 leader_election.cc:343] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:58.961920 14147 leader_election.cc:290] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:58.961813 13476 catalog_manager.cc:5697] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.979450 13850 ts_tablet_manager.cc:1434] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:58.990523 13850 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:58.992949 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:58.994377 13724 raft_consensus.cc:3060] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.008894 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:58.944319 14196 leader_election.cc:290] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:59.009660 13578 raft_consensus.cc:3060] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.013332 13766 leader_election.cc:304] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:59.015754 14090 consensus_queue.cc:1048] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:59.018676 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:59.021947 13853 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:59.022359 13900 raft_consensus.cc:2749] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:59.022589 13853 ts_tablet_manager.cc:1403] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.186s	user 0.008s	sys 0.036s
I20260709 13:03:59.025364 14005 consensus_queue.cc:1048] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:59.029124 13576 raft_consensus.cc:2468] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
W20260709 13:03:58.946094 13542 leader_election.cc:343] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.036039 13847 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:59.038654 13847 ts_tablet_manager.cc:1403] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.003s
I20260709 13:03:59.045446 13578 raft_consensus.cc:2468] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:59.048233 13850 tablet_bootstrap.cc:654] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.041743 13542 leader_election.cc:304] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
W20260709 13:03:59.056519 13616 leader_election.cc:343] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.075737 14089 raft_consensus.cc:2749] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:59.077786 14188 consensus_queue.cc:1048] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:59.078197 13542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 132194us
W20260709 13:03:59.079255 13542 leader_election.cc:343] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.079681 13542 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:03:59.081255 14229 consensus_queue.cc:1048] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.063916 13724 raft_consensus.cc:2468] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:03:59.083145 13846 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:59.083690 13846 ts_tablet_manager.cc:1403] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.001s
I20260709 13:03:59.062681 13619 leader_election.cc:304] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:03:59.084842 13619 leader_election.cc:304] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:59.086269 14241 raft_consensus.cc:2804] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:59.087146 14241 raft_consensus.cc:697] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:59.087834 13574 raft_consensus.cc:2468] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:59.087968 14241 consensus_queue.cc:237] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:59.086522 14147 raft_consensus.cc:2804] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:59.086272 14180 raft_consensus.cc:2749] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:59.090409 14147 raft_consensus.cc:697] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:03:59.091830 14147 consensus_queue.cc:237] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:59.094631 13693 leader_election.cc:304] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:59.095345 13846 raft_consensus.cc:359] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.096822 13846 raft_consensus.cc:385] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.097086 13846 raft_consensus.cc:740] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.111053 13965 raft_consensus.cc:2804] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:59.111727 13965 raft_consensus.cc:697] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:03:59.112728 13965 consensus_queue.cc:237] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.133311 13847 raft_consensus.cc:359] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:59.134109 13847 raft_consensus.cc:385] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.134416 13847 raft_consensus.cc:740] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.135010 13847 consensus_queue.cc:260] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:59.137518 13847 ts_tablet_manager.cc:1434] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.098s	user 0.005s	sys 0.000s
I20260709 13:03:59.138546 13847 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:03:59.132335 13846 consensus_queue.cc:260] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.161262 13846 ts_tablet_manager.cc:1434] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.001s
I20260709 13:03:59.164923 13853 raft_consensus.cc:359] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.170397 14139 consensus_queue.cc:1048] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:59.172312 13853 raft_consensus.cc:385] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.174597 13853 raft_consensus.cc:740] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.176047 13853 consensus_queue.cc:260] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.183796 13846 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:59.228073 13847 tablet_bootstrap.cc:654] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.231721 13473 catalog_manager.cc:5697] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.233397 13473 catalog_manager.cc:5697] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.276008 14228 consensus_queue.cc:1048] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.284440 13846 tablet_bootstrap.cc:654] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.319839 13476 catalog_manager.cc:5697] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:59.322139 13766 consensus_peers.cc:597] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.327569 13766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 57750.7us
I20260709 13:03:59.364620 14231 raft_consensus.cc:493] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.365316 14231 raft_consensus.cc:515] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:59.381645 14231 leader_election.cc:290] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:03:59.388952 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:59.389364 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:59.391501 14185 consensus_queue.cc:1048] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:59.400864 13543 leader_election.cc:343] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:59.401503 13541 leader_election.cc:343] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.402351 13541 leader_election.cc:304] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:03:59.404768 13850 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:59.405294 13850 ts_tablet_manager.cc:1403] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.415s	user 0.017s	sys 0.010s
I20260709 13:03:59.406818 13847 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: No bootstrap required, opened a new log
I20260709 13:03:59.407349 13847 ts_tablet_manager.cc:1403] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.269s	user 0.009s	sys 0.003s
I20260709 13:03:59.407716 14185 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.408280 14185 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.411037 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:59.411736 13576 raft_consensus.cc:2468] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:59.413020 14231 raft_consensus.cc:2749] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:59.411870 13850 raft_consensus.cc:359] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.413550 13850 raft_consensus.cc:385] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.413883 13850 raft_consensus.cc:740] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.414825 13850 consensus_queue.cc:260] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.416707 13850 ts_tablet_manager.cc:1434] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:03:59.409952 13847 raft_consensus.cc:359] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.417192 13847 raft_consensus.cc:385] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.417480 13847 raft_consensus.cc:740] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.412634 14185 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:59.418131 13847 consensus_queue.cc:260] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.420145 13847 ts_tablet_manager.cc:1434] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:03:59.423498 13767 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:03:59.424468 14189 raft_consensus.cc:2804] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:59.424894 14189 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.426285 14189 raft_consensus.cc:3060] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.433287 14189 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.435118 13850 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:59.442359 13846 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:59.442888 13846 ts_tablet_manager.cc:1403] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.259s	user 0.011s	sys 0.000s
I20260709 13:03:59.450537 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:59.435297 13853 ts_tablet_manager.cc:1434] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.412s	user 0.037s	sys 0.022s
I20260709 13:03:59.436793 13965 raft_consensus.cc:493] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.451629 13965 raft_consensus.cc:515] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.452180 13853 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:59.453701 13965 leader_election.cc:290] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:59.454284 14185 consensus_queue.cc:1048] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:59.451146 13578 raft_consensus.cc:3060] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.456058 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cb9bb386e4e21b297137851efdc10" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:59.445679 13846 raft_consensus.cc:359] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.458539 13846 raft_consensus.cc:385] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.462414 13846 raft_consensus.cc:740] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.469560 13850 tablet_bootstrap.cc:654] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.475190 13578 raft_consensus.cc:2468] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:03:59.471967 13846 consensus_queue.cc:260] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.479619 13576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cb9bb386e4e21b297137851efdc10" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:59.480281 13576 raft_consensus.cc:2468] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:03:59.480779 13846 ts_tablet_manager.cc:1434] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:03:59.485107 13846 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:59.482232 13767 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
W20260709 13:03:59.477133 13691 leader_election.cc:343] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.482039 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:59.501309 13853 tablet_bootstrap.cc:654] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.485399 14189 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:59.504052 13693 leader_election.cc:304] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:59.504904 13930 raft_consensus.cc:2804] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:59.505270 13930 raft_consensus.cc:493] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.505393 13846 tablet_bootstrap.cc:654] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.505651 13930 raft_consensus.cc:3060] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.488462 14095 raft_consensus.cc:2804] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:59.508965 14095 raft_consensus.cc:697] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:03:59.509773 14095 consensus_queue.cc:237] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.528070 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:03:59.537866 14147 consensus_queue.cc:1048] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 13:03:59.563071 13766 leader_election.cc:343] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:59.564113 13766 leader_election.cc:343] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.578022 13965 consensus_queue.cc:1048] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.580955 13930 raft_consensus.cc:515] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.608047 14259 raft_consensus.cc:493] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.608708 14259 raft_consensus.cc:515] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.610853 14259 leader_election.cc:290] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:59.611258 13930 leader_election.cc:290] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:03:59.611626 13850 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:59.612092 13850 ts_tablet_manager.cc:1403] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.177s	user 0.022s	sys 0.064s
I20260709 13:03:59.612815 14257 consensus_queue.cc:1048] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:03:59.616521 13646 raft_consensus.cc:3060] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.616804 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:59.619798 13575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:59.622216 13850 raft_consensus.cc:359] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.623021 13850 raft_consensus.cc:385] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.623286 13850 raft_consensus.cc:740] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.624558 13799 raft_consensus.cc:3060] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.625299 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cb9bb386e4e21b297137851efdc10" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:59.626564 13619 leader_election.cc:304] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:59.628679 13846 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:03:59.629175 13846 ts_tablet_manager.cc:1403] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.019s
W20260709 13:03:59.630010 13691 leader_election.cc:343] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.631259 13578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cb9bb386e4e21b297137851efdc10" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:03:59.631847 13578 raft_consensus.cc:3060] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.633525 13850 consensus_queue.cc:260] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.638859 13965 consensus_queue.cc:1048] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:59.639217 13850 ts_tablet_manager.cc:1434] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:03:59.640904 13850 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:03:59.638715 13846 raft_consensus.cc:359] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:59.641472 13846 raft_consensus.cc:385] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.642222 13846 raft_consensus.cc:740] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.644338 13846 consensus_queue.cc:260] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:03:59.645161 13578 raft_consensus.cc:2468] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:03:59.648566 13846 ts_tablet_manager.cc:1434] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:03:59.649083 13693 leader_election.cc:304] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:03:59.658046 13965 raft_consensus.cc:2804] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:59.658632 13965 raft_consensus.cc:697] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:03:59.659456 13965 consensus_queue.cc:237] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.664492 13920 consensus_queue.cc:1048] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.691198 13846 tablet_bootstrap.cc:492] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:03:59.692551 14228 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.698963 14228 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.701359 14228 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:59.706359 13473 catalog_manager.cc:5697] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.708446 13846 tablet_bootstrap.cc:654] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.710309 14147 consensus_queue.cc:1048] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:03:59.737344 13850 tablet_bootstrap.cc:654] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.738351 13853 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:03:59.738513 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:03:59.743611 13726 raft_consensus.cc:3060] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.750555 13853 ts_tablet_manager.cc:1403] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.299s	user 0.009s	sys 0.005s
I20260709 13:03:59.724713 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:03:59.764849 13725 raft_consensus.cc:2468] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 0.
I20260709 13:03:59.766687 13541 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
W20260709 13:03:59.790169 14274 log.cc:927] Time spent T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:03:59.791673 14259 consensus_queue.cc:1048] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:59.776935 14228 raft_consensus.cc:2804] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:59.797127 14228 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.797552 14228 raft_consensus.cc:3060] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:59.812043 13542 leader_election.cc:343] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.855002 13853 raft_consensus.cc:359] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.857326 13853 raft_consensus.cc:385] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.858374 13853 raft_consensus.cc:740] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.856007 13475 catalog_manager.cc:5697] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.859345 13853 consensus_queue.cc:260] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.883396 13900 raft_consensus.cc:493] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.883967 13900 raft_consensus.cc:515] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:03:59.891924 13853 ts_tablet_manager.cc:1434] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.000s
I20260709 13:03:59.896847 13900 leader_election.cc:290] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:03:59.885973 14193 raft_consensus.cc:2749] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:59.906049 14139 consensus_queue.cc:1048] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:59.919433 14228 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.922276 14228 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:03:59.925554 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:03:59.926537 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:03:59.929351 13850 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:03:59.929890 13850 ts_tablet_manager.cc:1403] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.289s	user 0.035s	sys 0.037s
W20260709 13:03:59.931576 13766 leader_election.cc:343] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.932216 13853 tablet_bootstrap.cc:492] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:03:59.932827 13646 raft_consensus.cc:3060] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.932607 13850 raft_consensus.cc:359] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:03:59.933848 13850 raft_consensus.cc:385] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.934156 13850 raft_consensus.cc:740] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.934779 13850 consensus_queue.cc:260] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:03:59.932371 13542 leader_election.cc:343] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.937021 13850 ts_tablet_manager.cc:1434] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:59.937876 13850 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
W20260709 13:03:59.952862 13541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 60282.4us
I20260709 13:03:59.958019 13850 tablet_bootstrap.cc:654] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:59.953246 13767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 71305.2us
I20260709 13:03:59.964879 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:03:59.965559 13721 raft_consensus.cc:3060] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.976163 13573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:03:59.976866 13573 raft_consensus.cc:2468] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:03:59.984246 13767 leader_election.cc:304] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:03:59.992398 13900 raft_consensus.cc:2804] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:59.992787 13900 raft_consensus.cc:493] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.993093 13900 raft_consensus.cc:3060] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.988517 13721 raft_consensus.cc:2468] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:03:59.993324 14095 consensus_queue.cc:1048] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:00.015563 13900 raft_consensus.cc:515] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:00.019577 13853 tablet_bootstrap.cc:654] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.021525 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:00.022545 13900 leader_election.cc:290] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:00.022787 13766 leader_election.cc:343] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.026901 13541 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:00.039136 13846 tablet_bootstrap.cc:492] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:04:00.039412 13577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:04:00.039705 13846 ts_tablet_manager.cc:1403] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.389s	user 0.015s	sys 0.004s
I20260709 13:04:00.045346 13577 raft_consensus.cc:3060] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.045747 13846 raft_consensus.cc:359] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.046454 13846 raft_consensus.cc:385] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.046713 13846 raft_consensus.cc:740] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.051221 13846 consensus_queue.cc:260] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.053323 13846 ts_tablet_manager.cc:1434] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:04:00.055023 13577 raft_consensus.cc:2468] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:00.060093 13846 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8: Bootstrap starting.
I20260709 13:04:00.063271 13767 leader_election.cc:304] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:00.064095 14185 raft_consensus.cc:2804] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.064558 14185 raft_consensus.cc:697] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:00.066011 14185 consensus_queue.cc:237] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:00.058960 14294 raft_consensus.cc:2804] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.070926 14294 raft_consensus.cc:697] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
W20260709 13:04:00.073272 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:04:00.087857 13766 consensus_peers.cc:597] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:00.090945 14294 consensus_queue.cc:237] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:00.095458 13853 tablet_bootstrap.cc:492] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:04:00.096014 13853 ts_tablet_manager.cc:1403] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.164s	user 0.019s	sys 0.003s
I20260709 13:04:00.097301 13846 tablet_bootstrap.cc:654] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.107515 13965 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.108105 13965 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.114172 13965 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:00.113950 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:00.115243 13846 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8: No bootstrap required, opened a new log
I20260709 13:04:00.117125 13846 ts_tablet_manager.cc:1403] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.006s
W20260709 13:04:00.117240 13691 leader_election.cc:343] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.120106 13965 consensus_queue.cc:1048] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:00.123116 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:00.123468 13846 raft_consensus.cc:359] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:00.126312 13846 raft_consensus.cc:385] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.127759 13846 raft_consensus.cc:740] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.128575 13846 consensus_queue.cc:260] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:00.117267 13473 catalog_manager.cc:5697] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.131865 13846 ts_tablet_manager.cc:1434] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
W20260709 13:04:00.133833 13692 leader_election.cc:343] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.134399 13692 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:00.135928 13965 raft_consensus.cc:2749] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.138006 13850 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:04:00.138530 13850 ts_tablet_manager.cc:1403] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.201s	user 0.007s	sys 0.012s
I20260709 13:04:00.141194 13850 raft_consensus.cc:359] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:00.141913 13850 raft_consensus.cc:385] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.142139 13853 raft_consensus.cc:359] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.142830 13853 raft_consensus.cc:385] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.142190 13850 raft_consensus.cc:740] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.148983 13850 consensus_queue.cc:260] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:00.143103 13853 raft_consensus.cc:740] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.151469 13853 consensus_queue.cc:260] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.153546 13853 ts_tablet_manager.cc:1434] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.002s
I20260709 13:04:00.158015 13850 ts_tablet_manager.cc:1434] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:04:00.159077 13850 tablet_bootstrap.cc:492] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:04:00.163249 13853 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:04:00.167524 13475 catalog_manager.cc:5697] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:00.177224 13853 tablet_bootstrap.cc:654] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.182401 13850 tablet_bootstrap.cc:654] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.182727 13800 raft_consensus.cc:3060] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.195026 13853 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:04:00.196141 13853 ts_tablet_manager.cc:1403] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.004s
I20260709 13:04:00.196745 13850 tablet_bootstrap.cc:492] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:04:00.197245 13850 ts_tablet_manager.cc:1403] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.000s
I20260709 13:04:00.199005 13853 raft_consensus.cc:359] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:00.199704 13853 raft_consensus.cc:385] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.199999 13853 raft_consensus.cc:740] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.199784 13850 raft_consensus.cc:359] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.200474 13850 raft_consensus.cc:385] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.200691 13853 consensus_queue.cc:260] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:00.200924 14283 consensus_queue.cc:1048] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:00.200732 13850 raft_consensus.cc:740] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.203166 13853 ts_tablet_manager.cc:1434] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:00.203030 13850 consensus_queue.cc:260] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.205319 13850 ts_tablet_manager.cc:1434] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:00.206116 13853 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:04:00.206995 13850 tablet_bootstrap.cc:492] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0: Bootstrap starting.
I20260709 13:04:00.215849 13850 tablet_bootstrap.cc:654] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.226030 13853 tablet_bootstrap.cc:654] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.230679 13850 tablet_bootstrap.cc:492] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0: No bootstrap required, opened a new log
I20260709 13:04:00.231204 13850 ts_tablet_manager.cc:1403] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.005s
I20260709 13:04:00.233892 13850 raft_consensus.cc:359] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.234838 13850 raft_consensus.cc:385] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.235366 13850 raft_consensus.cc:740] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.235976 13850 consensus_queue.cc:260] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.240883 13850 ts_tablet_manager.cc:1434] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:00.244514 13853 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:04:00.244993 13853 ts_tablet_manager.cc:1403] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.007s
I20260709 13:04:00.247030 13853 raft_consensus.cc:359] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:00.247476 13853 raft_consensus.cc:385] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.247701 13853 raft_consensus.cc:740] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.248248 13853 consensus_queue.cc:260] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:00.249866 13853 ts_tablet_manager.cc:1434] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:04:00.251101 13853 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:04:00.255441 13853 tablet_bootstrap.cc:654] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.259532 13853 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:04:00.259989 13853 ts_tablet_manager.cc:1403] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:00.262430 13853 raft_consensus.cc:359] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:00.262928 13853 raft_consensus.cc:385] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.263131 13853 raft_consensus.cc:740] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.263576 13853 consensus_queue.cc:260] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:00.265281 13853 ts_tablet_manager.cc:1434] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:00.266168 13853 tablet_bootstrap.cc:492] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029: Bootstrap starting.
I20260709 13:04:00.272902 13853 tablet_bootstrap.cc:654] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.277429 13853 tablet_bootstrap.cc:492] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029: No bootstrap required, opened a new log
I20260709 13:04:00.277802 13853 ts_tablet_manager.cc:1403] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:00.279981 13853 raft_consensus.cc:359] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.280613 13853 raft_consensus.cc:385] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.280853 13853 raft_consensus.cc:740] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.281522 13853 consensus_queue.cc:260] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.283306 13853 ts_tablet_manager.cc:1434] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:00.321349 14185 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.321789 14185 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:00.323555 14185 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:00.324060 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:00.324455 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:04:00.324862 13726 raft_consensus.cc:2393] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 1: Already voted for candidate 816d755a8270492d88dac41d1d303c68 in this term.
I20260709 13:04:00.326406 13764 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:00.326988 14185 raft_consensus.cc:3060] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.332531 14185 raft_consensus.cc:2749] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.339687 14185 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.340113 14185 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.341794 14185 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:00.342619 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:00.343032 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:00.343297 13646 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:04:00.343667 13726 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 0.
I20260709 13:04:00.346939 13930 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.347465 13930 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.348383 13766 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:00.349195 14185 raft_consensus.cc:2804] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.349502 13930 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:00.350337 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:00.350971 13652 raft_consensus.cc:2468] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:04:00.351992 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:00.352142 13692 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:00.352609 13800 raft_consensus.cc:2468] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 0.
I20260709 13:04:00.353303 14283 raft_consensus.cc:2804] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.349547 14185 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.353742 14283 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.353957 14185 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.354180 14283 raft_consensus.cc:3060] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.361124 14185 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.361479 14283 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.363883 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:00.364368 14283 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:00.364454 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:00.365016 13652 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.364675 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:00.365381 13646 raft_consensus.cc:3060] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.365782 13800 raft_consensus.cc:3060] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.365530 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:00.366561 13726 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.370484 14193 raft_consensus.cc:493] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.370985 14193 raft_consensus.cc:515] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:00.372012 13800 raft_consensus.cc:2468] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:04:00.364045 14185 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:00.372586 13646 raft_consensus.cc:2468] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:04:00.373206 13691 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:00.372586 13726 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:00.375355 13764 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:00.374121 14283 raft_consensus.cc:2804] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.376971 14283 raft_consensus.cc:697] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:00.377095 13652 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:00.378108 14193 leader_election.cc:290] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:00.377862 14283 consensus_queue.cc:237] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.379230 14185 raft_consensus.cc:2804] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.380293 14185 raft_consensus.cc:697] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:00.381102 14185 consensus_queue.cc:237] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:00.383337 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:00.384155 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:04:00.391800 13574 raft_consensus.cc:2393] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 1: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:04:00.394552 13472 catalog_manager.cc:5697] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.400439 13619 leader_election.cc:304] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:00.401643 14193 raft_consensus.cc:3060] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.411149 14193 raft_consensus.cc:2749] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.413116 13472 catalog_manager.cc:5697] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 1 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:00.466351 14185 consensus_queue.cc:1048] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:00.476578 14189 consensus_queue.cc:1048] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:00.486253 14193 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.486904 14193 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:00.490192 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:00.490419 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:04:00.491173 14193 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:00.492046 13619 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:00.492784 14193 raft_consensus.cc:2749] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.535967 13646 raft_consensus.cc:3060] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.574479 14193 raft_consensus.cc:493] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.575356 14193 raft_consensus.cc:515] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:00.578291 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:00.578727 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68" is_pre_election: true
I20260709 13:04:00.578962 13726 raft_consensus.cc:2468] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:04:00.579355 13574 raft_consensus.cc:2468] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 0.
I20260709 13:04:00.577760 14193 leader_election.cc:290] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:00.580531 13619 leader_election.cc:304] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:00.581241 14193 raft_consensus.cc:2804] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.581683 14193 raft_consensus.cc:493] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.582008 14193 raft_consensus.cc:3060] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.589088 14193 raft_consensus.cc:515] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:00.591357 14193 leader_election.cc:290] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:00.591902 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:00.592535 13725 raft_consensus.cc:3060] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.598490 13725 raft_consensus.cc:2468] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:00.645888 13574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816d755a8270492d88dac41d1d303c68"
I20260709 13:04:00.651448 13574 raft_consensus.cc:3060] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.655815 13616 leader_election.cc:304] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:00.678750 14147 raft_consensus.cc:2804] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.679663 14147 raft_consensus.cc:697] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:00.681576 14147 consensus_queue.cc:237] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:00.749462 14286 consensus_queue.cc:1048] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:00.753263 13574 raft_consensus.cc:2468] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
W20260709 13:04:00.717823 13616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 66628.2us
I20260709 13:04:00.771301 14318 consensus_queue.cc:1048] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:00.773563 14095 consensus_queue.cc:1048] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:00.781476 13473 catalog_manager.cc:5697] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.898201 13900 consensus_queue.cc:1048] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:00.954734 14283 consensus_queue.cc:1048] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:00.973176 13930 consensus_queue.cc:1048] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:01.211843 14147 consensus_queue.cc:1048] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:01.445313 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 180271us
I20260709 13:04:01.521106 14320 consensus_queue.cc:1048] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:01.579741 13617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 56569.9us
W20260709 13:04:01.599741 13542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 91539us
W20260709 13:04:01.675484 13542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 67842.6us
W20260709 13:04:01.681655 13617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 92275.8us
I20260709 13:04:02.286468  7088 tablet_server.cc:179] TabletServer@127.6.236.1:0 shutting down...
I20260709 13:04:02.325394  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:02.325472 13619 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 173 similar messages]
I20260709 13:04:02.326510  7088 tablet_replica.cc:333] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.327674  7088 raft_consensus.cc:2243] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.328521  7088 raft_consensus.cc:2272] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.331586  7088 tablet_replica.cc:333] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.332613  7088 raft_consensus.cc:2243] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.333228  7088 raft_consensus.cc:2272] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.334421 13619 consensus_peers.cc:597] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.335920  7088 tablet_replica.cc:333] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.336627  7088 raft_consensus.cc:2243] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.337054  7088 raft_consensus.cc:2272] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.339774  7088 tablet_replica.cc:333] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.340678  7088 raft_consensus.cc:2243] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.341197  7088 raft_consensus.cc:2272] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.341900 13767 consensus_peers.cc:597] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.344007  7088 tablet_replica.cc:333] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.344888  7088 raft_consensus.cc:2243] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.345424  7088 raft_consensus.cc:2272] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.347972  7088 tablet_replica.cc:333] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.348495  7088 raft_consensus.cc:2243] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.349525  7088 raft_consensus.cc:2272] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.352244  7088 tablet_replica.cc:333] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.352907  7088 raft_consensus.cc:2243] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.353322  7088 raft_consensus.cc:2272] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.355444  7088 tablet_replica.cc:333] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.356253  7088 raft_consensus.cc:2243] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.356869  7088 raft_consensus.cc:2272] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.359875  7088 tablet_replica.cc:333] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
W20260709 13:04:02.360199 13619 consensus_peers.cc:597] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.360708  7088 raft_consensus.cc:2243] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.361179  7088 raft_consensus.cc:2272] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.363384  7088 tablet_replica.cc:333] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.364178  7088 raft_consensus.cc:2243] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.365077  7088 raft_consensus.cc:2272] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.367295  7088 tablet_replica.cc:333] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.367857  7088 raft_consensus.cc:2243] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.368713  7088 raft_consensus.cc:2272] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.371960  7088 tablet_replica.cc:333] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.372581  7088 raft_consensus.cc:2243] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.372968  7088 raft_consensus.cc:2272] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.375064  7088 tablet_replica.cc:333] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.375783  7088 raft_consensus.cc:2243] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.376366  7088 raft_consensus.cc:2272] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.379061  7088 tablet_replica.cc:333] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.379740  7088 raft_consensus.cc:2243] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.380812  7088 raft_consensus.cc:2272] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.383462  7088 tablet_replica.cc:333] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
W20260709 13:04:02.383435 13693 consensus_peers.cc:597] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.384502  7088 raft_consensus.cc:2243] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.385677  7088 raft_consensus.cc:2272] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.388581  7088 tablet_replica.cc:333] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
W20260709 13:04:02.388971 13619 consensus_peers.cc:597] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.389232  7088 raft_consensus.cc:2243] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.389750  7088 raft_consensus.cc:2272] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.391933  7088 tablet_replica.cc:333] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.392524  7088 raft_consensus.cc:2243] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.392937  7088 raft_consensus.cc:2272] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.395185  7088 tablet_replica.cc:333] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.395896  7088 raft_consensus.cc:2243] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.396865  7088 raft_consensus.cc:2272] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.397876 13674 debug-util.cc:398] Leaking SignalData structure 0x7b08002728e0 after lost signal to thread 7091
W20260709 13:04:02.399147 13674 debug-util.cc:398] Leaking SignalData structure 0x7b08002721a0 after lost signal to thread 13510
I20260709 13:04:02.400256  7088 tablet_replica.cc:333] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
W20260709 13:04:02.400592 13674 debug-util.cc:398] Leaking SignalData structure 0x7b0800283dc0 after lost signal to thread 13602
I20260709 13:04:02.401466  7088 raft_consensus.cc:2243] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.402902  7088 raft_consensus.cc:2272] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.402127 13674 debug-util.cc:398] Leaking SignalData structure 0x7b080033c260 after lost signal to thread 13677
W20260709 13:04:02.404701 13674 debug-util.cc:398] Leaking SignalData structure 0x7b08003918c0 after lost signal to thread 13751
I20260709 13:04:02.406033  7088 tablet_replica.cc:333] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
W20260709 13:04:02.406474 13674 debug-util.cc:398] Leaking SignalData structure 0x7b0800417ce0 after lost signal to thread 13825
I20260709 13:04:02.406898  7088 raft_consensus.cc:2243] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.407500  7088 raft_consensus.cc:2272] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.410358  7088 tablet_replica.cc:333] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.411213  7088 raft_consensus.cc:2243] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.412714  7088 raft_consensus.cc:2272] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.416127 13767 consensus_peers.cc:597] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.416477  7088 tablet_replica.cc:333] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.417382  7088 raft_consensus.cc:2243] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.417943  7088 raft_consensus.cc:2272] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.418541 13767 consensus_peers.cc:597] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.420954  7088 tablet_replica.cc:333] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.421900  7088 raft_consensus.cc:2243] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.422474  7088 raft_consensus.cc:2272] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.425536  7088 tablet_replica.cc:333] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.426604  7088 raft_consensus.cc:2243] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.427244  7088 raft_consensus.cc:2272] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.430224  7088 tablet_replica.cc:333] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.430949  7088 raft_consensus.cc:2243] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.432008  7088 raft_consensus.cc:2272] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.434866  7088 tablet_replica.cc:333] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.435608  7088 raft_consensus.cc:2243] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.436659  7088 raft_consensus.cc:2272] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.439388  7088 tablet_replica.cc:333] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.440086  7088 raft_consensus.cc:2243] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.440649  7088 raft_consensus.cc:2272] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.443699  7088 tablet_replica.cc:333] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.444442  7088 raft_consensus.cc:2243] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:02.444952 13767 consensus_peers.cc:597] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.445518  7088 raft_consensus.cc:2272] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.447646 13767 consensus_peers.cc:597] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.448644  7088 tablet_replica.cc:333] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.449484  7088 raft_consensus.cc:2243] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.450060  7088 raft_consensus.cc:2272] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.453182  7088 tablet_replica.cc:333] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.453960  7088 raft_consensus.cc:2243] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.454990  7088 raft_consensus.cc:2272] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.456032 13619 consensus_peers.cc:597] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.457732  7088 tablet_replica.cc:333] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.458556  7088 raft_consensus.cc:2243] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.459575  7088 raft_consensus.cc:2272] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.462539  7088 tablet_replica.cc:333] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.463270  7088 raft_consensus.cc:2243] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.463868  7088 raft_consensus.cc:2272] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.464311 13619 consensus_peers.cc:597] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.466800  7088 tablet_replica.cc:333] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.467609  7088 raft_consensus.cc:2243] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.468180  7088 raft_consensus.cc:2272] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.470983  7088 tablet_replica.cc:333] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.471727  7088 raft_consensus.cc:2243] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:02.472034 13767 consensus_peers.cc:597] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.472311  7088 raft_consensus.cc:2272] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.475351  7088 tablet_replica.cc:333] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.475829  7088 raft_consensus.cc:2243] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.476255  7088 raft_consensus.cc:2272] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.479061  7088 tablet_replica.cc:333] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.479764  7088 raft_consensus.cc:2243] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.480747  7088 raft_consensus.cc:2272] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.483274  7088 tablet_replica.cc:333] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.484017  7088 raft_consensus.cc:2243] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.484627  7088 raft_consensus.cc:2272] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.486982  7088 tablet_replica.cc:333] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.487460  7088 raft_consensus.cc:2243] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.487918  7088 raft_consensus.cc:2272] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.493546  7088 tablet_replica.cc:333] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.494694  7088 raft_consensus.cc:2243] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.495888  7088 raft_consensus.cc:2272] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.498831  7088 tablet_replica.cc:333] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.499487  7088 raft_consensus.cc:2243] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.500509  7088 raft_consensus.cc:2272] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.501118 13767 consensus_peers.cc:597] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.503352  7088 tablet_replica.cc:333] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.504215  7088 raft_consensus.cc:2243] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.504634  7088 raft_consensus.cc:2272] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.508034  7088 tablet_replica.cc:333] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.508654  7088 raft_consensus.cc:2243] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.509155  7088 raft_consensus.cc:2272] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.511440  7088 tablet_replica.cc:333] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.511938  7088 raft_consensus.cc:2243] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.512832  7088 raft_consensus.cc:2272] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.515543  7088 tablet_replica.cc:333] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.516165  7088 raft_consensus.cc:2243] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.517246  7088 raft_consensus.cc:2272] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.520017  7088 tablet_replica.cc:333] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: stopping tablet replica
I20260709 13:04:02.520671  7088 raft_consensus.cc:2243] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.521593  7088 raft_consensus.cc:2272] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.535077 13693 consensus_peers.cc:597] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.536343 13619 consensus_peers.cc:597] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.539023 13693 consensus_peers.cc:597] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.556486 13619 consensus_peers.cc:597] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.573073 13619 consensus_peers.cc:597] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.591889 13693 connection.cc:573] client connection to 127.6.236.1:40147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:04:02.605104 13693 consensus_peers.cc:597] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.607942 13693 consensus_peers.cc:597] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.608137  7088 tablet_server.cc:196] TabletServer@127.6.236.1:0 shutdown complete.
W20260709 13:04:02.672947 13619 consensus_peers.cc:597] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.698931  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:02.706008 14366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:02.708313 14367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:02.721518 14369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:02.733155  7088 server_base.cc:1061] running on GCE node
I20260709 13:04:02.738107  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:02.738446  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:02.738699  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602242738679 us; error 0 us; skew 500 ppm
I20260709 13:04:02.739540  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:04:02.757467 13767 consensus_peers.cc:597] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.771703  7088 webserver.cc:533] Webserver started at http://127.6.236.1:42637/ using document root <none> and password file <none>
I20260709 13:04:02.773746  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:02.774127  7088 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:04:02.780063 13767 consensus_peers.cc:597] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.782245 13619 consensus_peers.cc:597] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.786728  7088 fs_manager.cc:714] Time spent opening directory manager: real 0.011s	user 0.009s	sys 0.000s
W20260709 13:04:02.801956 13693 consensus_peers.cc:597] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.929870 14375 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:02.931167  7088 fs_manager.cc:730] Time spent opening block manager: real 0.132s	user 0.034s	sys 0.066s
I20260709 13:04:02.931631  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "816d755a8270492d88dac41d1d303c68"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-j4mc"
I20260709 13:04:02.932227  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:03.000792  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:03.002097  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:03.004191  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:03.021564 14388 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:04:03.261695 14390 raft_consensus.cc:493] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.262432 14390 raft_consensus.cc:515] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.270270 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.272722 14390 leader_election.cc:290] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:04:03.278236 13619 leader_election.cc:336] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.278703 13619 leader_election.cc:304] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:03.280375 14389 raft_consensus.cc:2749] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.326519  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:04:03.326871  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.311s	user 0.009s	sys 0.004s
I20260709 13:04:03.327176  7088 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:04:03.332661 14388 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:03.348506 14388 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.349457 14388 tablet_bootstrap.cc:492] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:03.350179 14388 ts_tablet_manager.cc:1403] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:04:03.353150 14388 raft_consensus.cc:359] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.353813 14388 raft_consensus.cc:740] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.354660 14388 consensus_queue.cc:260] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.367728 14388 ts_tablet_manager.cc:1434] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:04:03.368563 14388 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:03.389174 14388 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.390143 14388 tablet_bootstrap.cc:492] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:03.402499 14388 ts_tablet_manager.cc:1403] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.004s
I20260709 13:04:03.404888 14388 raft_consensus.cc:359] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.405541 14388 raft_consensus.cc:740] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.408317 14388 consensus_queue.cc:260] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.410153 14388 ts_tablet_manager.cc:1434] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:03.410923 14388 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:03.442952 14388 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.443878 14388 tablet_bootstrap.cc:492] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:03.444461 14388 ts_tablet_manager.cc:1403] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.008s
I20260709 13:04:03.446915 14388 raft_consensus.cc:359] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.447568 14388 raft_consensus.cc:740] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.448346 14388 consensus_queue.cc:260] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.450183 14388 ts_tablet_manager.cc:1434] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:04:03.450949 14388 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:03.470260 14388 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.471221 14388 tablet_bootstrap.cc:492] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:03.471849 14388 ts_tablet_manager.cc:1403] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:04:03.474293 14388 raft_consensus.cc:359] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.475091 14388 raft_consensus.cc:740] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.475907 14388 consensus_queue.cc:260] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.478132 14388 ts_tablet_manager.cc:1434] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:03.479034 14388 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:03.493593 14378 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.503505 14378 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.497800 14390 raft_consensus.cc:493] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.505095 14390 raft_consensus.cc:515] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.505641 14378 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.507323 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.509984 14390 leader_election.cc:290] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:03.511075 14330 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.511612 14330 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.513680 14352 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.514472 14330 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.514279 14352 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.516247 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.517452 14352 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.520583 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.521178 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:03.535974 13767 leader_election.cc:336] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.536631 13767 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:03.502689 14388 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.538728 14380 raft_consensus.cc:2749] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.539225 14388 tablet_bootstrap.cc:492] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:03.540144 14388 ts_tablet_manager.cc:1403] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.004s
W20260709 13:04:03.541290 13693 leader_election.cc:336] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.541745 13693 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:03.543576 14388 raft_consensus.cc:359] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.544329 14388 raft_consensus.cc:740] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.545765 14382 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.546139 14352 raft_consensus.cc:493] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.546353 14382 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.548672 14382 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.550205 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.551198 13721 raft_consensus.cc:2468] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:03.552788 13764 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:03.553651 14382 raft_consensus.cc:2804] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.554104 14382 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.554677 14382 raft_consensus.cc:3060] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.555610 14352 raft_consensus.cc:515] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.556846 14330 raft_consensus.cc:2749] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.545161 14388 consensus_queue.cc:260] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.559024 14388 ts_tablet_manager.cc:1434] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
W20260709 13:04:03.559320 13619 leader_election.cc:336] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.559782 13619 leader_election.cc:304] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:03.559967 14388 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:03.560807 14390 raft_consensus.cc:2749] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:03.571054 13693 leader_election.cc:336] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.574720 14330 raft_consensus.cc:493] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.575340 14330 raft_consensus.cc:515] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.578615 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.580247 13646 raft_consensus.cc:2468] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:04:03.574836 14382 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:03.583014 13767 leader_election.cc:336] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.584846 14330 leader_election.cc:290] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.587416 14352 leader_election.cc:290] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.587792 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.588047 14378 raft_consensus.cc:493] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.588598 14378 raft_consensus.cc:515] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.591528 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:03.591842 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.592255 13721 raft_consensus.cc:3060] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.571556 13693 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:03.595187 14391 raft_consensus.cc:2749] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.597121 13692 leader_election.cc:304] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:03.598358  7088 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:04:03.598717  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.272s	user 0.266s	sys 0.000s
I20260709 13:04:03.598320 14391 raft_consensus.cc:2804] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.606225 14391 raft_consensus.cc:493] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.606705 14391 raft_consensus.cc:3060] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.605721 14390 raft_consensus.cc:493] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.607234 14390 raft_consensus.cc:515] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.608553 14378 leader_election.cc:290] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.609236 14390 leader_election.cc:290] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:03.613202 14378 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.613804 14378 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.615948 14352 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.616575 14352 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.619457 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.605165 13721 raft_consensus.cc:2468] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:03.623813 13764 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:03.624701 14380 raft_consensus.cc:2804] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.616864 14382 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.625963 14380 raft_consensus.cc:697] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:03.626127 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.627018 14380 consensus_queue.cc:237] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.629489 14352 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.638482 14389 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.639147 14389 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.641841 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.642447 13799 raft_consensus.cc:2468] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:03.643528 13617 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:03.644172 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.644374 14390 raft_consensus.cc:2804] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.644937 14390 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.645385 14390 raft_consensus.cc:3060] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:03.647845 13767 leader_election.cc:336] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.648370 13767 leader_election.cc:304] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:03.649284 14189 raft_consensus.cc:2749] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.650462 14389 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.652041 14352 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.652612 14352 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:03.655038 13693 leader_election.cc:336] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:03.655851 13693 leader_election.cc:336] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.656230 13693 leader_election.cc:304] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:03.657382 14330 raft_consensus.cc:2749] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.662326 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.664788 14352 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:03.666052 13619 leader_election.cc:336] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:03.667030 13767 leader_election.cc:336] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.645502 14378 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.673775 14391 raft_consensus.cc:515] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.677587 14391 leader_election.cc:290] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:03.673805 13693 leader_election.cc:336] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.678274 13693 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:03.681895 14391 raft_consensus.cc:2749] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:03.683043 13693 leader_election.cc:336] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.683442 13693 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:03.684593 14378 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.685115 14378 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.686357 14391 raft_consensus.cc:2749] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.687709 14189 raft_consensus.cc:493] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.688200 14189 raft_consensus.cc:515] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.688524 14352 raft_consensus.cc:493] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.689065 14352 raft_consensus.cc:515] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.689990 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.690606 13725 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:03.691275 14352 leader_election.cc:290] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.691948 14389 raft_consensus.cc:493] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.692351 13764 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:03.690215 13475 catalog_manager.cc:5697] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.692437 14389 raft_consensus.cc:515] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.693487 14382 raft_consensus.cc:2804] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.697181 14382 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.697570 14382 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.697854 14389 leader_election.cc:290] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.700707 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.701371 13725 raft_consensus.cc:2468] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:03.702585 13764 leader_election.cc:304] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:03.703887 14377 raft_consensus.cc:2804] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.704149 14358 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.704726 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.694351 14352 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.705415 13797 raft_consensus.cc:2468] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:03.705825 14352 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.704739 14358 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.707983 14352 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.708403 14358 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.710639 13617 leader_election.cc:304] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:03.711663 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.704312 14377 raft_consensus.cc:493] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.712867 14377 raft_consensus.cc:3060] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.712262 14382 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.714229 13619 leader_election.cc:304] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:03.714936 14389 raft_consensus.cc:2804] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.715324 14389 raft_consensus.cc:493] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.715670 14389 raft_consensus.cc:3060] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:03.716621 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 50616.3us
I20260709 13:04:03.717101 14390 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.721750 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:03.722462 13725 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.723364 14389 raft_consensus.cc:515] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.725430 14389 leader_election.cc:290] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.723788 14390 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.726387 13646 raft_consensus.cc:2393] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 2: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:04:03.727309 14378 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:03.727972 13767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 60981.3us
W20260709 13:04:03.728456 13767 leader_election.cc:336] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.730034 13766 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
W20260709 13:04:03.730412 13693 leader_election.cc:336] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.712349 13797 raft_consensus.cc:2468] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:03.734959 13617 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:03.735745 14380 raft_consensus.cc:3060] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.736909 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:03.737326 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:03.737478 13799 raft_consensus.cc:3060] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.739806 14358 raft_consensus.cc:2804] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.740247 14358 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.740607 14358 raft_consensus.cc:3060] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.740819 14388 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.741765 14388 tablet_bootstrap.cc:492] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:03.742430 14388 ts_tablet_manager.cc:1403] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.183s	user 0.018s	sys 0.001s
I20260709 13:04:03.744289 14189 leader_election.cc:290] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.745041 14388 raft_consensus.cc:359] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.745735 14388 raft_consensus.cc:740] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.747169 14352 raft_consensus.cc:493] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.747731 14352 raft_consensus.cc:515] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.749749 14352 leader_election.cc:290] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.751480 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.754642 14388 consensus_queue.cc:260] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.755396 13725 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:03.756769 13764 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:03.726008 14389 raft_consensus.cc:2749] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:03.750808 13693 leader_election.cc:336] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.756971 14388 ts_tablet_manager.cc:1434] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:04:03.760886 14378 raft_consensus.cc:2804] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.761011 14388 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:03.762395 14382 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.764920 14378 raft_consensus.cc:697] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
W20260709 13:04:03.766149 13767 leader_election.cc:336] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.765918 14378 consensus_queue.cc:237] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.768711 14410 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.769215 14410 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.771342 14410 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.750283 13799 raft_consensus.cc:2468] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:03.772078 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.772737 13721 raft_consensus.cc:2468] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:03.773371 14377 raft_consensus.cc:515] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:03.772428 13693 leader_election.cc:336] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.772657 14352 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.775048 14352 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.776293 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:03.776883 13721 raft_consensus.cc:3060] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.777208 14410 raft_consensus.cc:493] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.777771 14352 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.777702 14410 raft_consensus.cc:515] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.775326 14377 leader_election.cc:290] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.779788 13764 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
W20260709 13:04:03.782971 13693 leader_election.cc:336] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.783429 13693 leader_election.cc:304] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:03.784050 14352 raft_consensus.cc:2749] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.779044 13617 leader_election.cc:304] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:03.789721 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:03.790382 13646 raft_consensus.cc:3060] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.786316 14382 raft_consensus.cc:2804] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.795639 14388 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:03.787005 14389 raft_consensus.cc:2804] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.797430 14416 raft_consensus.cc:493] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.798062 14416 raft_consensus.cc:515] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.799062 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:04:03.799341 13767 leader_election.cc:336] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.799803 13648 raft_consensus.cc:2468] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
W20260709 13:04:03.800082 13767 leader_election.cc:336] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.800943 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.801486 14410 leader_election.cc:290] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.795589 14382 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.802515 14382 raft_consensus.cc:3060] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.804627 14358 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
W20260709 13:04:03.805066 13767 leader_election.cc:336] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:03.805931 13767 leader_election.cc:336] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.788066 14380 raft_consensus.cc:2749] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.811667 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:04:03.812446 13619 leader_election.cc:336] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.812448 13725 raft_consensus.cc:2468] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:03.814033 14330 raft_consensus.cc:493] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.814270 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.814489 13764 leader_election.cc:304] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
W20260709 13:04:03.815088 13767 leader_election.cc:336] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.815316 14377 raft_consensus.cc:2804] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.815718 14377 raft_consensus.cc:493] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.816059 14377 raft_consensus.cc:3060] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.815021 14330 raft_consensus.cc:515] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.806692 14352 raft_consensus.cc:493] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.822405 14388 tablet_bootstrap.cc:492] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:03.823269 14388 ts_tablet_manager.cc:1403] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.000s
I20260709 13:04:03.800196 14416 leader_election.cc:290] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:03.826610 13692 leader_election.cc:304] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:03.828204 13692 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:03.835177 14391 raft_consensus.cc:2804] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.835875 13721 raft_consensus.cc:2468] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:03.825057 14352 raft_consensus.cc:515] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.835631 14330 leader_election.cc:290] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.837448 14330 raft_consensus.cc:2749] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:03.838907 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:03.839023 13797 raft_consensus.cc:2468] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:03.844612 14416 raft_consensus.cc:493] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.845278 14416 raft_consensus.cc:515] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.847283 14410 raft_consensus.cc:493] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.848104 14416 leader_election.cc:290] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.847904 14410 raft_consensus.cc:515] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.850121 14410 leader_election.cc:290] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.835598 14391 raft_consensus.cc:493] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.850970 14391 raft_consensus.cc:3060] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.851428 14416 raft_consensus.cc:493] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.852041 14416 raft_consensus.cc:515] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.854197 14416 leader_election.cc:290] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:03.855873 13646 raft_consensus.cc:2468] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:03.837800 14352 leader_election.cc:290] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:03.856293 13767 leader_election.cc:336] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.850461 14358 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:03.860592 13693 leader_election.cc:336] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.863498 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:03.864568 13797 raft_consensus.cc:3060] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.866833 14377 raft_consensus.cc:515] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:03.867213 13693 leader_election.cc:336] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.883092 13693 leader_election.cc:304] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:03.883575 13475 catalog_manager.cc:5697] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.887540 14352 raft_consensus.cc:2749] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:03.889842 13693 leader_election.cc:336] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:03.868392 13619 leader_election.cc:336] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.869760 13764 leader_election.cc:304] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:03.871963 14380 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.891449 14380 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:03.893168 13619 leader_election.cc:336] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.893536 14380 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.872685 13797 raft_consensus.cc:2468] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:03.873111 13692 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:03.895403 14352 raft_consensus.cc:2749] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:03.900087 13767 leader_election.cc:336] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.900333 14352 raft_consensus.cc:493] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.900826 14352 raft_consensus.cc:515] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.862787 14424 raft_consensus.cc:493] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.872957 14382 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:03.875149 14389 raft_consensus.cc:697] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
W20260709 13:04:03.875545 13616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 88030.5us
I20260709 13:04:03.902429 14424 raft_consensus.cc:515] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.903219 14352 leader_election.cc:290] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.903015 14389 consensus_queue.cc:237] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.904165 14413 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.904657 14413 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.906635 14413 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:03.874511 14388 raft_consensus.cc:359] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.874595 13617 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:03.909287 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.909971 13721 raft_consensus.cc:2468] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:03.910612 14413 raft_consensus.cc:2804] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.911198 14413 raft_consensus.cc:697] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:03.912137 14413 consensus_queue.cc:237] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.913113 14424 leader_election.cc:290] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.914016 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.914665 13721 raft_consensus.cc:2468] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:03.915109 14388 raft_consensus.cc:740] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.915977 14388 consensus_queue.cc:260] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.918314 14422 raft_consensus.cc:493] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.918859 14422 raft_consensus.cc:515] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:03.919874 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.920552 13646 raft_consensus.cc:2468] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
W20260709 13:04:03.920691 13767 leader_election.cc:336] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.909343 14382 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.876072 14391 raft_consensus.cc:515] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.923619 14391 leader_election.cc:290] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:03.919224 14388 ts_tablet_manager.cc:1434] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 13:04:03.927107 14388 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:03.937482 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.937477 13766 leader_election.cc:304] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:03.939180 14410 raft_consensus.cc:2804] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.939553 14380 raft_consensus.cc:2804] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.939765 14410 raft_consensus.cc:697] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:03.940127 14380 raft_consensus.cc:493] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.940541 14380 raft_consensus.cc:3060] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.940683 14410 consensus_queue.cc:237] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:03.941919 13764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 72266.1us
I20260709 13:04:03.943097 13617 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:03.944520 14377 leader_election.cc:290] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:03.948457 13616 leader_election.cc:304] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:03.949227 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:03.949896 13725 raft_consensus.cc:3060] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.950608 13616 leader_election.cc:304] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:03.957231 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.958213 13725 raft_consensus.cc:2468] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:03.946550 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.962961 13692 leader_election.cc:304] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:03.953639 14413 raft_consensus.cc:2804] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.969743 14420 raft_consensus.cc:2804] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.956403 14358 raft_consensus.cc:2804] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:03.979511 13619 leader_election.cc:336] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:03.983743 13619 leader_election.cc:336] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.967734 14391 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.967622 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:03.972893 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:03.980100 14420 raft_consensus.cc:493] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:03.983572 14358 raft_consensus.cc:493] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
W20260709 13:04:03.997814 13619 leader_election.cc:336] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.988559 14422 leader_election.cc:290] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:04.000052 13721 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:04.009655 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:04.011926 13652 raft_consensus.cc:3060] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.012724 14423 raft_consensus.cc:2804] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.013262 14423 raft_consensus.cc:697] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:04.000054 14189 raft_consensus.cc:493] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.014043 14189 raft_consensus.cc:515] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:04.014171 14423 consensus_queue.cc:237] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:03.996070 14391 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.016180 14189 leader_election.cc:290] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:04.000221 13651 raft_consensus.cc:2468] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:04:04.017450 14391 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:04.018695 13693 leader_election.cc:336] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:03.999606 14420 raft_consensus.cc:3060] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:04.019199 13693 leader_election.cc:336] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.000989 14358 raft_consensus.cc:3060] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.020272 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:04.020931 13651 raft_consensus.cc:2468] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:04.030705 13766 leader_election.cc:304] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:04.032480 14382 raft_consensus.cc:493] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.032981 14382 raft_consensus.cc:515] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:04.030807 13767 leader_election.cc:336] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.042531 14380 raft_consensus.cc:515] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:04.044041 13767 leader_election.cc:336] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.044766 14380 leader_election.cc:290] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:04.046255 14382 leader_election.cc:290] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:04.042395 13652 raft_consensus.cc:2468] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
W20260709 13:04:04.051175 13693 leader_election.cc:336] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:04.051831 13693 leader_election.cc:336] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.060628 13475 catalog_manager.cc:5697] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.059422 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:04.064916 13651 raft_consensus.cc:3060] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.066393 14429 raft_consensus.cc:2804] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:04.055784 14413 raft_consensus.cc:697] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:04.066860 14429 raft_consensus.cc:493] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.064030 14358 raft_consensus.cc:515] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.076133 13651 raft_consensus.cc:2468] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
W20260709 13:04:04.076620 13767 leader_election.cc:336] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.082718 13646 raft_consensus.cc:2393] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 2: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
W20260709 13:04:04.082916 13767 leader_election.cc:336] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.083606 14358 leader_election.cc:290] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:04.084626 14413 consensus_queue.cc:237] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:04.077802 14429 raft_consensus.cc:3060] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.087098 13766 leader_election.cc:304] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.081228 14420 raft_consensus.cc:515] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.089577 14410 raft_consensus.cc:2804] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.094624 14410 raft_consensus.cc:697] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:04.095029 13648 raft_consensus.cc:2393] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 2: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:04:04.095490 14410 consensus_queue.cc:237] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.090006 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:04.096560 13722 raft_consensus.cc:3060] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.096870 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:04.097488 13721 raft_consensus.cc:3060] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:04.100255 13767 consensus_peers.cc:597] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.104048 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:04.107272 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:04.110651 14434 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.111268 14434 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.112495 13764 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.100845 14420 leader_election.cc:290] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:04.114920 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:04.115528 13725 raft_consensus.cc:2468] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:04.116516 13764 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.113466 13692 leader_election.cc:304] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
W20260709 13:04:04.114591 13619 leader_election.cc:336] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:04.117837 13619 leader_election.cc:336] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.118340 13692 leader_election.cc:304] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
W20260709 13:04:04.118733 13619 leader_election.cc:336] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.119146 13619 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:04.115607 14382 raft_consensus.cc:2804] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.120870 14391 raft_consensus.cc:2804] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:04.121273 14391 raft_consensus.cc:493] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.121683 14391 raft_consensus.cc:3060] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.119849 13475 catalog_manager.cc:5697] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.121577 14382 raft_consensus.cc:697] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:04.125746 14382 consensus_queue.cc:237] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.121220 14380 raft_consensus.cc:2804] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:04.120110 13616 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:04.101734 14416 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.108067 13722 raft_consensus.cc:2468] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:04.133639 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:04.135712 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:04.147008 13726 raft_consensus.cc:2468] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:04.136418 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:04.147881 13725 raft_consensus.cc:3060] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.129635 14380 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.152607 14380 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.113468 14434 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:04.132709 14423 raft_consensus.cc:2804] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.154932 14429 raft_consensus.cc:515] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:04.155795 14423 raft_consensus.cc:697] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:04.124871 13476 catalog_manager.cc:5697] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.124814 14420 raft_consensus.cc:2749] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:04.142458 14389 raft_consensus.cc:2804] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:04.145378 13692 leader_election.cc:304] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:04.145890 14388 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:04.146106 13619 leader_election.cc:336] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.140955 14416 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.156162 13796 raft_consensus.cc:2393] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 2: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:04:04.157142 14429 leader_election.cc:290] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:04.171360 14416 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:04:04.172741 13619 leader_election.cc:336] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.173311 13619 leader_election.cc:304] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:04.173601 13617 leader_election.cc:304] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:04.175163 14420 raft_consensus.cc:2749] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:04.177280 14416 raft_consensus.cc:3060] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.169505 14352 raft_consensus.cc:2749] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:04.183359 14388 tablet_bootstrap.cc:492] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:04.184095 14388 ts_tablet_manager.cc:1403] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.257s	user 0.018s	sys 0.000s
I20260709 13:04:04.183765 14380 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.185814 14380 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:04.187297 14388 raft_consensus.cc:359] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.188064 14388 raft_consensus.cc:740] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.158865 13725 raft_consensus.cc:2468] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:04.166111 13692 leader_election.cc:304] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:04.165685 13616 leader_election.cc:304] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
W20260709 13:04:04.192770 13619 leader_election.cc:336] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.194476 14436 raft_consensus.cc:2804] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.162602 13648 raft_consensus.cc:2468] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:04:04.194995 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:04.164515 14389 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.159860 14391 raft_consensus.cc:515] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.196556 14389 raft_consensus.cc:3060] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.196997 14436 raft_consensus.cc:697] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:04.197921 14436 consensus_queue.cc:237] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:04.198499 13619 leader_election.cc:336] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:04.199051 13619 leader_election.cc:336] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.162191 14423 consensus_queue.cc:237] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.203241 14391 leader_election.cc:290] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:04.203709 13764 leader_election.cc:304] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
W20260709 13:04:04.164772 13767 leader_election.cc:336] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.205229 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:04.205818 13726 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:04.205974 13693 leader_election.cc:336] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.205073 13764 leader_election.cc:304] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
W20260709 13:04:04.206866 13619 leader_election.cc:336] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.207701 14382 raft_consensus.cc:2804] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:04.208061 14382 raft_consensus.cc:493] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.208405 14382 raft_consensus.cc:3060] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.205150 13692 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.209287 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:04.209957 13719 raft_consensus.cc:2468] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:04.209414 14330 raft_consensus.cc:2804] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:04.210768 14330 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.211127 14330 raft_consensus.cc:3060] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.211819 14437 raft_consensus.cc:2804] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.212371 14437 raft_consensus.cc:697] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:04.213366 14437 consensus_queue.cc:237] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.221024 13726 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:04.220660 14330 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.215809 13616 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.222167 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:04.227034 13646 raft_consensus.cc:3060] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.227381 13725 raft_consensus.cc:1275] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.225534 13764 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:04.164038 13475 catalog_manager.cc:5697] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.188791 14388 consensus_queue.cc:260] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.236877 13646 raft_consensus.cc:2468] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:04.238456 14430 raft_consensus.cc:2804] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:04.238885 14430 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:04.239239 14430 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.239156 13721 raft_consensus.cc:2468] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:04.240046 14352 raft_consensus.cc:2749] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:04.241187 13767 consensus_peers.cc:597] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:04.241628 13767 leader_election.cc:336] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.243391 13692 leader_election.cc:304] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.244128 14391 raft_consensus.cc:2804] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.244578 14391 raft_consensus.cc:697] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:04.245378 14391 consensus_queue.cc:237] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.249572 13616 leader_election.cc:304] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.251628 14434 raft_consensus.cc:2804] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.254900 14434 raft_consensus.cc:697] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:04.255774 14434 consensus_queue.cc:237] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.257102 14382 raft_consensus.cc:515] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.267772 14330 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:04.268510 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:04.270882 13648 raft_consensus.cc:3060] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.284286 14377 consensus_queue.cc:1048] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:04.288820 14382 leader_election.cc:290] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:04.289753 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:04.290468 13721 raft_consensus.cc:3060] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.235075 14410 raft_consensus.cc:2804] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.295514 14388 ts_tablet_manager.cc:1434] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 13:04:04.296898 14388 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:04.261600 14430 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:04.327267 13767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 50600.8us
I20260709 13:04:04.330623 13796 raft_consensus.cc:1275] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.332195 14416 raft_consensus.cc:2749] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:04.333060 13476 catalog_manager.cc:5697] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:04.345952 13693 leader_election.cc:336] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.348901 13726 raft_consensus.cc:1275] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.346961 13476 catalog_manager.cc:5697] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.338922 14389 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:04.350420 13767 leader_election.cc:336] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.350407 14189 consensus_queue.cc:1048] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:04:04.366027 14430 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:04.362344 14416 consensus_queue.cc:1048] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:04:04.367591 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:04.368178 13726 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.368286 13651 raft_consensus.cc:2468] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:04.376133 13726 raft_consensus.cc:2468] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:04.362344 13721 raft_consensus.cc:2468] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:04.362679 14410 raft_consensus.cc:697] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:04.382843 13616 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:04.386360 13764 leader_election.cc:304] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.400633 14389 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:04.384299 14436 raft_consensus.cc:2804] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.406718 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:04.407929 13766 leader_election.cc:304] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.412705 13719 raft_consensus.cc:3060] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:04.413280 13619 leader_election.cc:336] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.415673 13475 catalog_manager.cc:5697] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.419472 14410 consensus_queue.cc:237] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.416847 14436 raft_consensus.cc:697] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
W20260709 13:04:04.422966 13619 leader_election.cc:336] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:04.409034 14437 raft_consensus.cc:2804] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.423656 14437 raft_consensus.cc:697] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
W20260709 13:04:04.425046 13767 consensus_peers.cc:597] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.424491 14437 consensus_queue.cc:237] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.428355 14380 raft_consensus.cc:2804] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.432703 13721 raft_consensus.cc:1275] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.435437 13648 raft_consensus.cc:2468] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
W20260709 13:04:04.441170 13619 consensus_peers.cc:597] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.444926 14378 consensus_queue.cc:1048] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:04.447177 13692 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.456642 14424 raft_consensus.cc:2804] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.457279 14424 raft_consensus.cc:697] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:04.458253 14424 consensus_queue.cc:237] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.442418 14380 raft_consensus.cc:697] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:04.455471 13475 catalog_manager.cc:5697] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.422926 14436 consensus_queue.cc:237] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:04.491381 13651 raft_consensus.cc:1275] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.494043 14330 consensus_queue.cc:1048] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.522543 13719 raft_consensus.cc:2468] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:04.523595 13796 raft_consensus.cc:1275] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.528388 13616 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:04.531698 14434 consensus_queue.cc:1048] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:04.540480 14389 raft_consensus.cc:2804] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.533979 14380 consensus_queue.cc:237] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:04.583168 14389 raft_consensus.cc:697] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:04.657366 14389 consensus_queue.cc:237] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:04.670359 13619 consensus_peers.cc:597] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.681308 13475 catalog_manager.cc:5697] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.675057 14393 raft_consensus.cc:493] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.711609 14393 raft_consensus.cc:515] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
W20260709 13:04:04.723713 13693 consensus_peers.cc:597] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.723778 14388 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:04.727036 14388 tablet_bootstrap.cc:492] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:04.727738 14388 ts_tablet_manager.cc:1403] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.431s	user 0.010s	sys 0.032s
I20260709 13:04:04.728650 13721 raft_consensus.cc:1275] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.730568 14388 raft_consensus.cc:359] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:04.731376 14388 raft_consensus.cc:740] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.732945 14388 consensus_queue.cc:260] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
W20260709 13:04:04.735740 13693 consensus_peers.cc:597] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.755021 14393 leader_election.cc:290] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:04.753571 14473 consensus_queue.cc:1048] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:04:04.779562 14388 ts_tablet_manager.cc:1434] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.004s
I20260709 13:04:04.784932 14388 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:04.796458 14480 raft_consensus.cc:493] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:04.800772 13767 consensus_peers.cc:597] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:04.801362 13767 consensus_peers.cc:597] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.798959 14480 raft_consensus.cc:515] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:04.817582 14393 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.842984 13648 raft_consensus.cc:1275] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.856318 14480 leader_election.cc:290] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:04.825166 14393 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:04.863229 13767 consensus_peers.cc:597] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:04.864466 14330 consensus_queue.cc:1048] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:04.874943 14393 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:04.889742 13476 catalog_manager.cc:5697] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:04.892997 13619 consensus_peers.cc:597] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.891629 13476 catalog_manager.cc:5697] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.896755 13476 catalog_manager.cc:5697] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:04.902760 13693 consensus_peers.cc:597] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.908958 13473 catalog_manager.cc:5697] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.940222 13473 catalog_manager.cc:5697] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.941736 13473 catalog_manager.cc:5697] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.944144 13473 catalog_manager.cc:5697] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.991364 13796 raft_consensus.cc:1275] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.995630 13721 raft_consensus.cc:1275] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:05.007665 13726 raft_consensus.cc:1275] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:05.013684 13767 consensus_peers.cc:597] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.014254 13767 consensus_peers.cc:597] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:05.014626 13767 consensus_peers.cc:597] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.014958 13767 consensus_peers.cc:597] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:05.017037 13721 raft_consensus.cc:1275] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:05.019169 13693 consensus_peers.cc:597] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.019768 13693 consensus_peers.cc:597] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:04.905037 14393 raft_consensus.cc:493] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.023756 14393 raft_consensus.cc:515] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:05.025744 14393 leader_election.cc:290] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:04:05.028575 13767 consensus_peers.cc:597] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.031317 13619 consensus_peers.cc:597] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:05.040632 14472 consensus_queue.cc:1048] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:05.042550 13646 raft_consensus.cc:1275] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:05.045536 13646 raft_consensus.cc:1275] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:05.047077 13619 consensus_peers.cc:597] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.047504 13767 consensus_peers.cc:597] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:05.050881 13719 raft_consensus.cc:1275] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:05.049001 13619 consensus_peers.cc:597] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:05.056304 14472 consensus_queue.cc:1048] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:05.070838 14476 consensus_queue.cc:1048] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:05.072010 14388 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.073551 14470 consensus_queue.cc:1048] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:05.077193 13693 consensus_peers.cc:597] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.087296 13767 consensus_peers.cc:597] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:05.087546 14388 tablet_bootstrap.cc:492] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.088454 14388 ts_tablet_manager.cc:1403] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.304s	user 0.019s	sys 0.000s
I20260709 13:04:05.095340 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:05.099234 13727 raft_consensus.cc:1275] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:05.103536 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:05.095549 14393 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.104992 14393 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:05.107079 14393 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:05.107582 14388 raft_consensus.cc:359] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.108304 14388 raft_consensus.cc:740] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.108546 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:05.109018 14388 consensus_queue.cc:260] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.112915 14388 ts_tablet_manager.cc:1434] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:04:05.113780 14388 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
W20260709 13:04:05.116566 13767 consensus_peers.cc:597] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.119797 13693 consensus_peers.cc:597] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:05.122856 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:05.089104 13721 raft_consensus.cc:1275] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:05.123759 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:05.121769 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:05.125380 13727 raft_consensus.cc:2393] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 816d755a8270492d88dac41d1d303c68 in current term 2: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:04:05.123232 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:05.128455 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:05.130812 14480 raft_consensus.cc:493] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.131546 14480 raft_consensus.cc:515] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:05.130681 13473 catalog_manager.cc:5697] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.133571 14480 leader_election.cc:290] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:05.133354 14380 consensus_queue.cc:1048] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:05.133404 14410 consensus_queue.cc:1048] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:04:05.143143 14383 leader_election.cc:304] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:05.144109 14393 raft_consensus.cc:2749] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.146384 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:04:05.149536 13619 consensus_peers.cc:597] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:05.153515 14474 consensus_queue.cc:1048] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:05.161005 14378 consensus_queue.cc:1048] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:05.161590 14189 consensus_queue.cc:1048] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:05.162258 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:05.169020 13619 consensus_peers.cc:597] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:05.174324 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:05.177654 13619 consensus_peers.cc:597] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:05.176596 14393 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.183645 14393 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:05.210292 14393 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:05.210908 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:05.214577 13767 consensus_peers.cc:597] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:05.216914 13646 raft_consensus.cc:1275] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:05.219695 13767 consensus_peers.cc:597] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:05.227116 14380 consensus_queue.cc:1048] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:05.233629 14384 leader_election.cc:304] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:05.236131 14393 raft_consensus.cc:2749] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.238790 14384 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:05.239657 14393 raft_consensus.cc:3060] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.240131 14384 leader_election.cc:304] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:05.242535 14480 raft_consensus.cc:2749] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:05.244230 13693 consensus_peers.cc:597] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:05.247177 14388 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.225406 13476 catalog_manager.cc:5697] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.267823 14388 tablet_bootstrap.cc:492] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.268605 14388 ts_tablet_manager.cc:1403] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.155s	user 0.020s	sys 0.004s
I20260709 13:04:05.273764 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:05.274644 14393 raft_consensus.cc:2749] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.266743 13651 raft_consensus.cc:1275] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:05.286312 14388 raft_consensus.cc:359] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.287808 14388 raft_consensus.cc:740] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.288566 14384 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:05.291404 14393 raft_consensus.cc:2749] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.288666 14388 consensus_queue.cc:260] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.294512 13727 raft_consensus.cc:1275] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:05.301455 13619 consensus_peers.cc:597] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.303071 13619 consensus_peers.cc:597] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.303584 13619 consensus_peers.cc:597] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.303979 13619 consensus_peers.cc:597] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.313535 13767 consensus_peers.cc:597] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:05.314396 14388 ts_tablet_manager.cc:1434] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:04:05.319326 14388 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:05.324414 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:04:05.319810 13619 consensus_peers.cc:597] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:05.360579 13619 consensus_peers.cc:597] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:05.361703 13693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 49983.7us
I20260709 13:04:05.376368 14416 consensus_queue.cc:1048] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:05.374969 14384 leader_election.cc:304] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:05.389146 14393 raft_consensus.cc:2749] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.389508 14384 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:05.360579 14330 consensus_queue.cc:1048] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:04:05.390574 14393 raft_consensus.cc:2749] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:05.393479 13619 consensus_peers.cc:597] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.398654 13767 consensus_peers.cc:597] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.410374 13619 consensus_peers.cc:597] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.440058 13692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 72105.1us
W20260709 13:04:05.448256 13693 consensus_peers.cc:597] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:05.456257 13693 consensus_peers.cc:597] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:05.557715 14388 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.558821 14388 tablet_bootstrap.cc:492] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.559489 14388 ts_tablet_manager.cc:1403] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.244s	user 0.025s	sys 0.023s
I20260709 13:04:05.561987 14388 raft_consensus.cc:359] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.562688 14388 raft_consensus.cc:740] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.563549 14388 consensus_queue.cc:260] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.566064 14388 ts_tablet_manager.cc:1434] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:05.567021 14388 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:05.599275 14388 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.600675 14388 tablet_bootstrap.cc:492] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.601542 14388 ts_tablet_manager.cc:1403] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.008s
I20260709 13:04:05.604059 14388 raft_consensus.cc:359] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:05.604722 14388 raft_consensus.cc:740] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.606318 14388 consensus_queue.cc:260] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:05.608625 14388 ts_tablet_manager.cc:1434] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:05.609483 14388 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:05.630931 14388 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.632745 14388 tablet_bootstrap.cc:492] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.633375 14388 ts_tablet_manager.cc:1403] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:04:05.636451 14388 raft_consensus.cc:359] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:05.637121 14388 raft_consensus.cc:740] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.637909 14388 consensus_queue.cc:260] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:05.640097 14388 ts_tablet_manager.cc:1434] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:04:05.640885 14388 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:05.646006 14393 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.646591 14393 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.648566 14393 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:05.650657 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:05.652853 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:05.656082 14381 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:05.658548 14393 raft_consensus.cc:2749] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.687274 14388 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.688436 14388 tablet_bootstrap.cc:492] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.689131 14388 ts_tablet_manager.cc:1403] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 13:04:05.692003 14388 raft_consensus.cc:359] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.692642 14388 raft_consensus.cc:740] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.693284 14388 consensus_queue.cc:260] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.695533 14388 ts_tablet_manager.cc:1434] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:04:05.699421 14388 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:05.737953  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:40147
I20260709 13:04:05.738102 14553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:40147 every 8 connection(s)
I20260709 13:04:05.741338 14388 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.742398 14388 tablet_bootstrap.cc:492] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.743101 14388 ts_tablet_manager.cc:1403] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.006s
I20260709 13:04:05.767204 14388 raft_consensus.cc:359] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.767882 14388 raft_consensus.cc:740] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.768539 14388 consensus_queue.cc:260] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.779345 14388 ts_tablet_manager.cc:1434] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.001s
I20260709 13:04:05.780299 14388 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:05.842811 14388 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.843981 14388 tablet_bootstrap.cc:492] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.844987 14388 ts_tablet_manager.cc:1403] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.012s
I20260709 13:04:05.848548 14388 raft_consensus.cc:359] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.849308 14388 raft_consensus.cc:740] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.850131 14388 consensus_queue.cc:260] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.852346 14388 ts_tablet_manager.cc:1434] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:05.853418 14388 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:05.855172 14518 raft_consensus.cc:3060] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.892850 14521 raft_consensus.cc:3060] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.915858 14388 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.916951 14388 tablet_bootstrap.cc:492] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.917666 14388 ts_tablet_manager.cc:1403] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.000s
I20260709 13:04:05.921907 14388 raft_consensus.cc:359] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.923944 14388 raft_consensus.cc:740] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.924742 14388 consensus_queue.cc:260] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:05.926952 14388 ts_tablet_manager.cc:1434] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:05.927807 14388 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:05.934448 14554 heartbeater.cc:344] Connected to a master server at 127.6.236.62:37525
I20260709 13:04:05.934937 14554 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:05.935844 14554 heartbeater.cc:507] Master 127.6.236.62:37525 requested a full tablet report, sending...
I20260709 13:04:05.957667 13476 ts_manager.cc:194] Re-registered known tserver with Master: 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:05.963219 14388 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.964218 14388 tablet_bootstrap.cc:492] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:05.964936 14388 ts_tablet_manager.cc:1403] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.009s
I20260709 13:04:05.967689 14388 raft_consensus.cc:359] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:05.968420 14388 raft_consensus.cc:740] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.967537 14518 raft_consensus.cc:3060] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.971802 14517 raft_consensus.cc:3060] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:05.969102 14388 consensus_queue.cc:260] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:05.990378 14388 ts_tablet_manager.cc:1434] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:04:05.991215 14388 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.008314 13476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48676
I20260709 13:04:06.013851 14554 heartbeater.cc:499] Master 127.6.236.62:37525 was elected leader, sending a full tablet report...
I20260709 13:04:06.018251 14388 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.019207 14388 tablet_bootstrap.cc:492] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.019778 14388 ts_tablet_manager.cc:1403] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.004s
I20260709 13:04:06.021790 14388 raft_consensus.cc:359] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.022393 14388 raft_consensus.cc:740] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.022908 14388 consensus_queue.cc:260] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.024413 14388 ts_tablet_manager.cc:1434] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:06.025099 14388 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.046603 14388 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.047511 14388 tablet_bootstrap.cc:492] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.048182 14388 ts_tablet_manager.cc:1403] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:04:06.050658 14388 raft_consensus.cc:359] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.051317 14388 raft_consensus.cc:740] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.051584 14393 raft_consensus.cc:493] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.051939 14388 consensus_queue.cc:260] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.052268 14393 raft_consensus.cc:515] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.054414 14393 leader_election.cc:290] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:06.056224 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:06.056702 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:06.058964 14384 leader_election.cc:304] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:06.061877 14393 raft_consensus.cc:2749] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:06.076792 14388 ts_tablet_manager.cc:1434] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.020s
I20260709 13:04:06.077785 14388 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.096693 14521 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.114846 14388 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.115841 14388 tablet_bootstrap.cc:492] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.116468 14388 ts_tablet_manager.cc:1403] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.007s
I20260709 13:04:06.118861 14388 raft_consensus.cc:359] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.119529 14388 raft_consensus.cc:740] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.120115 14388 consensus_queue.cc:260] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.122546 14388 ts_tablet_manager.cc:1434] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:06.123369 14388 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.145830 14388 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.146929 14388 tablet_bootstrap.cc:492] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.147599 14388 ts_tablet_manager.cc:1403] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 13:04:06.150466 14388 raft_consensus.cc:359] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.151130 14388 raft_consensus.cc:740] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.151741 14388 consensus_queue.cc:260] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.154181 14388 ts_tablet_manager.cc:1434] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:06.154945 14388 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.177263 14388 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.178233 14388 tablet_bootstrap.cc:492] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.178910 14388 ts_tablet_manager.cc:1403] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 13:04:06.181324 14388 raft_consensus.cc:359] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:06.181981 14388 raft_consensus.cc:740] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.182639 14388 consensus_queue.cc:260] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:06.184667 14388 ts_tablet_manager.cc:1434] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:06.185410 14388 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.205981 14388 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.206921 14388 tablet_bootstrap.cc:492] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.207590 14388 ts_tablet_manager.cc:1403] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:04:06.209715 14517 raft_consensus.cc:3060] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.212455 14388 raft_consensus.cc:359] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.213187 14388 raft_consensus.cc:740] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.213819 14388 consensus_queue.cc:260] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.216496 14388 ts_tablet_manager.cc:1434] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:06.217285 14388 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.251873 14388 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.252836 14388 tablet_bootstrap.cc:492] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.253530 14388 ts_tablet_manager.cc:1403] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.008s
I20260709 13:04:06.255991 14388 raft_consensus.cc:359] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.256623 14388 raft_consensus.cc:740] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.257227 14388 consensus_queue.cc:260] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.259477 14388 ts_tablet_manager.cc:1434] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:06.260221 14388 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.282343 14388 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.283282 14388 tablet_bootstrap.cc:492] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.283955 14388 ts_tablet_manager.cc:1403] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:04:06.286468 14388 raft_consensus.cc:359] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:06.287132 14388 raft_consensus.cc:740] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.287767 14388 consensus_queue.cc:260] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:06.289736 14388 ts_tablet_manager.cc:1434] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:06.290748 14388 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.311002 14388 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.312358 14388 tablet_bootstrap.cc:492] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.313318 14388 ts_tablet_manager.cc:1403] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:04:06.315687 14388 raft_consensus.cc:359] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.316330 14388 raft_consensus.cc:740] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.316947 14388 consensus_queue.cc:260] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.319079 14388 ts_tablet_manager.cc:1434] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:04:06.319845 14388 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.342885 14388 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.343852 14388 tablet_bootstrap.cc:492] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.344522 14388 ts_tablet_manager.cc:1403] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:04:06.346984 14388 raft_consensus.cc:359] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.347456 14388 raft_consensus.cc:740] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.348008 14388 consensus_queue.cc:260] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.349380 14388 ts_tablet_manager.cc:1434] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:04:06.350376 14388 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.392936 14517 raft_consensus.cc:3060] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.424094 14388 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.425048 14388 tablet_bootstrap.cc:492] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.425698 14388 ts_tablet_manager.cc:1403] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.003s
I20260709 13:04:06.428030 14388 raft_consensus.cc:359] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.428689 14388 raft_consensus.cc:740] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.438406 14388 consensus_queue.cc:260] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.440176 14388 ts_tablet_manager.cc:1434] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:06.441138 14388 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.450938 14517 raft_consensus.cc:3060] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.462353 14521 raft_consensus.cc:3060] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.465979 14518 raft_consensus.cc:3060] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.478138 14388 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.479140 14388 tablet_bootstrap.cc:492] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.479732 14388 ts_tablet_manager.cc:1403] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.011s
I20260709 13:04:06.490911 14514 raft_consensus.cc:3060] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.483953 14388 raft_consensus.cc:359] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:06.492646 14388 raft_consensus.cc:740] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.493386 14388 consensus_queue.cc:260] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:06.495615 14388 ts_tablet_manager.cc:1434] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:06.497656 14388 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.519814 14388 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.520751 14388 tablet_bootstrap.cc:492] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.521672 14388 ts_tablet_manager.cc:1403] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 13:04:06.524744 14388 raft_consensus.cc:359] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.525372 14388 raft_consensus.cc:740] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.526156 14388 consensus_queue.cc:260] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.528339 14388 ts_tablet_manager.cc:1434] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:06.529114 14388 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.547151 14518 raft_consensus.cc:3060] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:06.652696 13767 consensus_peers.cc:597] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:06.673642 14388 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.675428 14388 tablet_bootstrap.cc:492] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.676148 14388 ts_tablet_manager.cc:1403] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.147s	user 0.015s	sys 0.003s
I20260709 13:04:06.684930 14388 raft_consensus.cc:359] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.685621 14388 raft_consensus.cc:740] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.687088 14388 consensus_queue.cc:260] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.694931 14388 ts_tablet_manager.cc:1434] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:04:06.699096 14388 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.729223 14388 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.730170 14388 tablet_bootstrap.cc:492] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.730827 14388 ts_tablet_manager.cc:1403] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.003s
I20260709 13:04:06.733704 14388 raft_consensus.cc:359] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.734551 14388 raft_consensus.cc:740] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.735471 14388 consensus_queue.cc:260] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.738096 14388 ts_tablet_manager.cc:1434] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:06.738814 14388 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.779165 14388 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.780169 14388 tablet_bootstrap.cc:492] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.780857 14388 ts_tablet_manager.cc:1403] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.007s
I20260709 13:04:06.783772 14388 raft_consensus.cc:359] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.784489 14388 raft_consensus.cc:740] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.785193 14388 consensus_queue.cc:260] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.787559 14388 ts_tablet_manager.cc:1434] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:06.788379 14388 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.832350 14388 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.833305 14388 tablet_bootstrap.cc:492] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.834002 14388 ts_tablet_manager.cc:1403] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.016s
I20260709 13:04:06.837970 14388 raft_consensus.cc:359] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.838670 14388 raft_consensus.cc:740] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.839530 14388 consensus_queue.cc:260] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:06.841552 14388 ts_tablet_manager.cc:1434] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:06.844573 14388 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.859885 14388 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.860863 14388 tablet_bootstrap.cc:492] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.861572 14388 ts_tablet_manager.cc:1403] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:04:06.864063 14388 raft_consensus.cc:359] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:06.864778 14388 raft_consensus.cc:740] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.865434 14388 consensus_queue.cc:260] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:06.867509 14388 ts_tablet_manager.cc:1434] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:04:06.871410 14388 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.898743 14388 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.899622 14388 tablet_bootstrap.cc:492] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.900260 14388 ts_tablet_manager.cc:1403] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.008s
I20260709 13:04:06.902595 14388 raft_consensus.cc:359] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.903224 14388 raft_consensus.cc:740] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.903954 14388 consensus_queue.cc:260] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.905901 14388 ts_tablet_manager.cc:1434] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:06.906674 14388 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.924834 14388 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.925508 14388 tablet_bootstrap.cc:492] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:06.926024 14388 ts_tablet_manager.cc:1403] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:04:06.928201 14388 raft_consensus.cc:359] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.928726 14388 raft_consensus.cc:740] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.929481 14388 consensus_queue.cc:260] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:06.931517 14388 ts_tablet_manager.cc:1434] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:06.935055 14388 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:06.983435 14518 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.067065 14388 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:07.067981 14388 tablet_bootstrap.cc:492] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:07.068619 14388 ts_tablet_manager.cc:1403] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.134s	user 0.040s	sys 0.086s
I20260709 13:04:07.071118 14388 raft_consensus.cc:359] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:07.071762 14388 raft_consensus.cc:740] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.072407 14388 consensus_queue.cc:260] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:07.074659 14388 ts_tablet_manager.cc:1434] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:04:07.078457 14388 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:07.099700 14388 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:07.100641 14388 tablet_bootstrap.cc:492] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:07.101298 14388 ts_tablet_manager.cc:1403] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 13:04:07.103909 14388 raft_consensus.cc:359] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:07.104547 14388 raft_consensus.cc:740] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.105402 14388 consensus_queue.cc:260] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:07.107461 14388 ts_tablet_manager.cc:1434] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:07.116268 14388 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:07.129791 14388 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:07.130723 14388 tablet_bootstrap.cc:492] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:07.131313 14388 ts_tablet_manager.cc:1403] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:04:07.133122 14388 raft_consensus.cc:359] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:07.133600 14388 raft_consensus.cc:740] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.134208 14388 consensus_queue.cc:260] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:07.136018 14388 ts_tablet_manager.cc:1434] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:07.137133 14388 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:07.157524 14388 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:07.158607 14388 tablet_bootstrap.cc:492] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:07.159447 14388 ts_tablet_manager.cc:1403] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 13:04:07.160810 14521 raft_consensus.cc:3060] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.160730 14512 raft_consensus.cc:3060] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:07.173080 13693 consensus_peers.cc:597] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:07.173374 14388 raft_consensus.cc:359] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:07.174062 14388 raft_consensus.cc:740] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.177259 14388 consensus_queue.cc:260] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:07.179579 14388 ts_tablet_manager.cc:1434] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:04:07.180415 14388 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:07.186408 14518 raft_consensus.cc:3060] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.237648 14388 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:07.238518 14388 tablet_bootstrap.cc:492] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:07.239241 14388 ts_tablet_manager.cc:1403] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.020s
I20260709 13:04:07.242045 14388 raft_consensus.cc:359] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:07.242740 14388 raft_consensus.cc:740] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.243414 14388 consensus_queue.cc:260] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:07.244917 14388 ts_tablet_manager.cc:1434] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
I20260709 13:04:07.245790 14388 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Bootstrap starting.
I20260709 13:04:07.286019 14388 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:07.287009 14388 tablet_bootstrap.cc:492] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Bootstrap complete.
I20260709 13:04:07.287858 14388 ts_tablet_manager.cc:1403] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.011s
I20260709 13:04:07.290413 14388 raft_consensus.cc:359] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:07.290987 14388 raft_consensus.cc:740] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.291498 14388 consensus_queue.cc:260] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:07.293398 14388 ts_tablet_manager.cc:1434] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:07.392263 14512 raft_consensus.cc:3060] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.458530 14512 raft_consensus.cc:3060] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.577183 14518 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.813575  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:15.870064 13651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00c0045f00654855a3d672f639e01b17"
dest_uuid: "e3683af201ac41948aaa81cea02de029"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:04:15.871032 13651 raft_consensus.cc:606] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:15.886631 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "570d47d923e646698c8d1cb50881806a"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:15.887095 13796 raft_consensus.cc:606] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:15.889484 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7303d87314c5440cbf299237115d818c"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:15.890102 13796 raft_consensus.cc:606] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:15.892721 13801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:15.893193 13801 raft_consensus.cc:606] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:15.895545 13801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:15.896014 13801 raft_consensus.cc:606] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:15.898010 13801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:15.898460 13801 raft_consensus.cc:606] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:15.899410  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:15.900621  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:15.908994 14638 raft_consensus.cc:993] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:15.909682 14634 raft_consensus.cc:1081] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:15.911651 14521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7303d87314c5440cbf299237115d818c"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:15.912230 14521 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:15.912629 14521 raft_consensus.cc:3060] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.915043 14623 raft_consensus.cc:993] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:15.915511 14623 raft_consensus.cc:1081] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:15.916956 14518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00c0045f00654855a3d672f639e01b17"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34642
I20260709 13:04:15.917444 14518 raft_consensus.cc:493] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:15.917791 14518 raft_consensus.cc:3060] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.924817 14518 raft_consensus.cc:515] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:15.928942 14521 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:15.931020 14518 leader_election.cc:290] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:15.931988 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:15.932866 14521 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:15.933188 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:15.933797 13646 raft_consensus.cc:3060] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.936578 14638 raft_consensus.cc:993] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower fd3a9103ce8543f5aae6be46c1f76bd8 to start an election
I20260709 13:04:15.936975 14638 raft_consensus.cc:1081] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer fd3a9103ce8543f5aae6be46c1f76bd8 to start an election
I20260709 13:04:15.938673 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:15.940282 13727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249"
dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
 from {username='slave'} at 127.0.0.1:45868
I20260709 13:04:15.932757 13651 raft_consensus.cc:3055] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:15.940863 13727 raft_consensus.cc:493] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:15.941275 13727 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.941841 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:15.942539 13801 raft_consensus.cc:3055] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:15.942831 13801 raft_consensus.cc:740] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:15.943648 13801 consensus_queue.cc:260] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:15.945065 13801 raft_consensus.cc:3060] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.940421 13725 raft_consensus.cc:3060] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.946295 13651 raft_consensus.cc:740] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:15.947379 13651 consensus_queue.cc:260] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:15.948611 13651 raft_consensus.cc:3060] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.953521 13725 raft_consensus.cc:2468] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:15.954028 13801 raft_consensus.cc:2468] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:15.956275 14383 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:04:15.958143 14642 raft_consensus.cc:2804] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.959429 13727 raft_consensus.cc:515] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:15.956445 13646 raft_consensus.cc:2468] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:15.962316 13727 leader_election.cc:290] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:15.954200 14634 raft_consensus.cc:993] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:15.963404 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:15.964535 13796 raft_consensus.cc:3055] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:15.965052 13796 raft_consensus.cc:740] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:15.965440 14381 leader_election.cc:304] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:15.966382 13796 consensus_queue.cc:260] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:15.967963 13796 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.964637 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:15.969216 13646 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.975914 13796 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:15.977532 13691 leader_election.cc:304] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:15.978212 14645 raft_consensus.cc:1081] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:15.978957 14635 raft_consensus.cc:2804] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.976040 13651 raft_consensus.cc:2468] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:15.979506 14635 raft_consensus.cc:697] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:15.982481 14635 consensus_queue.cc:237] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:15.983536 13646 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:15.987620 14521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "570d47d923e646698c8d1cb50881806a"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:15.984202 14646 raft_consensus.cc:2804] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.989275 14521 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:15.989485 14646 raft_consensus.cc:697] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:15.989787 14521 raft_consensus.cc:3060] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.990715 14646 consensus_queue.cc:237] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:15.994776 14642 raft_consensus.cc:697] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:15.996353 14642 consensus_queue.cc:237] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:15.998283 13476 catalog_manager.cc:5697] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.999202 14521 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:16.005472 14521 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:16.006568 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:16.007306 13801 raft_consensus.cc:3055] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.007597 13801 raft_consensus.cc:740] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:16.008111 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:16.008708 13727 raft_consensus.cc:3060] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.008334 13801 consensus_queue.cc:260] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:16.010789 13801 raft_consensus.cc:3060] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.014140 13727 raft_consensus.cc:2468] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:16.015514 14381 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:16.017618 13801 raft_consensus.cc:2468] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:16.020210 14644 raft_consensus.cc:2804] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.024832 14644 raft_consensus.cc:697] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:16.025883 14644 consensus_queue.cc:237] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:16.035508 13473 catalog_manager.cc:5697] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.052879 13473 catalog_manager.cc:5697] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.054548 13473 catalog_manager.cc:5697] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.304826 14634 raft_consensus.cc:993] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower fd3a9103ce8543f5aae6be46c1f76bd8 to start an election
I20260709 13:04:16.305325 14638 raft_consensus.cc:1081] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer fd3a9103ce8543f5aae6be46c1f76bd8 to start an election
I20260709 13:04:16.306738 13725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9"
dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
 from {username='slave'} at 127.0.0.1:45868
I20260709 13:04:16.307277 13725 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.307562 13725 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.312945 14643 raft_consensus.cc:993] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:16.313467 14638 raft_consensus.cc:1081] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:16.313413 13725 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:16.315107 14521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:16.315522 13725 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:16.315796 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:16.317054 14521 raft_consensus.cc:493] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.317178 13646 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.317513 14521 raft_consensus.cc:3060] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.316220 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:16.319494 13801 raft_consensus.cc:3055] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.319788 13801 raft_consensus.cc:740] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:16.320663 13801 consensus_queue.cc:260] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:16.322688 13801 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.325243 14521 raft_consensus.cc:515] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:16.328058 14521 leader_election.cc:290] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:16.328182 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:16.328783 13796 raft_consensus.cc:3055] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.329046 13796 raft_consensus.cc:740] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:16.329768 13796 consensus_queue.cc:260] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:16.330817 13796 raft_consensus.cc:3060] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.331588 13646 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:16.332762 13692 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:16.333869 14635 raft_consensus.cc:2804] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.334347 14635 raft_consensus.cc:697] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:16.334713 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:16.335255 13652 raft_consensus.cc:3060] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.335137 14635 consensus_queue.cc:237] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:16.335728 13801 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:16.341504 13652 raft_consensus.cc:2468] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:16.344524 14384 leader_election.cc:304] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:16.345434 14644 raft_consensus.cc:2804] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.345899 14644 raft_consensus.cc:697] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:16.346027 13796 raft_consensus.cc:2468] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:16.346547 13473 catalog_manager.cc:5697] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.346889 14644 consensus_queue.cc:237] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:16.361725 13476 catalog_manager.cc:5697] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.450160 13652 raft_consensus.cc:1275] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.451319 14635 consensus_queue.cc:1048] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.467056 13801 raft_consensus.cc:1275] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.468245 14635 consensus_queue.cc:1048] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.489615 13652 raft_consensus.cc:1275] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.491070 14644 consensus_queue.cc:1048] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.504454 13796 raft_consensus.cc:1275] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.505729 14644 consensus_queue.cc:1048] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.529551 13652 raft_consensus.cc:1275] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.531500 13725 raft_consensus.cc:1275] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.531828 14644 consensus_queue.cc:1048] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.532748 14646 consensus_queue.cc:1048] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.552889 13727 raft_consensus.cc:1275] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.564194 14642 consensus_queue.cc:1048] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.594925 13796 raft_consensus.cc:1275] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.599174 14644 consensus_queue.cc:1048] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.767316 13652 raft_consensus.cc:1275] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.768393 14661 consensus_queue.cc:1048] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.777508 13796 raft_consensus.cc:1275] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.778743 14661 consensus_queue.cc:1048] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.900846 13796 raft_consensus.cc:1275] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.901530  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:16.902257 14642 consensus_queue.cc:1048] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.928721 13652 raft_consensus.cc:1275] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.933360 14673 consensus_queue.cc:1048] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.970216  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:17.009544 13652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "225960baa6af41d187116bada579f2f4"
dest_uuid: "e3683af201ac41948aaa81cea02de029"
mode: GRACEFUL
new_leader_uuid: "da3d66493d2f419fb8eda6491ce13df0"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:04:17.010046 13652 raft_consensus.cc:606] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Received request to transfer leadership to TS da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:17.012403 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35763cd4283147759ec2c744a06238e3"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:17.012856 13796 raft_consensus.cc:606] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:17.015192 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:17.015698 13796 raft_consensus.cc:606] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:17.018093 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:17.018565 13796 raft_consensus.cc:606] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:17.020543 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c6632785442492484d7bd8e03442d29"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:17.020923 13796 raft_consensus.cc:606] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:17.022894 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:17.023307 13796 raft_consensus.cc:606] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:17.024307  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:17.025470  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:17.152777 14623 raft_consensus.cc:993] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029: : Instructing follower da3d66493d2f419fb8eda6491ce13df0 to start an election
I20260709 13:04:17.153295 14636 raft_consensus.cc:1081] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Signalling peer da3d66493d2f419fb8eda6491ce13df0 to start an election
I20260709 13:04:17.154663 13796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "225960baa6af41d187116bada579f2f4"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:17.155314 13796 raft_consensus.cc:493] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.155704 13796 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.161394 13796 raft_consensus.cc:515] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:17.163439 13796 leader_election.cc:290] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:17.164109 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:17.164350 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:17.164702 13646 raft_consensus.cc:3055] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.164876 13725 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.165016 13646 raft_consensus.cc:740] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:17.165807 13646 consensus_queue.cc:260] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:17.167008 13646 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.170666 13725 raft_consensus.cc:2468] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:17.171978 13764 leader_election.cc:304] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:17.173199 14643 raft_consensus.cc:2804] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.173491 13646 raft_consensus.cc:2468] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:17.173586 14643 raft_consensus.cc:697] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:17.174715 14643 consensus_queue.cc:237] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:17.184638 13476 catalog_manager.cc:5697] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.197933 14680 raft_consensus.cc:993] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower fd3a9103ce8543f5aae6be46c1f76bd8 to start an election
I20260709 13:04:17.198468 14643 raft_consensus.cc:1081] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer fd3a9103ce8543f5aae6be46c1f76bd8 to start an election
I20260709 13:04:17.199862 13725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713"
dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
 from {username='slave'} at 127.0.0.1:45868
I20260709 13:04:17.200399 13725 raft_consensus.cc:493] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.200747 13725 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.206312 13725 raft_consensus.cc:515] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:17.207999 13725 leader_election.cc:290] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:17.208616 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:17.208909 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:17.209218 13646 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.209474 13796 raft_consensus.cc:3055] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.209745 13796 raft_consensus.cc:740] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:17.210491 13796 consensus_queue.cc:260] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:17.211398 13796 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.214246 13646 raft_consensus.cc:2468] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:17.215458 13692 leader_election.cc:304] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:17.216485 14631 raft_consensus.cc:2804] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.216535 13796 raft_consensus.cc:2468] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:17.217049 14631 raft_consensus.cc:697] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:17.217898 14631 consensus_queue.cc:237] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:17.229254 13476 catalog_manager.cc:5697] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.358016 14680 raft_consensus.cc:993] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:17.358477 14643 raft_consensus.cc:1081] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:17.359913 14512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:17.360316 14512 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.360539 14512 raft_consensus.cc:3060] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.365828 14512 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:17.367810 14512 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:17.368736 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:17.368815 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:17.369415 13652 raft_consensus.cc:3060] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.369488 13801 raft_consensus.cc:3055] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.369891 13801 raft_consensus.cc:740] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:17.370604 13801 consensus_queue.cc:260] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:17.371518 13801 raft_consensus.cc:3060] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.376061 13652 raft_consensus.cc:2468] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:17.376134 13801 raft_consensus.cc:2468] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:17.377307 14384 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:17.378156 14673 raft_consensus.cc:2804] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.378600 14673 raft_consensus.cc:697] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:17.379446 14673 consensus_queue.cc:237] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:17.387638 13476 catalog_manager.cc:5697] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.434530 14680 raft_consensus.cc:993] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:17.435043 14643 raft_consensus.cc:1081] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:17.436491 14512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:17.436916 14512 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.437184 14512 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.440680 14680 raft_consensus.cc:993] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:17.441185 14680 raft_consensus.cc:1081] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:17.442808 14521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35763cd4283147759ec2c744a06238e3"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:17.443333 14521 raft_consensus.cc:493] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.443655 14521 raft_consensus.cc:3060] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.447041 14512 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.449612 14512 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:17.449949 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:17.450227 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:17.450685 13725 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.451028 13801 raft_consensus.cc:3055] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:17.450914 14521 raft_consensus.cc:515] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.451375 13801 raft_consensus.cc:740] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:17.452229 13801 consensus_queue.cc:260] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.453250 14521 leader_election.cc:290] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:17.453330 13801 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.453954 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:17.454557 13727 raft_consensus.cc:3060] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.456810 13725 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 3.
I20260709 13:04:17.460827 13801 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 3.
I20260709 13:04:17.461951 14381 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:17.462697 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:17.463392 13796 raft_consensus.cc:3055] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.463752 13796 raft_consensus.cc:740] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:17.469430 13796 consensus_queue.cc:260] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.470528 14644 raft_consensus.cc:2804] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:17.472993 14644 raft_consensus.cc:697] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 3 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:17.474442 13796 raft_consensus.cc:3060] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.473948 14644 consensus_queue.cc:237] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.472559 13727 raft_consensus.cc:2468] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:17.478116 14381 leader_election.cc:304] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:17.478894 14646 raft_consensus.cc:2804] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.479389 14646 raft_consensus.cc:697] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:17.480168 14646 consensus_queue.cc:237] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.487277 13796 raft_consensus.cc:2468] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:17.498359 13476 catalog_manager.cc:5697] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 2 to 3, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 3 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.510991 13476 catalog_manager.cc:5697] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.584825 14643 raft_consensus.cc:993] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:17.585234 14680 raft_consensus.cc:1081] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:17.586529 14521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c6632785442492484d7bd8e03442d29"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:17.586948 14521 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.587196 14521 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.593492 14521 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.594900 14521 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:17.595939 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:17.596036 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:17.596544 13725 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.596637 13796 raft_consensus.cc:3055] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:17.597056 13796 raft_consensus.cc:740] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:17.597728 13796 consensus_queue.cc:260] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.600195 13646 raft_consensus.cc:1275] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.599474 13796 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.601775 14631 consensus_queue.cc:1048] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.604384 13725 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 3.
I20260709 13:04:17.607434 13796 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 3.
I20260709 13:04:17.608939 14383 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:04:17.609889 14646 raft_consensus.cc:2804] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:17.610430 14646 raft_consensus.cc:697] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 3 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:17.611303 14646 consensus_queue.cc:237] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:17.626050 13796 raft_consensus.cc:1275] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.627936 14631 consensus_queue.cc:1048] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.629822 13652 raft_consensus.cc:1275] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.633141 13725 raft_consensus.cc:1275] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.635704 14643 consensus_queue.cc:1048] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.637270 14643 consensus_queue.cc:1048] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.657848 13476 catalog_manager.cc:5697] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 2 to 3, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 3 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.815447 13652 raft_consensus.cc:1275] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.816642 14689 consensus_queue.cc:1048] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.829234 13801 raft_consensus.cc:1275] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.830440 14689 consensus_queue.cc:1048] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.891335 13725 raft_consensus.cc:1275] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.892436 14646 consensus_queue.cc:1048] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.906287 13801 raft_consensus.cc:1275] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.907521 14673 consensus_queue.cc:1048] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.026347  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:18.042389 13725 raft_consensus.cc:1275] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:18.043687 14673 consensus_queue.cc:1048] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:18.054643 13796 raft_consensus.cc:1275] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:18.058247 14689 consensus_queue.cc:1048] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:18.078404  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:18.121481 13652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b"
dest_uuid: "e3683af201ac41948aaa81cea02de029"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:04:18.122102 13652 raft_consensus.cc:606] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:18.124647 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46592c7f545042849b442d72dcc3979f"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:18.125216 13796 raft_consensus.cc:606] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:18.126591 13725 raft_consensus.cc:1275] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:18.127576 13652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a"
dest_uuid: "e3683af201ac41948aaa81cea02de029"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:04:18.127704 14689 consensus_queue.cc:1048] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:18.128068 13652 raft_consensus.cc:606] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:18.130446 13652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a"
dest_uuid: "e3683af201ac41948aaa81cea02de029"
mode: GRACEFUL
new_leader_uuid: "da3d66493d2f419fb8eda6491ce13df0"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:04:18.130931 13652 raft_consensus.cc:606] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Received request to transfer leadership to TS da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:18.133307 13652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef"
dest_uuid: "e3683af201ac41948aaa81cea02de029"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:04:18.133791 13652 raft_consensus.cc:606] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:18.134882  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:18.137024  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:18.138616 13796 raft_consensus.cc:1275] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:18.140256 14689 consensus_queue.cc:1048] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:18.175514 14680 raft_consensus.cc:993] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower fd3a9103ce8543f5aae6be46c1f76bd8 to start an election
I20260709 13:04:18.175966 14638 raft_consensus.cc:1081] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer fd3a9103ce8543f5aae6be46c1f76bd8 to start an election
I20260709 13:04:18.177268 13725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46592c7f545042849b442d72dcc3979f"
dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
 from {username='slave'} at 127.0.0.1:45868
I20260709 13:04:18.177690 13725 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:18.177938 13725 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.184559 13725 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:18.187188 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:18.187198 13725 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:18.187768 13652 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.188380 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:18.190959 13796 raft_consensus.cc:3055] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:18.191243 13796 raft_consensus.cc:740] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:18.191387 14705 raft_consensus.cc:993] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:18.191922 14705 raft_consensus.cc:1081] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:18.192263 13796 consensus_queue.cc:260] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:18.193809 13796 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.195011 14512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34642
I20260709 13:04:18.195150 13652 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:18.195838 14512 raft_consensus.cc:493] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:18.196214 14512 raft_consensus.cc:3060] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.196935 13692 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:18.197837 14635 raft_consensus.cc:2804] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:18.199174 14635 raft_consensus.cc:697] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:18.200109 14635 consensus_queue.cc:237] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:18.203176 14512 raft_consensus.cc:515] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.203840 13796 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:18.207193 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:18.207604 14512 leader_election.cc:290] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:18.208024 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:18.208585 13727 raft_consensus.cc:3060] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.208997 13652 raft_consensus.cc:3055] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:18.209363 13652 raft_consensus.cc:740] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:18.210356 13652 consensus_queue.cc:260] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.211752 13652 raft_consensus.cc:3060] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.215543 13727 raft_consensus.cc:2468] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:18.216780 14381 leader_election.cc:304] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:18.217576 14646 raft_consensus.cc:2804] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:18.218037 14646 raft_consensus.cc:697] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:18.218120 13652 raft_consensus.cc:2468] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:18.218974 14646 consensus_queue.cc:237] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.231607 13475 catalog_manager.cc:5697] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.235325 14636 raft_consensus.cc:993] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029: : Instructing follower da3d66493d2f419fb8eda6491ce13df0 to start an election
I20260709 13:04:18.235940 14636 raft_consensus.cc:1081] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Signalling peer da3d66493d2f419fb8eda6491ce13df0 to start an election
I20260709 13:04:18.237551 13796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:18.238176 13796 raft_consensus.cc:493] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:18.238557 13796 raft_consensus.cc:3060] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.252151 13796 raft_consensus.cc:515] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:18.254591 13796 leader_election.cc:290] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:18.255323 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:18.256031 13652 raft_consensus.cc:3055] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:18.256373 13652 raft_consensus.cc:740] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:18.254781 13473 catalog_manager.cc:5697] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.257359 13652 consensus_queue.cc:260] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:18.258421 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:18.258941 13652 raft_consensus.cc:3060] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.259241 13727 raft_consensus.cc:3060] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.266993 13652 raft_consensus.cc:2468] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:18.270300 13766 leader_election.cc:304] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:18.270501 13727 raft_consensus.cc:2468] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:18.272073 14680 raft_consensus.cc:2804] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:18.272579 14680 raft_consensus.cc:697] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:18.273435 14680 consensus_queue.cc:237] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:18.291368 13473 catalog_manager.cc:5697] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:18.568244 14636 raft_consensus.cc:993] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:18.569132 14705 raft_consensus.cc:1081] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:18.571231 14512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34642
I20260709 13:04:18.571679 14512 raft_consensus.cc:493] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:18.572014 14512 raft_consensus.cc:3060] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.577893 14512 raft_consensus.cc:515] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.579587 14512 leader_election.cc:290] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:18.580096 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:18.580533 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:18.580641 13652 raft_consensus.cc:3055] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:18.581008 13652 raft_consensus.cc:740] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:18.581008 13725 raft_consensus.cc:3060] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.581827 13652 consensus_queue.cc:260] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.583039 13652 raft_consensus.cc:3060] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.586436 14636 raft_consensus.cc:993] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:18.586954 14705 raft_consensus.cc:1081] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:18.587698 13725 raft_consensus.cc:2468] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:18.588572 14512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34642
I20260709 13:04:18.590770 14512 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:18.591199 14512 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:18.589450 14381 leader_election.cc:304] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:18.593477 14708 raft_consensus.cc:2804] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:18.590013 13652 raft_consensus.cc:2468] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:18.593976 14708 raft_consensus.cc:697] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:18.594923 14708 consensus_queue.cc:237] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.593498 13646 raft_consensus.cc:1275] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.598748 14512 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.599746 14661 consensus_queue.cc:1048] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.601022 14512 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:18.601586 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:18.602157 13727 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:18.602391 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:18.602972 13646 raft_consensus.cc:3055] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:18.603257 13646 raft_consensus.cc:740] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:18.604009 13646 consensus_queue.cc:260] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.605026 13646 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:18.613631 13796 raft_consensus.cc:1275] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.615209 14661 consensus_queue.cc:1048] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.616461 13727 raft_consensus.cc:2468] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 3.
I20260709 13:04:18.622790 14381 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:18.623272 13646 raft_consensus.cc:2468] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 3.
I20260709 13:04:18.620316 13475 catalog_manager.cc:5697] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.629251 14689 raft_consensus.cc:2804] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:18.630239 14689 raft_consensus.cc:697] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 3 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:18.631078 14689 consensus_queue.cc:237] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:18.646951 13727 raft_consensus.cc:1275] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.648341 14689 consensus_queue.cc:1048] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.653213 13476 catalog_manager.cc:5697] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 2 to 3, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 3 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.679471 13648 raft_consensus.cc:1275] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.681092 14646 consensus_queue.cc:1048] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.736846 13727 raft_consensus.cc:1275] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.737938 14643 consensus_queue.cc:1048] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.747437 13648 raft_consensus.cc:1275] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.750800 14726 consensus_queue.cc:1048] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.988968 13646 raft_consensus.cc:1275] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.990110 14646 consensus_queue.cc:1048] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.999603 13725 raft_consensus.cc:1275] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:19.001561 14644 consensus_queue.cc:1048] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:19.090984 13646 raft_consensus.cc:1275] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:19.092238 14708 consensus_queue.cc:1048] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.104249 13725 raft_consensus.cc:1275] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:19.105461 14708 consensus_queue.cc:1048] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.137977  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:19.184921  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:19.221154 13796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:19.221683 13796 raft_consensus.cc:606] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:19.224049 13646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b"
dest_uuid: "e3683af201ac41948aaa81cea02de029"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:04:19.224591 13646 raft_consensus.cc:606] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:19.249627 13727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249"
dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
mode: GRACEFUL
new_leader_uuid: "da3d66493d2f419fb8eda6491ce13df0"
 from {username='slave'} at 127.0.0.1:36234
I20260709 13:04:19.250329 13727 raft_consensus.cc:606] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Received request to transfer leadership to TS da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:19.251991  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:19.253274  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:19.368218 14734 raft_consensus.cc:993] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:19.369006 14705 raft_consensus.cc:1081] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:19.370383 14512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34642
I20260709 13:04:19.370795 14512 raft_consensus.cc:493] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:19.371044 14512 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.376296 14512 raft_consensus.cc:515] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:19.377935 14512 leader_election.cc:290] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:19.378654 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:19.378911 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:19.379191 13648 raft_consensus.cc:3055] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:19.379503 13648 raft_consensus.cc:740] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:19.379514 13727 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.380194 13648 consensus_queue.cc:260] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:19.381063 13648 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.386868 13727 raft_consensus.cc:2468] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:19.387571 13648 raft_consensus.cc:2468] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:19.388180 14381 leader_election.cc:304] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:19.389546 14708 raft_consensus.cc:2804] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:19.390055 14708 raft_consensus.cc:697] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:19.391001 14708 consensus_queue.cc:237] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:19.405618 13473 catalog_manager.cc:5697] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.544566 14643 raft_consensus.cc:993] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:19.544992 14726 raft_consensus.cc:1081] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:19.546252 14512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:19.546710 14512 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:19.546995 14512 raft_consensus.cc:3060] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.553438 14512 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:19.557504 14512 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:19.557952 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:19.557966 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:19.558732 13648 raft_consensus.cc:3060] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.558878 13796 raft_consensus.cc:3055] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:19.559396 13796 raft_consensus.cc:740] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:19.562525 13796 consensus_queue.cc:260] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:19.563807 13796 raft_consensus.cc:3060] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.577957 13796 raft_consensus.cc:2468] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:19.579634 13648 raft_consensus.cc:2468] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:19.579855 14383 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:04:19.580786 14708 raft_consensus.cc:2804] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:19.581266 14708 raft_consensus.cc:697] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:19.582643 14708 consensus_queue.cc:237] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:19.597393 13473 catalog_manager.cc:5697] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.740761 14635 raft_consensus.cc:993] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8: : Instructing follower da3d66493d2f419fb8eda6491ce13df0 to start an election
I20260709 13:04:19.741254 14661 raft_consensus.cc:1081] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Signalling peer da3d66493d2f419fb8eda6491ce13df0 to start an election
I20260709 13:04:19.742599 13796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
 from {username='slave'} at 127.0.0.1:49522
I20260709 13:04:19.742982 13796 raft_consensus.cc:493] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:19.743202 13796 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:19.747990 13796 raft_consensus.cc:515] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:19.749788 13796 leader_election.cc:290] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:19.750710 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:19.750730 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:19.751356 13727 raft_consensus.cc:3055] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:19.751597 13648 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:19.751726 13727 raft_consensus.cc:740] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:19.752580 13727 consensus_queue.cc:260] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:19.754263 13727 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:19.757117 13648 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:19.758308 13766 leader_election.cc:304] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:19.758950 14680 raft_consensus.cc:2804] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:19.759047 13727 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:19.759476 14680 raft_consensus.cc:697] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:19.760277 14680 consensus_queue.cc:237] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:19.768749 13473 catalog_manager.cc:5697] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 3, leader changed from fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.792893 13727 raft_consensus.cc:1275] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:19.793964 14708 consensus_queue.cc:1048] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:19.807587 13648 raft_consensus.cc:1275] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:19.809517 14644 consensus_queue.cc:1048] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.100196 13796 raft_consensus.cc:1275] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.101584 14644 consensus_queue.cc:1048] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.111814 13646 raft_consensus.cc:1275] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.113662 14644 consensus_queue.cc:1048] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.176342 13725 raft_consensus.cc:1275] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:20.177536 14643 consensus_queue.cc:1048] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:20.185431 13648 raft_consensus.cc:1275] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:20.186661 14751 consensus_queue.cc:1048] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:20.254242  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:20.299907  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:20.334931 13799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50"
dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
mode: GRACEFUL
new_leader_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:04:20.335510 13799 raft_consensus.cc:606] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Received request to transfer leadership to TS 816d755a8270492d88dac41d1d303c68
I20260709 13:04:20.336947  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:04:20.338649  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:20.465874 14680 raft_consensus.cc:993] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0: : Instructing follower 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:20.466516 14751 raft_consensus.cc:1081] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Signalling peer 816d755a8270492d88dac41d1d303c68 to start an election
I20260709 13:04:20.468096 14521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50"
dest_uuid: "816d755a8270492d88dac41d1d303c68"
 from {username='slave'} at 127.0.0.1:34658
I20260709 13:04:20.468636 14521 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.468962 14521 raft_consensus.cc:3060] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.474093 14521 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:20.475975 14521 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:20.476696 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:20.477190 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:20.477337 13725 raft_consensus.cc:3060] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.477655 13799 raft_consensus.cc:3055] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.477963 13799 raft_consensus.cc:740] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:20.478642 13799 consensus_queue.cc:260] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:20.479496 13799 raft_consensus.cc:3060] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.482887 13725 raft_consensus.cc:2468] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:20.484212 14381 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:20.484688 13799 raft_consensus.cc:2468] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:20.484930 14708 raft_consensus.cc:2804] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.486011 14708 raft_consensus.cc:697] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Leader. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:20.486910 14708 consensus_queue.cc:237] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:20.495688 13473 catalog_manager.cc:5697] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to 816d755a8270492d88dac41d1d303c68 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "816d755a8270492d88dac41d1d303c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.992502 13727 raft_consensus.cc:1275] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.047091 14761 consensus_queue.cc:1048] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:21.087805 13799 raft_consensus.cc:1275] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer 816d755a8270492d88dac41d1d303c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.089509 14761 consensus_queue.cc:1048] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:21.535557  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:21.594487  7088 tablet_server.cc:179] TabletServer@127.6.236.1:40147 shutting down...
W20260709 13:04:21.655046 13693 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 282 similar messages]
W20260709 13:04:21.791729 13693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 136829us
W20260709 13:04:21.822842 13693 consensus_peers.cc:597] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.825253 13693 consensus_peers.cc:597] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.825542 13616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 187933us
W20260709 13:04:21.829761 13693 consensus_peers.cc:597] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.838343 13693 consensus_peers.cc:597] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.839078 13693 consensus_peers.cc:597] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.839694 13693 consensus_peers.cc:597] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.842247 13693 consensus_peers.cc:597] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.871577 13693 consensus_peers.cc:597] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.932781 13693 consensus_peers.cc:597] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:23.561038 13619 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.637s	user 0.011s	sys 0.030s
W20260709 13:04:23.561581 13619 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.638s	user 0.011s	sys 0.030s
W20260709 13:04:23.561832 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 1.66013e+06us
I20260709 13:04:23.563861 14784 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:23.564541 14785 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:23.564508 14784 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.565312 14785 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.567205 14784 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:23.567394 14785 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:23.564821 13617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 50534.7us
I20260709 13:04:23.574095 14788 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.575313 14785 raft_consensus.cc:493] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:23.575886 14786 raft_consensus.cc:493] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:23.576985 14785 raft_consensus.cc:515] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.577104 14786 raft_consensus.cc:515] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.577869 14790 raft_consensus.cc:493] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.579988 14785 leader_election.cc:290] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.580612 14788 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
W20260709 13:04:23.581292 13748 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3d20 after lost signal to thread 7091
I20260709 13:04:23.582329 14788 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
W20260709 13:04:23.583922 13748 debug-util.cc:398] Leaking SignalData structure 0x7b08002152c0 after lost signal to thread 13510
I20260709 13:04:23.584033 14787 raft_consensus.cc:493] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.584640 14787 raft_consensus.cc:515] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:23.586966 14787 leader_election.cc:290] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
W20260709 13:04:23.587069 13748 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9d60 after lost signal to thread 13677
I20260709 13:04:23.588435 14787 raft_consensus.cc:493] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
W20260709 13:04:23.588789 13748 debug-util.cc:398] Leaking SignalData structure 0x7b080034c060 after lost signal to thread 13751
I20260709 13:04:23.591064 14784 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
W20260709 13:04:23.591605 13748 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca420 after lost signal to thread 13825
I20260709 13:04:23.589970 14789 raft_consensus.cc:493] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.591799 14784 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.588995 14787 raft_consensus.cc:515] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.593789 14792 raft_consensus.cc:493] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.594679 14785 raft_consensus.cc:493] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.598941 14794 raft_consensus.cc:493] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.579152 14790 raft_consensus.cc:515] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.599994 14793 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
W20260709 13:04:23.728955 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 154399us
I20260709 13:04:23.614660 14792 raft_consensus.cc:515] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:23.754612 14798 raft_consensus.cc:493] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.755378 14798 raft_consensus.cc:515] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.756296 14792 leader_election.cc:290] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:23.727008 14794 raft_consensus.cc:515] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:23.760007 14794 leader_election.cc:290] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
W20260709 13:04:23.612234 13748 debug-util.cc:398] Leaking SignalData structure 0x7b08004232a0 after lost signal to thread 14553
I20260709 13:04:23.614171 14784 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.757617 14798 leader_election.cc:290] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.740141 14787 leader_election.cc:290] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:23.739666 14788 raft_consensus.cc:493] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.600558 14795 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.733691 14790 leader_election.cc:290] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:23.804656 13748 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8300 after lost signal to thread 14652
I20260709 13:04:23.812413 14798 raft_consensus.cc:493] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.727332 14785 raft_consensus.cc:515] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:23.816610 14799 raft_consensus.cc:493] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.817206 14799 raft_consensus.cc:515] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:23.815331 14790 raft_consensus.cc:493] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.817797 14785 leader_election.cc:290] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:23.818259 14790 raft_consensus.cc:515] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.819660 14788 raft_consensus.cc:515] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.746433 14800 raft_consensus.cc:493] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.824000 14792 raft_consensus.cc:493] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:23.824568 14792 raft_consensus.cc:515] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.825129 14799 leader_election.cc:290] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:23.825511 14795 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.826148 14800 raft_consensus.cc:515] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.826740 14792 leader_election.cc:290] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:23.612761 14789 raft_consensus.cc:515] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:23.825461 13766 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.889s	user 0.000s	sys 0.045s
W20260709 13:04:23.828145 13766 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.893s	user 0.001s	sys 0.045s
I20260709 13:04:23.828467 14800 leader_election.cc:290] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.829129 14789 leader_election.cc:290] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:04:23.828441 13766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 1.89337e+06us
I20260709 13:04:23.814512 14786 leader_election.cc:290] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.820380 14790 leader_election.cc:290] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.740079 14793 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:23.833701 14789 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.829175 14795 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:23.839498 14789 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.843730 14789 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:23.835813 14787 raft_consensus.cc:493] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.816015 14798 raft_consensus.cc:515] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.838281 14788 leader_election.cc:290] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:23.849453 14799 raft_consensus.cc:493] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.854626 14799 raft_consensus.cc:515] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:23.857159 14799 leader_election.cc:290] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:23.858448 14793 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:23.893221 13726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34368 (request call id 102) took 1969 ms. Trace:
I20260709 13:04:23.893808 13726 rpcz_store.cc:276] 0709 13:04:21.913563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.913691 (+   128us) service_pool.cc:224] Handling call
0709 13:04:23.869944 (+1956253us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800756998. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2ef8fe8db1 00007f2ef9128b71 00007f2ef9128a22 00007f2f02041c09 00007f2f0119bee0 00007f2f012650ab 00007f2f01265131 00007f2f01226fc0 00007f2f01211929 00007f2f012113d2 00007f2efa788bd4
0709 13:04:23.882491 (+ 12547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.882718 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:23.882745 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:23.882790 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:23.882819 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.882874 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.883006 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2820480}
I20260709 13:04:23.850132 14787 raft_consensus.cc:515] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.897410 14787 leader_election.cc:290] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:23.901821 14799 raft_consensus.cc:493] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.902268 14805 raft_consensus.cc:493] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.902872 14805 raft_consensus.cc:515] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.906383 14798 leader_election.cc:290] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.907482 14789 raft_consensus.cc:493] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.907796 14805 leader_election.cc:290] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.908342 14789 raft_consensus.cc:515] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.909348 14807 raft_consensus.cc:493] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.909487 14799 raft_consensus.cc:515] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.909961 14807 raft_consensus.cc:515] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:23.910842 14789 leader_election.cc:290] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:23.928213 13619 consensus_peers.cc:597] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:23.930059 13619 consensus_peers.cc:597] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:23.930657 14799 leader_election.cc:290] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:04:23.939726 13619 consensus_peers.cc:597] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:23.946331 13619 consensus_peers.cc:597] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:23.947269 13619 consensus_peers.cc:597] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:23.947970 14793 raft_consensus.cc:493] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.950652 14788 raft_consensus.cc:493] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.953445 14807 leader_election.cc:290] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:23.954981 14803 raft_consensus.cc:493] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
W20260709 13:04:23.953764 13619 consensus_peers.cc:597] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:23.955158 14798 raft_consensus.cc:493] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.954489 14790 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:23.958554 14801 raft_consensus.cc:493] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.959282 14811 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.959729 14789 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.961488 14805 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.962121 14815 raft_consensus.cc:493] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.964284 14795 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:23.954881 14680 raft_consensus.cc:493] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
W20260709 13:04:23.967036 13619 consensus_peers.cc:597] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:23.970315 14680 raft_consensus.cc:515] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:23.966354 14802 raft_consensus.cc:493] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.968287 14786 raft_consensus.cc:493] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.966022 14812 raft_consensus.cc:493] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.968524 14796 raft_consensus.cc:493] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:23.998589 14806 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.977634 14807 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.969138 14795 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.017935 14807 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.019421 14795 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:23.966770 14803 raft_consensus.cc:515] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.968014 14789 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:23.966358 14788 raft_consensus.cc:515] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.010201 14810 raft_consensus.cc:493] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.011125 14797 raft_consensus.cc:493] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.011520 14787 raft_consensus.cc:493] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.013476 14814 raft_consensus.cc:493] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.968863 14815 raft_consensus.cc:515] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:24.035597 13767 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.116s	user 0.024s	sys 0.042s
W20260709 13:04:24.036154 13767 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.117s	user 0.024s	sys 0.042s
I20260709 13:04:23.967080 14798 raft_consensus.cc:515] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
W20260709 13:04:24.036441 13767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 2.11766e+06us
I20260709 13:04:24.014158 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.015249 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:23.967772 14811 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.016971 14680 leader_election.cc:290] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.042759 14680 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:23.967353 14790 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:23.968161 14805 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:23.967562 14801 raft_consensus.cc:515] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.053380 14801 leader_election.cc:290] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.020344 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.020905 14806 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.021713 14802 raft_consensus.cc:515] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.020053 14807 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:23.966158 14793 raft_consensus.cc:515] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.034373 14787 raft_consensus.cc:515] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.015219 14813 raft_consensus.cc:493] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.022526 14786 raft_consensus.cc:515] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.060160 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.054288 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.080392 14680 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.073901 14801 raft_consensus.cc:493] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.083518 14801 raft_consensus.cc:515] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.085799 14801 leader_election.cc:290] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.091020 14801 raft_consensus.cc:493] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.041062 14814 raft_consensus.cc:515] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.009922 14812 raft_consensus.cc:515] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.074697 14799 raft_consensus.cc:493] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.102105 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.074463 14795 raft_consensus.cc:493] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.108943 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.109619 13648 raft_consensus.cc:2468] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:04:24.078876 14815 leader_election.cc:290] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.081558 13645 raft_consensus.cc:2468] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:24.040292 14810 raft_consensus.cc:515] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.046630 14797 raft_consensus.cc:515] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.026904 14796 raft_consensus.cc:515] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.133118 14680 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.102886 14801 raft_consensus.cc:515] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.118373 14815 raft_consensus.cc:493] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.154431 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.156018 14680 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.157831 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.122381 14827 raft_consensus.cc:493] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.158421 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.157241 13766 leader_election.cc:304] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:24.154184 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.121034 14795 raft_consensus.cc:515] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.121196 14799 raft_consensus.cc:515] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.163398 13652 raft_consensus.cc:2468] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.100113 14813 raft_consensus.cc:515] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.164372 14680 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.169932 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.170439 14822 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.171164 14816 raft_consensus.cc:493] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.171882 14816 raft_consensus.cc:515] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.173439 14790 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.171037 14822 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.183269 14814 leader_election.cc:290] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.183346 14786 leader_election.cc:290] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.183967 14802 leader_election.cc:290] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.183856 14827 raft_consensus.cc:515] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.166728 14784 raft_consensus.cc:493] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.186283 14821 raft_consensus.cc:493] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.186194 14784 raft_consensus.cc:515] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.186858 14821 raft_consensus.cc:515] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.187924 14832 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.186501 14813 leader_election.cc:290] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.188431 14832 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.188956 14838 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.189495 14821 leader_election.cc:290] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.190218 14819 raft_consensus.cc:493] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.190797 14840 raft_consensus.cc:493] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.190972 14819 raft_consensus.cc:515] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.191442 14840 raft_consensus.cc:515] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.192327 14823 raft_consensus.cc:493] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.192888 14823 raft_consensus.cc:515] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.193451 14819 leader_election.cc:290] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.163821 14804 raft_consensus.cc:493] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.173975 14816 leader_election.cc:290] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.268401 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.281069 14680 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.174166 14820 raft_consensus.cc:493] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.165438 14815 raft_consensus.cc:515] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.210806 14840 leader_election.cc:290] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.269207 13652 raft_consensus.cc:2468] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.177760 14825 raft_consensus.cc:493] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.270570 14789 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.308748 14835 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.309412 14835 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.310335 14786 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.310954 14786 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.313428 14828 raft_consensus.cc:493] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.313992 14828 raft_consensus.cc:515] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.210963 14827 leader_election.cc:290] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.316159 14828 leader_election.cc:290] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.314656 14812 leader_election.cc:290] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.315953 14794 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.317118 14803 leader_election.cc:290] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.317230 14794 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.306198 14813 raft_consensus.cc:493] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.319331 14794 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.320353 14831 raft_consensus.cc:493] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.320608 14839 raft_consensus.cc:493] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.321210 14839 raft_consensus.cc:515] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.321915 14821 raft_consensus.cc:493] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.322811 14832 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.322513 14831 raft_consensus.cc:515] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.323345 14839 leader_election.cc:290] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.323865 14839 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.324326 14839 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.324700 14831 leader_election.cc:290] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.322521 14821 raft_consensus.cc:515] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:24.314468 13619 leader_election.cc:336] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:24.363225 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 48792.2us
W20260709 13:04:24.369269 13619 leader_election.cc:336] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:24.189499 14838 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.324185 14797 leader_election.cc:290] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.325479 14799 leader_election.cc:290] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.320842 14822 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:04:24.374090 13766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 216934us
W20260709 13:04:24.371101 13619 leader_election.cc:336] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:24.381690 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.373529 14787 leader_election.cc:290] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.384238 14806 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.385690 14821 leader_election.cc:290] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.386454 14806 raft_consensus.cc:493] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.386935 14810 leader_election.cc:290] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.387961 14842 raft_consensus.cc:493] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.388218 14795 leader_election.cc:290] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.388597 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.368134 14825 raft_consensus.cc:515] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.312079 14820 raft_consensus.cc:515] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.388130 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.292333 14804 raft_consensus.cc:515] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.409551 14820 leader_election.cc:290] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.410266 14804 leader_election.cc:290] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.410696 14838 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.411468 14821 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.412009 14821 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:24.394636 13619 consensus_peers.cc:597] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.414350 14680 raft_consensus.cc:2804] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:04:24.414513 13619 consensus_peers.cc:597] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.414779 14680 raft_consensus.cc:493] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.415105 14680 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.416815 14815 leader_election.cc:290] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
W20260709 13:04:24.418398 13619 leader_election.cc:336] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:24.418974 13619 leader_election.cc:336] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:24.419514 13619 leader_election.cc:336] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:24.420177 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:24.424194 13619 consensus_peers.cc:597] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.423955 14806 raft_consensus.cc:515] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.425545 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:04:24.425662 13619 leader_election.cc:336] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:24.426415 13619 leader_election.cc:336] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:24.426491 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:24.427009 13619 leader_election.cc:336] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:24.427193 13797 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:04:24.428313 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.428491 14806 leader_election.cc:290] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:24.428686 13619 leader_election.cc:336] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:24.421746 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.426529 14823 leader_election.cc:290] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.431593 14784 leader_election.cc:290] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.432950 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.414402 14834 raft_consensus.cc:493] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.434382 14821 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.434574 14829 raft_consensus.cc:493] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.434394 14834 raft_consensus.cc:515] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.435221 14829 raft_consensus.cc:515] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.437232 14834 leader_election.cc:290] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.437476 14829 leader_election.cc:290] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.438098 14840 raft_consensus.cc:493] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.438655 14840 raft_consensus.cc:515] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.405368 14814 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.439637 14814 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.440795 14840 leader_election.cc:290] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.431605 14825 leader_election.cc:290] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.441793 14814 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.414543 14818 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.405191 14819 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.443096 14818 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.444370 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.425788 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.445007 14845 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.372325 14813 raft_consensus.cc:515] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.446002 14842 raft_consensus.cc:515] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.447464 14813 leader_election.cc:290] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.448232 14842 leader_election.cc:290] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.446430 14833 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.449070 14833 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.445549 14845 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.443154 14819 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.450450 14844 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.453374 14819 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.453191 14844 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.454313 13801 raft_consensus.cc:2468] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:04:24.454733 14828 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.445034 13646 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:24.450721 14832 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.443845 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.455602 14808 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.455838 14832 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.456202 14808 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.457412 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.458127 13720 raft_consensus.cc:2468] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.458645 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.457929 14832 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.459302 13722 raft_consensus.cc:2468] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.452436 14845 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.445556 14818 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.460434 14848 raft_consensus.cc:493] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.460817 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.461087 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.460960 14848 raft_consensus.cc:515] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.461748 13721 raft_consensus.cc:2468] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.455272 14844 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.462476 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.450585 14810 raft_consensus.cc:493] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.463295 14810 raft_consensus.cc:515] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.463568 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.463019 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cb9bb386e4e21b297137851efdc10" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.464552 14848 leader_election.cc:290] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.454504 14804 raft_consensus.cc:493] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.462581 13723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.465262 14804 raft_consensus.cc:515] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.450052 14822 raft_consensus.cc:493] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.464821 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.466529 14822 raft_consensus.cc:515] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.466964 13795 raft_consensus.cc:2468] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 1.
I20260709 13:04:24.467368 14804 leader_election.cc:290] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.467818 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.468313 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:04:24.468972 13766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 45264.5us
I20260709 13:04:24.470446 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.465323 14810 leader_election.cc:290] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.471096 14808 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.468446 14822 leader_election.cc:290] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.451134 14833 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.455237 14828 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.470400 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.473526 13722 raft_consensus.cc:2468] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.474123 14828 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.476377 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.477636 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.478137 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.478755 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.479326 13652 raft_consensus.cc:2468] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:24.479327 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.481209 13723 raft_consensus.cc:2468] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:04:24.481983 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.481539 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.484438 13724 raft_consensus.cc:2468] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.487891 14833 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.488562 14833 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.490664 14833 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.491173 14833 raft_consensus.cc:493] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.491606 14833 raft_consensus.cc:515] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.493040 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.493752 14833 leader_election.cc:290] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.494771 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.495172 13723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.495464 13651 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:24.495846 13723 raft_consensus.cc:2468] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.497762 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:04:24.507992 14384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 333351us
I20260709 13:04:24.493104 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.556767 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.557796 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30707476881c44db89b44a8a2e812372" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:04:24.566047 14549 debug-util.cc:398] Leaking SignalData structure 0x7b080005d700 after lost signal to thread 7091
I20260709 13:04:24.566244 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.566713 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:04:24.567266 14549 debug-util.cc:398] Leaking SignalData structure 0x7b0800332da0 after lost signal to thread 13510
I20260709 13:04:24.567795 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:04:24.568697 14549 debug-util.cc:398] Leaking SignalData structure 0x7b0800369e80 after lost signal to thread 13677
I20260709 13:04:24.569124 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.555069 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:24.570045 14549 debug-util.cc:398] Leaking SignalData structure 0x7b0800433b20 after lost signal to thread 13751
I20260709 13:04:24.569136 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.571552 14839 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.571624 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:04:24.574057 14549 debug-util.cc:398] Leaking SignalData structure 0x7b0800170260 after lost signal to thread 13825
I20260709 13:04:24.565582 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d226b35af23040529bd02af17994d615" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.572062 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.572088 14798 leader_election.cc:290] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.570604 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.571807 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.578217 14788 leader_election.cc:290] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:04:24.575935 14549 debug-util.cc:398] Leaking SignalData structure 0x7b08001242c0 after lost signal to thread 14553
W20260709 13:04:24.600600 14549 debug-util.cc:398] Leaking SignalData structure 0x7b0800031fc0 after lost signal to thread 14554
I20260709 13:04:24.605254 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.607564 14809 raft_consensus.cc:493] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.607851 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.608024 14384 leader_election.cc:304] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:24.578624 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.609016 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.578982 14850 raft_consensus.cc:493] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.579357 13797 raft_consensus.cc:2468] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:04:24.609164 14789 raft_consensus.cc:2804] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.579147 13721 raft_consensus.cc:2468] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:24.579296 14811 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.610263 13800 raft_consensus.cc:2468] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.586208 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.609966 14850 raft_consensus.cc:515] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:24.579748 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.583993 14793 leader_election.cc:290] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.586999 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.615645 13801 raft_consensus.cc:2468] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.615722 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.591156 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.590867 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cb9bb386e4e21b297137851efdc10" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.586403 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.599670 14680 raft_consensus.cc:515] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.597550 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.616343 13725 raft_consensus.cc:2468] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:24.590548 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.610690 14789 raft_consensus.cc:493] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.594389 13723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.625308 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.625573 13723 raft_consensus.cc:2468] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:24.626423 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.627182 14680 leader_election.cc:290] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.626713 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:24.586678 13767 consensus_peers.cc:597] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:24.594739 13693 consensus_peers.cc:597] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.633219 14384 leader_election.cc:304] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:24.594662 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.591593 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.635290 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.596849 14805 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.624934 14789 raft_consensus.cc:3060] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.598284 14786 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.592146 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.614171 14850 leader_election.cc:290] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:24.648773 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.637424 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.650566 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.651213 13795 raft_consensus.cc:2468] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:04:24.651891 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.652741 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.652967 14384 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:24.653362 13800 raft_consensus.cc:2468] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:04:24.594739 14796 leader_election.cc:290] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.594971 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.637948 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.654343 13722 raft_consensus.cc:2468] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 1.
I20260709 13:04:24.654417 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.655037 13796 raft_consensus.cc:2468] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:04:24.655371 14801 leader_election.cc:290] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.591595 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.655522 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.655905 14811 raft_consensus.cc:2804] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.629516 13794 raft_consensus.cc:1240] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Rejecting Update request from peer fd3a9103ce8543f5aae6be46c1f76bd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:24.656275 14811 raft_consensus.cc:493] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.656812 14811 raft_consensus.cc:3060] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.658138 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.658696 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.660851 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.661280 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.662245 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.662511 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.662655 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.663602 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.651947 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.664474 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.664605 13798 raft_consensus.cc:2468] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:04:24.665573 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.665768 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.640106 14793 raft_consensus.cc:2804] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.667484 14793 raft_consensus.cc:493] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.667877 14793 raft_consensus.cc:3060] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.608886 14809 raft_consensus.cc:515] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.644814 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.645364 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.669713 13719 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:24.658715 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.670281 13720 raft_consensus.cc:2468] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 1.
I20260709 13:04:24.646464 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c288c22a5bfd4771bddaaf7a39264407" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.647135 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84008f69faa047d1b47f08ea114c506a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.671974 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.672936 14809 leader_election.cc:290] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.673890 13723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.674142 13766 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:24.646793 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.675308 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cb9bb386e4e21b297137851efdc10" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.671023 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.647882 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.656301 13799 raft_consensus.cc:2468] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 1.
I20260709 13:04:24.641852 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.676752 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.653489 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.675235 13766 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:24.675841 14850 raft_consensus.cc:2804] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.678160 14850 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.678524 14850 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.678340 14833 raft_consensus.cc:2804] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.679781 14833 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.680153 14833 raft_consensus.cc:3060] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.677645 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.684911 13616 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.688784 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.689085 14835 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.689384 14788 raft_consensus.cc:2749] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:24.691850 13616 leader_election.cc:304] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.686730 13691 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
W20260709 13:04:24.696017 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 63712.7us
I20260709 13:04:24.699916 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.700692 13800 raft_consensus.cc:2393] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 3: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:04:24.700748 13766 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:24.701002 14809 raft_consensus.cc:2804] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.701414 14809 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.701792 14809 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:24.697425 13691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 73656.5us
I20260709 13:04:24.708441 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.708669 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.709197 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.709812 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cfd7b05f864022974fc28bfacd9c0d" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.710892 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.711591 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d226b35af23040529bd02af17994d615" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.713162 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.715283 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.715840 13651 raft_consensus.cc:2468] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 816d755a8270492d88dac41d1d303c68 in term 2.
I20260709 13:04:24.709750 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.711210 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.718567 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.719341 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.720211 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.720544 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.722179 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1fa6c68f5c4c54ad078f62fd387651" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.722502 13794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.725322 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.725768 13794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.725849 13800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.727016 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1653f547204758a0cd6a122be125cc" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.727640 14850 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.730294 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.731967 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.732251 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b764a88e92eb45b59fdd342348e09439" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:24.733850 13693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 103590us
I20260709 13:04:24.702831 14835 raft_consensus.cc:2749] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.736352 13691 leader_election.cc:304] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.738200 13617 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.740238 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.731509 14810 raft_consensus.cc:2804] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.742486 13617 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.741652 14384 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:24.745545 13691 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:24.723304 14811 raft_consensus.cc:515] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.746747 14839 raft_consensus.cc:2804] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.741809 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30707476881c44db89b44a8a2e812372" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.729861 14833 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.753549 13617 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.752068 14850 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.743302 14786 raft_consensus.cc:2749] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.746517 14788 raft_consensus.cc:2749] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.745151 14810 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.759967 14810 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.760705 14784 raft_consensus.cc:2749] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.752343 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d226b35af23040529bd02af17994d615" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.749017 14848 raft_consensus.cc:2804] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.762254 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32f0a6ac7f748819c2a4796bb279d80" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.762598 14847 raft_consensus.cc:2804] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.763164 14847 raft_consensus.cc:493] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.763509 14847 raft_consensus.cc:3060] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.766427 14837 consensus_queue.cc:1059] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:24.762295 14848 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.767963 14383 leader_election.cc:304] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.767957 14848 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.769310 14383 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.770246 14805 raft_consensus.cc:2804] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.770480 14798 raft_consensus.cc:2804] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.770978 14798 raft_consensus.cc:493] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.771325 14798 raft_consensus.cc:3060] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.771674 14805 raft_consensus.cc:493] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.772075 14805 raft_consensus.cc:3060] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.773281 14789 raft_consensus.cc:515] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.774006 14383 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.774821 14795 raft_consensus.cc:2804] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.775166 14795 raft_consensus.cc:493] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.775508 14795 raft_consensus.cc:3060] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.775780 14383 leader_election.cc:304] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.777242 14787 raft_consensus.cc:2749] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.750783 14839 raft_consensus.cc:493] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.779376 14839 raft_consensus.cc:3060] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.780457 14833 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.783985 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:24.791497 13764 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.792769 13764 leader_election.cc:304] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.793257 14789 leader_election.cc:290] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.794512 13617 leader_election.cc:304] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.796875 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.798017 14850 raft_consensus.cc:2749] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.770169 14846 raft_consensus.cc:3055] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:24.798676 14846 raft_consensus.cc:740] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:24.798316 14811 leader_election.cc:290] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.799175 14849 raft_consensus.cc:2804] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.789693 14805 raft_consensus.cc:515] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.799731 14849 raft_consensus.cc:493] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.800151 14849 raft_consensus.cc:3060] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.802211 14805 leader_election.cc:290] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.805110 14784 raft_consensus.cc:2749] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.808107 13616 leader_election.cc:304] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.809707 14793 raft_consensus.cc:515] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.811950 13616 leader_election.cc:304] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.806746 13617 leader_election.cc:304] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.813535 13616 leader_election.cc:304] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.815002 14809 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.815667 14788 raft_consensus.cc:2749] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.816310 14792 raft_consensus.cc:2749] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.816735 13617 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.818902 14792 raft_consensus.cc:2749] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.820003 13692 leader_election.cc:304] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
W20260709 13:04:24.820894 13692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 84204.8us
I20260709 13:04:24.821167 13617 leader_election.cc:304] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.821700 14837 raft_consensus.cc:2749] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.822654 13692 leader_election.cc:304] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.823112 13617 leader_election.cc:304] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.824085 13692 leader_election.cc:304] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.816933 14810 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.810487 14848 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.817394 14786 raft_consensus.cc:2804] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.829715 14786 raft_consensus.cc:493] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.830171 14786 raft_consensus.cc:3060] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.827991 14807 raft_consensus.cc:2749] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.831651 14810 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.826797 14817 raft_consensus.cc:2749] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.822018 14792 raft_consensus.cc:2749] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.833302 14809 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.800253 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.834370 14381 leader_election.cc:304] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.777874 14383 leader_election.cc:304] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:04:24.834404 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:24.825970 13692 leader_election.cc:304] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.835224 14839 raft_consensus.cc:515] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.829865 14760 raft_consensus.cc:2749] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.837270 14839 leader_election.cc:290] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.819190 14793 leader_election.cc:290] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.837868 14839 raft_consensus.cc:2749] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.837510 14798 raft_consensus.cc:515] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.839316 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:24.837383 14848 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.841009 13616 leader_election.cc:304] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.799803 14846 consensus_queue.cc:260] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.843010 14795 raft_consensus.cc:515] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:24.845130 13616 leader_election.cc:304] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:24.842665 14786 raft_consensus.cc:515] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.846921 13616 leader_election.cc:304] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.847703 13692 leader_election.cc:304] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.847371 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.789803 14847 raft_consensus.cc:515] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:24.850673 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.851210 14381 leader_election.cc:304] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.852391 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.852823 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc89eeba61904cf58fc52c2ef8809a70" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.853601 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.853752 14846 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.849623 14811 raft_consensus.cc:2804] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.854738 14811 raft_consensus.cc:493] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.855147 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.855916 14849 raft_consensus.cc:515] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.848845 14788 raft_consensus.cc:2804] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.856858 14788 raft_consensus.cc:493] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:24.857265 14788 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.848770 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.858417 14801 raft_consensus.cc:2804] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.858827 14801 raft_consensus.cc:493] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.859170 14801 raft_consensus.cc:3060] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.859326 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.860541 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.846060 14760 raft_consensus.cc:2749] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.856390 13720 raft_consensus.cc:1240] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Rejecting Update request from peer e3683af201ac41948aaa81cea02de029 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:24.862375 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:24.855098 14811 raft_consensus.cc:3060] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.864217 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72da2bb06f304ae68d7bc48e326c2b84" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.864405 14381 leader_election.cc:304] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.849874 14793 raft_consensus.cc:2804] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.841310 14798 leader_election.cc:290] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.847503 14792 raft_consensus.cc:2804] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.873364 14792 raft_consensus.cc:493] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.873766 14792 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.874063 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd55ddae5c64d3a9093174906446c68" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.875227 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c9f55bf0434c59813efb44039ba4ae" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
W20260709 13:04:24.846458 14383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 68672.8us
I20260709 13:04:24.876170 14383 leader_election.cc:304] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.876315 14812 raft_consensus.cc:2749] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.871574 14815 raft_consensus.cc:2749] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.878047 14795 leader_election.cc:290] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:24.871603 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d381a014c4f543909a33453b71bff652" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.851408 14848 raft_consensus.cc:2749] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.880235 13616 leader_election.cc:304] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.883939 13651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.883648 13616 leader_election.cc:304] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.884074 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:24.885385 13616 leader_election.cc:304] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.885916 13692 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.882740 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.893158 13616 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.870532 14793 raft_consensus.cc:493] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.895834 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.896443 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635dc98fdf3042ecba64ee28b17f4713" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:24.893790 14812 raft_consensus.cc:2804] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:24.902746 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:24.903226 14812 raft_consensus.cc:493] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.897073 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:24.880168 14849 leader_election.cc:290] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.895284 14807 raft_consensus.cc:2749] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.911787 14796 consensus_queue.cc:1059] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.903656 14812 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:24.900915 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.903390 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:24.912892 14796 raft_consensus.cc:3055] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.908756 14381 leader_election.cc:304] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.914295 13652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.914390 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.893778 14760 raft_consensus.cc:2804] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.914228 14381 leader_election.cc:304] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.913256 14796 raft_consensus.cc:740] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:24.894156 14790 raft_consensus.cc:3060] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.916563 13799 raft_consensus.cc:1240] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Rejecting Update request from peer fd3a9103ce8543f5aae6be46c1f76bd8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:24.901548 14793 raft_consensus.cc:3060] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.916896 14820 raft_consensus.cc:2804] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.900748 14815 raft_consensus.cc:2749] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.925498 14820 raft_consensus.cc:493] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.902679 14785 raft_consensus.cc:2749] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.925983 14820 raft_consensus.cc:3060] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.917068 14760 raft_consensus.cc:493] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.926748 14760 raft_consensus.cc:3060] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.909958 14383 leader_election.cc:304] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: 
I20260709 13:04:24.929903 13650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:24.930938 14383 leader_election.cc:304] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.932327 14383 leader_election.cc:304] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.934252 14787 raft_consensus.cc:2804] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.934676 14787 raft_consensus.cc:493] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.935037 14787 raft_consensus.cc:3060] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.935360 14847 leader_election.cc:290] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.935978 14847 raft_consensus.cc:2804] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.936297 14847 raft_consensus.cc:493] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.936625 14847 raft_consensus.cc:3060] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.938778 14815 raft_consensus.cc:2749] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.918949 14797 raft_consensus.cc:2804] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.939395 14797 raft_consensus.cc:493] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.939771 14797 raft_consensus.cc:3060] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.925498 14796 consensus_queue.cc:260] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.943631 14796 raft_consensus.cc:3060] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.941429 14812 raft_consensus.cc:515] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.946762 13647 raft_consensus.cc:1240] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Rejecting Update request from peer da3d66493d2f419fb8eda6491ce13df0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:24.947278 14812 leader_election.cc:290] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.947988 14786 leader_election.cc:290] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:24.948817 14849 consensus_queue.cc:1059] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:24.949963 14810 raft_consensus.cc:3055] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:24.950348 14810 raft_consensus.cc:740] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:24.920181 13764 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.922036 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:24.933776 14383 leader_election.cc:304] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.953155 14383 leader_election.cc:304] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.909971 13692 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.922822 14381 leader_election.cc:304] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.923979  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:24.924321 14839 consensus_queue.cc:1059] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.954941 14817 raft_consensus.cc:2749] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.933878 14788 raft_consensus.cc:515] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:24.909493 13693 leader_election.cc:336] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:24.954131 13692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 46896.1us
I20260709 13:04:24.956799  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:24.958634 13693 leader_election.cc:304] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.960264 13764 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.960956 14383 leader_election.cc:304] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.961445 14381 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.961815 14383 leader_election.cc:304] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.963292 14383 leader_election.cc:304] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.965130 13764 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:24.964641 14830 raft_consensus.cc:2804] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.957526 14849 raft_consensus.cc:2749] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.957135 14798 raft_consensus.cc:2804] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.960450 14805 raft_consensus.cc:2749] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.963873 14795 raft_consensus.cc:2804] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.965163 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:24.963979 14799 raft_consensus.cc:2749] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.973807 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:24.951272 14810 consensus_queue.cc:260] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:24.964152 14789 raft_consensus.cc:2804] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:24.968973 14818 raft_consensus.cc:2749] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:24.987046 14789 raft_consensus.cc:493] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:24.987519 14789 raft_consensus.cc:3060] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:24.987064 13693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 77604.3us
I20260709 13:04:24.981331 13692 leader_election.cc:304] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.970468 14830 raft_consensus.cc:493] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:24.973552 14381 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.970736 14822 raft_consensus.cc:2749] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.972216 14798 raft_consensus.cc:493] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.990257 14381 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
W20260709 13:04:24.988901 13693 leader_election.cc:336] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:24.991904 13693 leader_election.cc:304] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:24.987223 14817 raft_consensus.cc:2749] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:24.976306 14795 raft_consensus.cc:493] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:24.992077 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320e88d5ea5446bf95970895e068d9b5" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:24.992326 14799 raft_consensus.cc:2804] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:24.995926 14788 leader_election.cc:290] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:24.982621 14815 raft_consensus.cc:2749] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:24.998915 13693 leader_election.cc:336] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:24.999012 13692 leader_election.cc:304] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.001884 13693 leader_election.cc:304] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:24.989771 14830 raft_consensus.cc:3060] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.992934 14798 raft_consensus.cc:3060] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.000182 14795 raft_consensus.cc:3060] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.003818 13652 raft_consensus.cc:1240] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Rejecting Update request from peer da3d66493d2f419fb8eda6491ce13df0 for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:25.013319 13693 leader_election.cc:336] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.014171 13693 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.001096 14839 raft_consensus.cc:2749] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.000656 14805 raft_consensus.cc:2749] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.002601 14817 raft_consensus.cc:2749] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.000304 14799 raft_consensus.cc:493] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
W20260709 13:04:25.019078 13693 leader_election.cc:336] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.020699 13693 leader_election.cc:304] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:25.025028 14846 raft_consensus.cc:2749] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:25.013895 14807 raft_consensus.cc:2749] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:25.026690 13693 leader_election.cc:336] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.027112 13693 leader_election.cc:304] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:25.015357 14809 raft_consensus.cc:2749] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:25.028043 14809 raft_consensus.cc:2749] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:25.031219 13693 leader_election.cc:336] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.031776 13693 leader_election.cc:304] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
W20260709 13:04:25.036480 13693 leader_election.cc:336] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.036927 13693 leader_election.cc:304] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
W20260709 13:04:25.040362 14383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 77166.5us
W20260709 13:04:25.040560 13693 leader_election.cc:336] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.041188 13693 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:25.018340 14810 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:25.015027 13720 raft_consensus.cc:2468] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:25.043380 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d68fc7290844b39bac589ab8ce83a3" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.031073 14799 raft_consensus.cc:3060] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:25.046519 13693 leader_election.cc:336] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.049036 13693 leader_election.cc:304] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.048403 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b482cf0234463ea074fc05017ed5b4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.052290 14824 raft_consensus.cc:2749] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.040839 14792 raft_consensus.cc:515] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.055102 14792 leader_election.cc:290] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.056005 14846 raft_consensus.cc:2749] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.058776 13650 raft_consensus.cc:1240] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Rejecting Update request from peer da3d66493d2f419fb8eda6491ce13df0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:25.059418 14793 raft_consensus.cc:515] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:25.061576 14793 leader_election.cc:290] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.041932 14817 raft_consensus.cc:2749] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.062232 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfa4c53a9364ccf8cf7c241664c6538" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
W20260709 13:04:25.062479 13693 leader_election.cc:336] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.066495 13693 leader_election.cc:304] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
W20260709 13:04:25.067639 13693 leader_election.cc:336] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.068073 13693 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
W20260709 13:04:25.069082 13693 leader_election.cc:336] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.069509 13693 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:25.038739 14807 raft_consensus.cc:2749] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.035310 14849 consensus_queue.cc:1059] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:04:25.075945 13725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fef40743044169b7338f2d22113320" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.041788 14809 raft_consensus.cc:2749] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.093592 14795 raft_consensus.cc:515] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:25.081090 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.096130 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907d3c0b010e4d80b4aa0eeb2068b21b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.096670 13726 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.076479 14828 raft_consensus.cc:2749] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.102869 14801 raft_consensus.cc:515] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:25.103905 14790 raft_consensus.cc:2749] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.105122 14801 leader_election.cc:290] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.106022 14787 raft_consensus.cc:515] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:25.106998 13726 raft_consensus.cc:2468] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:25.108040 14787 leader_election.cc:290] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.109045 14795 leader_election.cc:290] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:25.108014 13726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.070459 14817 raft_consensus.cc:2749] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.072469 14825 consensus_queue.cc:1059] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:04:25.113359 13616 leader_election.cc:304] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:25.114609 14835 raft_consensus.cc:2804] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:25.115082 14835 raft_consensus.cc:697] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:25.115972 14835 consensus_queue.cc:237] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:25.116684 14850 raft_consensus.cc:3055] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.117169 14850 raft_consensus.cc:740] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:25.118054 14850 consensus_queue.cc:260] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.119470 14850 raft_consensus.cc:3060] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.119881 14825 raft_consensus.cc:3055] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:25.120292 14825 raft_consensus.cc:740] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:25.121132 14825 consensus_queue.cc:260] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.084048 13723 raft_consensus.cc:1240] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Rejecting Update request from peer e3683af201ac41948aaa81cea02de029 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:25.122927 13722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341bc78504924367be418f9f9efdce67" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.084671 13727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.086524 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d05fd940f54f5284d55861d78ae249" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.044965 14811 raft_consensus.cc:515] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:25.072861 14846 raft_consensus.cc:2749] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:25.125010  7088 raft_consensus.cc:2243] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.126101 14811 leader_election.cc:290] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.093676 14760 raft_consensus.cc:515] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
W20260709 13:04:25.124536 14832 consensus_queue.cc:1175] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:04:25.128193 14760 leader_election.cc:290] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.128948 13646 raft_consensus.cc:1240] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Rejecting Update request from peer da3d66493d2f419fb8eda6491ce13df0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:25.128940 13721 raft_consensus.cc:2393] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 2: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:04:25.118563 14831 raft_consensus.cc:3055] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.131063 14831 raft_consensus.cc:740] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:25.131548  7088 raft_consensus.cc:2272] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.131995 14831 consensus_queue.cc:260] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.116928 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225960baa6af41d187116bada579f2f4" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
W20260709 13:04:25.081951 13619 consensus_peers.cc:597] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.139499 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 57602.9us
W20260709 13:04:25.128053 13767 consensus_peers.cc:597] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.140079 13767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 69162.6us
W20260709 13:04:25.140683 13767 consensus_peers.cc:597] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.141647 13767 consensus_peers.cc:597] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.142227 13767 consensus_peers.cc:597] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.142791 13767 consensus_peers.cc:597] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.143313 13767 consensus_peers.cc:597] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.143821 13767 consensus_peers.cc:597] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.160513 14832 consensus_queue.cc:1059] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:25.161113 14789 raft_consensus.cc:515] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:25.161859 14832 raft_consensus.cc:3055] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.162317 14832 raft_consensus.cc:740] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:25.163192 14832 consensus_queue.cc:260] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.164474 14832 raft_consensus.cc:3060] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.065744 14799 raft_consensus.cc:515] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:25.124102 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9ad8a90dd49fcbe84e5a6fd2cca45" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.077577 14381 leader_election.cc:304] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.182792 14790 consensus_queue.cc:1059] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.184010 14792 raft_consensus.cc:3055] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.184371 14792 raft_consensus.cc:740] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:25.184587 14830 raft_consensus.cc:515] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:25.185648 13616 leader_election.cc:304] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.190379 14847 raft_consensus.cc:515] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:25.189592 14760 raft_consensus.cc:2749] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.192220 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:25.192505 14847 leader_election.cc:290] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:25.189457 14825 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.194016 14787 raft_consensus.cc:2749] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.185137 14792 consensus_queue.cc:260] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.195322 13764 leader_election.cc:304] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.196923  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.196499 14798 raft_consensus.cc:515] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:25.197014 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ab7e9fc8c34bc99d9f07c85304f21b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
W20260709 13:04:25.194270 14381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 116797us
I20260709 13:04:25.207583 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c13150952941e18c09fb91de8dbaa7" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.208097 13652 raft_consensus.cc:1240] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Rejecting Update request from peer 816d755a8270492d88dac41d1d303c68 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:25.189671 14797 raft_consensus.cc:515] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:25.209292 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.209690 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:25.212815 14797 leader_election.cc:290] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:25.211032 14799 leader_election.cc:290] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.210721 14833 raft_consensus.cc:2804] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:25.214331 14833 raft_consensus.cc:697] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:25.215351 14833 consensus_queue.cc:237] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.216032 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.217561 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.218397 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.212755 14792 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:25.224279 13767 consensus_peers.cc:597] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.227233 13475 catalog_manager.cc:5697] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.228325 14798 leader_election.cc:290] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:25.229264 14381 leader_election.cc:304] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.229926 14798 raft_consensus.cc:2749] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.205385  7088 raft_consensus.cc:2243] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.206347 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.230804  7088 raft_consensus.cc:2272] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.233943  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.234809  7088 raft_consensus.cc:2243] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.235742  7088 raft_consensus.cc:2272] T 8c6632785442492484d7bd8e03442d29 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.238222 14381 leader_election.cc:304] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.241365 13649 raft_consensus.cc:2468] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:25.173621 14789 leader_election.cc:290] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.242748 14801 raft_consensus.cc:2749] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.243162 13766 leader_election.cc:304] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.244203 14818 raft_consensus.cc:2804] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.218794 14830 leader_election.cc:290] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:25.245138 14818 raft_consensus.cc:697] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:25.193704 14831 raft_consensus.cc:3060] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.246129 14818 consensus_queue.cc:237] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.244153 14381 leader_election.cc:304] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.201315 14820 raft_consensus.cc:515] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:25.248070 14847 raft_consensus.cc:2749] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.250048 14847 consensus_queue.cc:1059] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:25.251523 14820 leader_election.cc:290] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:25.251574 14847 consensus_queue.cc:1243] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [LEADER]: Peer e3683af201ac41948aaa81cea02de029 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:25.194617 14383 leader_election.cc:304] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.255473 14830 raft_consensus.cc:3055] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:25.252573 14381 leader_election.cc:304] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
W20260709 13:04:25.258625 14383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 64101.1us
I20260709 13:04:25.259624 14381 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.259877 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:25.259325 14383 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.259781 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:25.260857 14820 raft_consensus.cc:2749] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.262811 14383 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
W20260709 13:04:25.268925 14383 raft_consensus.cc:2686] T 93d68fc7290844b39bac589ab8ce83a3 P 816d755a8270492d88dac41d1d303c68: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:25.270100 14801 raft_consensus.cc:2749] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.270578 13718 raft_consensus.cc:1240] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Rejecting Update request from peer e3683af201ac41948aaa81cea02de029 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:25.270889 14795 raft_consensus.cc:2749] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.261689 14830 raft_consensus.cc:740] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 816d755a8270492d88dac41d1d303c68, State: Running, Role: LEADER
I20260709 13:04:25.271606 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08af1fe4826543f6928324c919a96c4b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.261714 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:25.272173 14830 consensus_queue.cc:260] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:25.273350 14383 leader_election.cc:304] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.274747  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.275676  7088 raft_consensus.cc:2243] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.279841  7088 raft_consensus.cc:2272] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.280177 14801 raft_consensus.cc:2749] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.274771 14830 raft_consensus.cc:3060] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.262300 14798 raft_consensus.cc:2749] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.296296  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.296571 13799 raft_consensus.cc:2468] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:25.297399  7088 raft_consensus.cc:2243] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.297864  7088 raft_consensus.cc:2272] T 341bc78504924367be418f9f9efdce67 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.298391 13617 leader_election.cc:304] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:25.300829 13799 raft_consensus.cc:1240] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Rejecting Update request from peer fd3a9103ce8543f5aae6be46c1f76bd8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:25.303194 13799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.299041 13793 raft_consensus.cc:2468] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:25.311513 13801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399df00a17e541e98fae8d4664b4566c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.312970 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0411d9d92994ad9be1464bd3c136064" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.313745 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4375b1ee962c4bdab7ed9a4744ac1abf" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.312988 13794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.313297 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44b221b69f84c5b92e7df2779fa16dc" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.317219 13617 leader_election.cc:304] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.318146 14796 raft_consensus.cc:2804] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:25.318825 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e397de8fed4278ac1e623f0bb77e7c" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.318737 14796 raft_consensus.cc:697] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:25.320427 14796 consensus_queue.cc:237] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.309113 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9ef826114749218e503fce75ebe00b" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:25.318193 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d4a4a907f4921a9e03d12d58b8bb4" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.324589 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944b6716b88040be900d0421aa382a29" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.326651 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c0cb319af54e149630d921dcb04084" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.327586 13724 raft_consensus.cc:1240] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Rejecting Update request from peer 816d755a8270492d88dac41d1d303c68 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:25.318796 14828 consensus_queue.cc:1059] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:04:25.329352 14828 raft_consensus.cc:3055] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:25.329710 14828 raft_consensus.cc:740] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
W20260709 13:04:25.330579 13767 leader_election.cc:336] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.331066 13767 leader_election.cc:304] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.331207 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d09546ee4ea492f8b5ebef6afa028f0" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.327725  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.332911  7088 raft_consensus.cc:2243] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.331826 14383 leader_election.cc:304] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.309687 14792 raft_consensus.cc:2804] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:25.334456 13767 leader_election.cc:336] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.337622 13767 leader_election.cc:304] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.335115 14820 raft_consensus.cc:2749] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.339254 14381 leader_election.cc:304] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.340134 14795 raft_consensus.cc:2749] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.339934 14828 consensus_queue.cc:260] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.341269 14828 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:25.341607 13767 leader_election.cc:336] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.342231 14832 raft_consensus.cc:2749] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.342041 13767 leader_election.cc:304] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
W20260709 13:04:25.343971 13767 leader_election.cc:336] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.344352 13767 leader_election.cc:304] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.345027 14825 raft_consensus.cc:2749] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.345683 14825 raft_consensus.cc:2749] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:25.347033 13767 leader_election.cc:336] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.347429 13767 leader_election.cc:304] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
W20260709 13:04:25.348445 13767 leader_election.cc:336] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.348847 13767 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.350402 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c7c53b44db41d9a56cff5d00be5010" candidate_uuid: "816d755a8270492d88dac41d1d303c68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:25.351774 14832 raft_consensus.cc:2749] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.341271 14381 leader_election.cc:304] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.352572 14832 raft_consensus.cc:2749] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.353116 14820 raft_consensus.cc:2749] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:04:25.354413 13767 leader_election.cc:336] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.354880 13767 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.355599 14810 raft_consensus.cc:2749] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:25.356906 13767 leader_election.cc:336] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.336519 14818 raft_consensus.cc:2749] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.357342 13767 leader_election.cc:304] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.358543 14810 raft_consensus.cc:2749] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:25.359809 13767 leader_election.cc:336] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.360208 13767 leader_election.cc:304] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.367151 14810 raft_consensus.cc:2749] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.367612 13795 raft_consensus.cc:1240] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Rejecting Update request from peer fd3a9103ce8543f5aae6be46c1f76bd8 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:25.368944 13767 leader_election.cc:336] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.369431 13767 leader_election.cc:304] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.368937 14792 raft_consensus.cc:697] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:25.336005 14383 leader_election.cc:304] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
W20260709 13:04:25.336475 13619 consensus_peers.cc:597] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:25.371539 13619 leader_election.cc:336] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.371908 13619 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:25.369818  7088 raft_consensus.cc:2272] T 9fd55ddae5c64d3a9093174906446c68 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:25.373348 13767 leader_election.cc:336] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:25.373618 13619 leader_election.cc:336] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.373909 13767 leader_election.cc:304] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.374152 13619 leader_election.cc:304] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:25.375118 14810 raft_consensus.cc:2749] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.375162 14796 raft_consensus.cc:2749] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:25.377099 13619 leader_election.cc:336] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.377672 13619 leader_election.cc:304] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.378671 14835 raft_consensus.cc:2749] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.372931 14792 consensus_queue.cc:237] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.381875 14835 consensus_queue.cc:1059] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.382203 14818 raft_consensus.cc:2749] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:25.383184 13767 leader_election.cc:336] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.383685 13767 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
W20260709 13:04:25.379458 13619 leader_election.cc:336] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.379921 14796 raft_consensus.cc:2749] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.385907 14818 raft_consensus.cc:2749] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.385416 14381 leader_election.cc:304] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.384917 13619 leader_election.cc:304] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
W20260709 13:04:25.387751 14381 raft_consensus.cc:2686] T a0411d9d92994ad9be1464bd3c136064 P 816d755a8270492d88dac41d1d303c68: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:25.387243 14796 raft_consensus.cc:3055] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.373059 14828 consensus_queue.cc:1059] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:04:25.385453 13767 leader_election.cc:336] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.388370 14796 raft_consensus.cc:740] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:25.389442 13767 leader_election.cc:304] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
W20260709 13:04:25.390901 13767 leader_election.cc:336] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.384707 14830 raft_consensus.cc:2749] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.391070 14381 leader_election.cc:304] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.389119 14839 raft_consensus.cc:3055] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:25.396535 14839 raft_consensus.cc:740] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:25.396910 14796 consensus_queue.cc:260] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.397492 14839 consensus_queue.cc:260] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.391291 14818 raft_consensus.cc:2749] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.390635 14835 raft_consensus.cc:2749] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.400386 14381 leader_election.cc:304] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.400660 14839 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.387502 14831 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:25.410637 14831 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:25.396544 13476 catalog_manager.cc:5697] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 3, leader changed from fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.409042 14820 raft_consensus.cc:2749] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.409076 14830 raft_consensus.cc:2749] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.391417 13767 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
W20260709 13:04:25.413491 13767 leader_election.cc:336] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:25.409273 13619 leader_election.cc:336] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.414106 13767 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.414856 14833 raft_consensus.cc:2749] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:25.415890 13767 leader_election.cc:336] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.409719 14796 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.406723 13792 raft_consensus.cc:2468] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 4.
I20260709 13:04:25.413545 14818 raft_consensus.cc:2749] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:25.421976  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.409029 14381 leader_election.cc:304] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.422914  7088 raft_consensus.cc:2243] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.423370 13617 leader_election.cc:304] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.422876 14830 raft_consensus.cc:2749] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.425055 14835 raft_consensus.cc:2804] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:25.425724 14835 raft_consensus.cc:697] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 4 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:25.426235 13767 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.426688 14835 consensus_queue.cc:237] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:25.423961  7088 raft_consensus.cc:2272] T a9f715bd53db44c9897c1bc9af541e5c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.432231 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:25.435341  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.436225  7088 raft_consensus.cc:2243] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.436789  7088 raft_consensus.cc:2272] T b764a88e92eb45b59fdd342348e09439 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.437563 14831 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:25.439927  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.440992  7088 raft_consensus.cc:2243] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.441581  7088 raft_consensus.cc:2272] T 54e397de8fed4278ac1e623f0bb77e7c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:25.428731 13767 leader_election.cc:336] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.429368 14833 raft_consensus.cc:2749] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:25.442296 13767 leader_election.cc:304] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.443096 14833 raft_consensus.cc:2749] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:25.443499 13767 leader_election.cc:336] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.443948 13767 leader_election.cc:304] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.444590 14833 raft_consensus.cc:2749] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:25.444988 13767 leader_election.cc:336] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:25.445220 13693 leader_election.cc:336] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.445463 13767 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.442324 14381 leader_election.cc:304] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.446231 14833 raft_consensus.cc:2749] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.445749 13693 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
W20260709 13:04:25.446591 13767 leader_election.cc:336] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.447022 13767 leader_election.cc:304] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:25.448122 14381 leader_election.cc:304] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
W20260709 13:04:25.448385 13767 leader_election.cc:336] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:25.449009 13767 leader_election.cc:304] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: 816d755a8270492d88dac41d1d303c68, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.446430 14795 raft_consensus.cc:2749] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.451190 14833 raft_consensus.cc:2749] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.451822 14830 raft_consensus.cc:2749] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.451941 14833 raft_consensus.cc:2749] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.447641 14831 raft_consensus.cc:2749] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:25.453502 14381 leader_election.cc:304] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.457571  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.459662  7088 raft_consensus.cc:2243] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.459908 14381 leader_election.cc:304] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.460286 14830 raft_consensus.cc:2749] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:04:25.460767 14381 raft_consensus.cc:2686] T 3d09546ee4ea492f8b5ebef6afa028f0 P 816d755a8270492d88dac41d1d303c68: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:25.464543 14381 leader_election.cc:304] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 816d755a8270492d88dac41d1d303c68; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:25.465358 14830 raft_consensus.cc:2749] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:25.460319  7088 raft_consensus.cc:2272] T 40fef40743044169b7338f2d22113320 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.489403  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.490119  7088 raft_consensus.cc:2243] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.491176  7088 raft_consensus.cc:2272] T 87ba941f0f3547dab9f990d24133749f P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.494551  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.495420  7088 raft_consensus.cc:2243] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.496027  7088 raft_consensus.cc:2272] T c288c22a5bfd4771bddaaf7a39264407 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.501279  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.502100  7088 raft_consensus.cc:2243] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.502583  7088 raft_consensus.cc:2272] T 907d3c0b010e4d80b4aa0eeb2068b21b P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.507797  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.511085  7088 raft_consensus.cc:2243] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.511624  7088 raft_consensus.cc:2272] T 11ab7e9fc8c34bc99d9f07c85304f21b P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.515537  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.516326  7088 raft_consensus.cc:2243] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.517565  7088 raft_consensus.cc:2272] T 00c0045f00654855a3d672f639e01b17 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.521099  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.522163  7088 raft_consensus.cc:2243] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.522675  7088 raft_consensus.cc:2272] T d226b35af23040529bd02af17994d615 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.525758  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.524906 13476 catalog_manager.cc:5697] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 2 to 3, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.527838 13476 catalog_manager.cc:5697] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.537297 13475 catalog_manager.cc:5697] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.538162 13476 catalog_manager.cc:5697] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 3 to 4, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.527314  7088 raft_consensus.cc:2243] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.547027  7088 raft_consensus.cc:2272] T e1c0cb319af54e149630d921dcb04084 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.583091  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.584033  7088 raft_consensus.cc:2243] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.587036  7088 raft_consensus.cc:2272] T 7303d87314c5440cbf299237115d818c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.590744  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.591580  7088 raft_consensus.cc:2243] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.592203  7088 raft_consensus.cc:2272] T e32f0a6ac7f748819c2a4796bb279d80 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.596683  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.597479  7088 raft_consensus.cc:2243] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.598140  7088 raft_consensus.cc:2272] T 944b6716b88040be900d0421aa382a29 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:25.600711 13619 consensus_peers.cc:597] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.609586  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.610999  7088 raft_consensus.cc:2243] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.631747 13646 raft_consensus.cc:1275] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.633448 14810 consensus_queue.cc:1048] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.621315  7088 raft_consensus.cc:2272] T 79c7c53b44db41d9a56cff5d00be5010 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.679102 13721 raft_consensus.cc:1275] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.683033 14810 consensus_queue.cc:1048] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.687462  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.688395  7088 raft_consensus.cc:2243] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.689570  7088 raft_consensus.cc:2272] T 5d98df69890142c4894e28b58aefd8d8 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.702760  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.703608  7088 raft_consensus.cc:2243] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.704244  7088 raft_consensus.cc:2272] T b5c13150952941e18c09fb91de8dbaa7 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.708856  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.709677  7088 raft_consensus.cc:2243] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.710872  7088 raft_consensus.cc:2272] T 35763cd4283147759ec2c744a06238e3 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.717057 13719 raft_consensus.cc:1275] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.718788 14833 consensus_queue.cc:1048] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.722393  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.723321  7088 raft_consensus.cc:2243] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.723805  7088 raft_consensus.cc:2272] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.726238 13724 raft_consensus.cc:3060] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.733405 13724 raft_consensus.cc:1275] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.735450 14835 consensus_queue.cc:1048] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.741003  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.741798 13718 raft_consensus.cc:1275] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.746816  7088 raft_consensus.cc:2243] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.747880  7088 raft_consensus.cc:2272] T ebb2600ae8d741429738e3887b811cef P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.754331  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.755160  7088 raft_consensus.cc:2243] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.755731  7088 raft_consensus.cc:2272] T 72da2bb06f304ae68d7bc48e326c2b84 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.756361 14796 consensus_queue.cc:1048] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.788070 13646 raft_consensus.cc:1275] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.789700 14833 consensus_queue.cc:1048] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:04:25.790479  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.800933  7088 raft_consensus.cc:2243] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.801556  7088 raft_consensus.cc:2272] T 7d1fa6c68f5c4c54ad078f62fd387651 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.811791  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.812726  7088 raft_consensus.cc:2243] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.816570  7088 raft_consensus.cc:2272] T e08d4a4a907f4921a9e03d12d58b8bb4 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.836714 13792 raft_consensus.cc:1275] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.838546 14796 consensus_queue.cc:1048] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.838886  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.839766  7088 raft_consensus.cc:2243] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.840276  7088 raft_consensus.cc:2272] T 8b9ef826114749218e503fce75ebe00b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.843312  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.858286  7088 raft_consensus.cc:2243] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.858863  7088 raft_consensus.cc:2272] T 4375b1ee962c4bdab7ed9a4744ac1abf P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.863102  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.863891  7088 raft_consensus.cc:2243] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.864373  7088 raft_consensus.cc:2272] T c7b482cf0234463ea074fc05017ed5b4 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.869342  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.870201  7088 raft_consensus.cc:2243] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.870792  7088 raft_consensus.cc:2272] T 9dfa4c53a9364ccf8cf7c241664c6538 P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.873678  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.874436  7088 raft_consensus.cc:2243] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.875404  7088 raft_consensus.cc:2272] T 570d47d923e646698c8d1cb50881806a P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.878042  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.883188  7088 raft_consensus.cc:2243] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.884140  7088 raft_consensus.cc:2272] T 52ea8762178341d5a08d0758292d2a50 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.887213  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.888032  7088 raft_consensus.cc:2243] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.888584  7088 raft_consensus.cc:2272] T be6cb9bb386e4e21b297137851efdc10 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.891858 13719 raft_consensus.cc:3060] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.892256  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.893093  7088 raft_consensus.cc:2243] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.893571  7088 raft_consensus.cc:2272] T d44b221b69f84c5b92e7df2779fa16dc P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.892194 13724 raft_consensus.cc:3060] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:25.896346  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.897109  7088 raft_consensus.cc:2243] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.897558  7088 raft_consensus.cc:2272] T 94cfd7b05f864022974fc28bfacd9c0d P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.899200 13792 raft_consensus.cc:1275] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:25.900808  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.901665  7088 raft_consensus.cc:2243] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.902864 14835 consensus_queue.cc:1048] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:04:25.902261  7088 raft_consensus.cc:2272] T bc89eeba61904cf58fc52c2ef8809a70 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.911051  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.911790  7088 raft_consensus.cc:2243] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.912822  7088 raft_consensus.cc:2272] T 5e95a37a01c349a08590fc8b4e1a355a P 816d755a8270492d88dac41d1d303c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.915764  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.916482  7088 raft_consensus.cc:2243] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.916998  7088 raft_consensus.cc:2272] T d381a014c4f543909a33453b71bff652 P 816d755a8270492d88dac41d1d303c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.904639 13719 raft_consensus.cc:1275] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.928509 14796 consensus_queue.cc:1048] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:25.931211  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.932349  7088 raft_consensus.cc:2243] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.932931  7088 raft_consensus.cc:2272] T 60c9f55bf0434c59813efb44039ba4ae P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.905978 13724 raft_consensus.cc:1275] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:25.947080 14796 consensus_queue.cc:1048] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:25.953594  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.954761  7088 raft_consensus.cc:2243] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.955883  7088 raft_consensus.cc:2272] T bceb1a953ae04c22a73b2911d54d6b10 P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.972852 13795 raft_consensus.cc:1275] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.973354  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.974152  7088 raft_consensus.cc:2243] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.975111  7088 raft_consensus.cc:2272] T 2a9d6a51fea243bf921646c100c91f8b P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.981809 14792 consensus_queue.cc:1048] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:25.984364  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:25.985108  7088 raft_consensus.cc:2243] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.985611  7088 raft_consensus.cc:2272] T 399df00a17e541e98fae8d4664b4566c P 816d755a8270492d88dac41d1d303c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.215487 14825 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:26.216037 14825 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.218102 14825 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:26.219403 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:26.219852 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:26.220245 13719 raft_consensus.cc:2393] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 2: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:04:26.220530 13646 raft_consensus.cc:2468] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:26.222975 13766 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:26.224036 14825 raft_consensus.cc:2804] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:26.224428 14825 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:26.224766 14825 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.238754 14825 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.241412 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:26.241714 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:26.242624 13719 raft_consensus.cc:2393] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 2: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:04:26.243911 14825 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:26.248265 13646 raft_consensus.cc:2468] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:26.249486 13766 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:26.250577 14825 raft_consensus.cc:2804] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.251055 14825 raft_consensus.cc:697] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:26.251842 14825 consensus_queue.cc:237] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.273077 13475 catalog_manager.cc:5697] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.474291 14792 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:26.475003 14792 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.483050 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.483850 13792 raft_consensus.cc:2393] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 2: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:04:26.491293 14828 raft_consensus.cc:493] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:26.491945 14828 raft_consensus.cc:515] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.495908 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:26.496634 13646 raft_consensus.cc:2393] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 2: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:04:26.496901 14792 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.497954 14835 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:26.502605 14835 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.494058 14828 leader_election.cc:290] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.498903 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.504410 13792 raft_consensus.cc:2468] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:26.505973 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:26.508071 13719 raft_consensus.cc:2468] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:26.509313 13691 leader_election.cc:304] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: e3683af201ac41948aaa81cea02de029
I20260709 13:04:26.509639 13616 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.511276 14792 raft_consensus.cc:2804] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:26.511680 14792 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:26.512060 14792 raft_consensus.cc:3060] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.510187 14835 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.521252 14792 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.510200 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:26.525532 13719 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:26.527848 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.528654 13795 raft_consensus.cc:2393] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 3: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:04:26.529285 14792 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.531200 14839 raft_consensus.cc:2804] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:26.531569 14839 raft_consensus.cc:493] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:26.531926 14839 raft_consensus.cc:3060] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.544348 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:26.545260 13792 raft_consensus.cc:2393] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 2: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:04:26.547626 13616 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.549331 14796 raft_consensus.cc:2804] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:26.549696 14796 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:26.550028 14796 raft_consensus.cc:3060] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.555490 14828 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.556023 14828 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.556253 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe49ba6d20a41ebbd9b9b9f8b8f083a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:26.558722 14828 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.560137 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.563246 14839 raft_consensus.cc:515] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.565291 14839 leader_election.cc:290] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.566557 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:26.568121 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:26.568779 13647 raft_consensus.cc:2468] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:26.572804 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1234620eb0424eb5ab654a8bb1dac9" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:26.573508 13646 raft_consensus.cc:2393] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 2: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:04:26.577297 14796 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.580379 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:26.581103 13795 raft_consensus.cc:2393] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 3: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:04:26.583187 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:26.584277 13719 raft_consensus.cc:2468] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:26.586297 13792 raft_consensus.cc:2468] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:26.588263 13691 leader_election.cc:304] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:26.590246 14887 raft_consensus.cc:2804] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.590790 14887 raft_consensus.cc:697] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
I20260709 13:04:26.592410 14810 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:26.592942 14810 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.593379 13720 raft_consensus.cc:2468] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:26.595065 14810 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:26.591586 14887 consensus_queue.cc:237] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.599347 13616 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.600589 14796 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.601172 14828 raft_consensus.cc:493] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.601673 14828 raft_consensus.cc:515] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:26.603837 14828 leader_election.cc:290] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:26.613935 13616 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.616046 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:26.616806 14792 raft_consensus.cc:2804] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.617463 14792 raft_consensus.cc:697] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:26.617579 13719 raft_consensus.cc:2393] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 2: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:04:26.618314 14792 consensus_queue.cc:237] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.616691 13692 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.619848 14835 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:26.621201 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:26.623876 13646 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:26.624886 13766 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
W20260709 13:04:26.625524 13693 leader_election.cc:336] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:26.621500 14790 raft_consensus.cc:2804] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:26.628213 14825 raft_consensus.cc:2804] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:26.626605 14887 raft_consensus.cc:2804] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:26.628616 14825 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:26.628964 14887 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.629562 14887 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.629819 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:26.627606 14835 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.633338 14835 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.629120 14825 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.641868 14796 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.644091 13475 catalog_manager.cc:5697] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 1 to 2, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.647847 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:26.649423 13720 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:26.649577 14790 raft_consensus.cc:697] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:26.657958 14790 consensus_queue.cc:237] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
W20260709 13:04:26.660645 13619 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111) [suppressed 187 similar messages]
I20260709 13:04:26.642745 13692 leader_election.cc:304] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:26.654373 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.662885 14839 raft_consensus.cc:2749] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:26.663200 13792 raft_consensus.cc:2393] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 3: Already voted for candidate da3d66493d2f419fb8eda6491ce13df0 in this term.
I20260709 13:04:26.665652 13616 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.667043 14890 raft_consensus.cc:2804] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:26.667543 14890 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3a9103ce8543f5aae6be46c1f76bd8)
I20260709 13:04:26.667891 14890 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.649302 14796 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:26.674743 13475 catalog_manager.cc:5697] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 1 to 2, leader changed from fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.683095 14796 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:26.688102 13619 leader_election.cc:336] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:26.688841 13693 consensus_peers.cc:597] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:26.692094 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.692938 14835 raft_consensus.cc:493] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.693471 14835 raft_consensus.cc:515] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:26.693773 13617 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.695062 14810 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.695497 14835 leader_election.cc:290] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:26.695621 14810 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.698472 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:26.698670 14810 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:26.703169 14890 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.700250 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:26.704582 13720 raft_consensus.cc:2468] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:26.704670 13647 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:26.678172 14825 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.701300 13646 raft_consensus.cc:1275] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.707083 14833 consensus_queue.cc:1048] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.708429 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:26.709101 13720 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:26.709345 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:26.709708 13766 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:26.710541 14833 raft_consensus.cc:2804] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:26.710919 14833 raft_consensus.cc:493] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.710245 13475 catalog_manager.cc:5697] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 2 to 3, leader changed from fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.699733 14887 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.694959 14796 raft_consensus.cc:2749] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:26.711257 14833 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:26.713994 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:26.720206 14887 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.724689 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:26.732592 13647 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:26.733932 13766 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:26.737583 14796 raft_consensus.cc:493] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.738268 14796 raft_consensus.cc:515] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:26.740917 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.741544 13795 raft_consensus.cc:2468] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:26.743281 14825 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 2 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:26.743806 14825 raft_consensus.cc:2804] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.744234 14825 raft_consensus.cc:697] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:26.745059 14825 consensus_queue.cc:237] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.748368 14833 raft_consensus.cc:515] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.750852 13616 leader_election.cc:304] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:26.751909 13792 raft_consensus.cc:2368] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 for earlier term 3. Current term is 4.
I20260709 13:04:26.752118 14890 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.752403 14792 raft_consensus.cc:2804] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:26.752789 14792 raft_consensus.cc:493] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.753122 14792 raft_consensus.cc:3060] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:26.765116 13619 leader_election.cc:336] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:26.766721 14891 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.767274 14891 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:26.768102 13617 leader_election.cc:304] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:26.769161 13617 leader_election.cc:400] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Vote denied by peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577) with higher term. Message: Invalid argument: T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 for earlier term 3. Current term is 4.
I20260709 13:04:26.769431 13617 leader_election.cc:403] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:04:26.769358 14891 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:26.770568 14891 raft_consensus.cc:2804] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:26.770893 14891 raft_consensus.cc:493] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.771234 14891 raft_consensus.cc:3060] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.771924 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.776520 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:26.777124 13647 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:26.771377 14796 leader_election.cc:290] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:26.786505 13647 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 4.
I20260709 13:04:26.787156 14835 raft_consensus.cc:2749] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577) with higher term. Message: Invalid argument: T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 for earlier term 3. Current term is 4.
I20260709 13:04:26.788146 14891 raft_consensus.cc:515] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:26.790527 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:26.791344 13720 raft_consensus.cc:2393] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da3d66493d2f419fb8eda6491ce13df0 in current term 2: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:04:26.795620 13720 raft_consensus.cc:1240] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Rejecting Update request from peer da3d66493d2f419fb8eda6491ce13df0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:26.797791 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:26.804404 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f715bd53db44c9897c1bc9af541e5c" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:26.804659 14891 leader_election.cc:290] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:26.805709 13792 raft_consensus.cc:3060] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.811725 13720 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:26.813169 13766 leader_election.cc:304] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:26.793622 14792 raft_consensus.cc:515] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:26.844213 14896 consensus_queue.cc:1059] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:26.844841 13766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 54999.8us
I20260709 13:04:26.845129 14896 raft_consensus.cc:2804] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:26.814815 14833 leader_election.cc:290] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:26.840417 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:26.846942 14792 leader_election.cc:290] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
W20260709 13:04:26.841140 13619 leader_election.cc:336] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:26.845662 14896 raft_consensus.cc:697] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 4 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:26.845341 14899 raft_consensus.cc:3055] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:26.849634 14899 raft_consensus.cc:740] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:26.850133 14896 consensus_queue.cc:237] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.850550 14899 consensus_queue.cc:260] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.851778 14887 raft_consensus.cc:493] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.851971 14899 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.852314 14887 raft_consensus.cc:515] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:26.854888 14887 leader_election.cc:290] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:26.855064 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.857818 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae6ae2455024cde872a6cce314120f9" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:26.858408 13720 raft_consensus.cc:3060] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:26.863874 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c0045f00654855a3d672f639e01b17" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:26.864523 13724 raft_consensus.cc:3060] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.849241 13792 raft_consensus.cc:2468] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:26.866160 13617 leader_election.cc:304] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:26.867003 14900 raft_consensus.cc:2804] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:26.868134 14900 raft_consensus.cc:697] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:26.870126 14900 consensus_queue.cc:237] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:26.870967 13724 raft_consensus.cc:2468] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:26.873492 13616 leader_election.cc:304] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:26.849547 13619 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.874509 14792 raft_consensus.cc:2804] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:26.875226 14792 raft_consensus.cc:697] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:26.876129 14792 consensus_queue.cc:237] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:26.878027 13693 leader_election.cc:336] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:26.878702 13693 leader_election.cc:304] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.879465 14887 raft_consensus.cc:2749] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:26.879585 14891 raft_consensus.cc:2749] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:26.880486 13619 leader_election.cc:336] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:26.882330 13475 catalog_manager.cc:5697] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 1 to 2, leader changed from e3683af201ac41948aaa81cea02de029 (127.6.236.2) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 2 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.904138 13720 raft_consensus.cc:2468] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 4.
I20260709 13:04:26.908071 13475 catalog_manager.cc:5697] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 4, leader changed from fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 4 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.913584 13476 catalog_manager.cc:5697] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.904371 13692 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029
W20260709 13:04:26.905583 13619 leader_election.cc:336] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:26.920405 13619 consensus_peers.cc:597] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:26.925758 14839 raft_consensus.cc:2749] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:04:26.930751 13619 leader_election.cc:336] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:26.931568 13619 consensus_peers.cc:597] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:26.942646 14828 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:26.943249 14828 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:26.943377 13476 catalog_manager.cc:5697] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.945298 14828 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:26.946717 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:26.947356 13693 consensus_peers.cc:597] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:26.947824 13693 consensus_peers.cc:597] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:26.950127 13693 leader_election.cc:336] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:26.950537 13693 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.951198 14828 raft_consensus.cc:2749] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:26.962504 14828 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.963002 14828 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.966248 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:26.966827 13646 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 2.
I20260709 13:04:26.967839 14828 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.968050 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:26.968936 13692 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
W20260709 13:04:26.969632 13619 consensus_peers.cc:597] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:26.971010 14887 raft_consensus.cc:2804] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:26.971414 14887 raft_consensus.cc:493] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.971733 14887 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.980288 14887 raft_consensus.cc:515] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:26.983264 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:26.983392 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe580baf6e25431f8421912ec7fcc66f" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:26.983989 13646 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.984856 14887 leader_election.cc:290] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 election: Requested vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:26.991089 13646 raft_consensus.cc:2468] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in term 3.
I20260709 13:04:26.993114 13692 leader_election.cc:304] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:26.994257 14887 raft_consensus.cc:2804] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:26.995649 14887 raft_consensus.cc:697] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 LEADER]: Becoming Leader. State: Replica: fd3a9103ce8543f5aae6be46c1f76bd8, State: Running, Role: LEADER
W20260709 13:04:26.998713 13693 consensus_peers.cc:597] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:26.998517 14887 consensus_queue.cc:237] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:27.008319 14828 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.008917 14828 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.011065 13476 catalog_manager.cc:5697] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 reported cstate change: term changed from 2 to 3, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:27.012571 13693 consensus_peers.cc:597] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.015569 13693 leader_election.cc:336] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.017278 13792 raft_consensus.cc:1275] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:27.019207 14828 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:27.020490 14828 consensus_queue.cc:1048] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.019842 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:27.022706 13692 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:27.024029 14887 raft_consensus.cc:2749] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:27.042449 13720 raft_consensus.cc:1275] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.047943 14825 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.048616 14825 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.050698 14825 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.048122 13646 raft_consensus.cc:1275] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:27.057737 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.058459 13720 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:27.058302 14887 consensus_queue.cc:1048] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.061276 13764 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:27.061968 14792 consensus_queue.cc:1048] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:27.064721 13767 leader_election.cc:336] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.062058 14896 raft_consensus.cc:2804] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:27.066203 14896 raft_consensus.cc:493] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.066615 14896 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.075565 14825 raft_consensus.cc:493] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.076669 14825 raft_consensus.cc:515] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.079995 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.080734 13719 raft_consensus.cc:2468] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:27.075567 14900 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.082458 13764 leader_election.cc:304] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:27.083333 14899 raft_consensus.cc:2804] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:27.083726 14899 raft_consensus.cc:493] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.084057 14899 raft_consensus.cc:3060] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.086532 14900 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:27.092973 14900 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.094367 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
W20260709 13:04:27.097462 13693 consensus_peers.cc:597] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.098599 13720 raft_consensus.cc:1275] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:27.099596 13619 leader_election.cc:336] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.100039 13619 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:27.100507 14792 consensus_queue.cc:1048] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.101958 14891 raft_consensus.cc:2749] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:27.105577 14833 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.106251 14833 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.106289 14835 raft_consensus.cc:493] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.107326 14835 raft_consensus.cc:515] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:27.108493 13693 consensus_peers.cc:597] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.109309 14833 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.113003 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.113963 13719 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:27.115892 13764 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:27.117177 14833 raft_consensus.cc:2804] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:27.117660 14833 raft_consensus.cc:493] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.118096 14833 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:27.118306 13693 consensus_peers.cc:597] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.121867 14887 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.122592 14887 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.126168 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:27.126842 14887 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:27.131448 13767 leader_election.cc:336] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.132052 14887 raft_consensus.cc:493] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
W20260709 13:04:27.133759  7088 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14549)
I20260709 13:04:27.133486 14887 raft_consensus.cc:515] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.140019 14835 leader_election.cc:290] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:27.100936 14825 leader_election.cc:290] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:27.146628 13619 consensus_peers.cc:597] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.147289 13619 leader_election.cc:336] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.154182 14896 raft_consensus.cc:515] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.157226 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6632785442492484d7bd8e03442d29" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:27.157991 13719 raft_consensus.cc:3060] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.154933 13792 raft_consensus.cc:1275] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:27.161410 14897 raft_consensus.cc:493] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.164103 14897 raft_consensus.cc:515] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:27.166548 14897 leader_election.cc:290] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:27.167794 14796 consensus_queue.cc:1048] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:27.169730 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:27.170889 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46592c7f545042849b442d72dcc3979f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.174644 14839 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.175158 14839 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.177446 14839 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.178145 13795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:27.180644 14796 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.181372 14796 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.182533 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.183187 13724 raft_consensus.cc:2468] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:27.184409 14796 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:27.186021 13764 leader_election.cc:304] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:27.186504 13795 raft_consensus.cc:1275] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.188059 14897 raft_consensus.cc:2749] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:27.196408 14839 raft_consensus.cc:493] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.197026 14839 raft_consensus.cc:515] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.199223 14839 leader_election.cc:290] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:27.202142 13619 leader_election.cc:336] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.204447 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.205546 13724 raft_consensus.cc:2468] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:27.207240 13616 leader_election.cc:304] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.210970 14796 consensus_queue.cc:1048] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:27.211016 14891 raft_consensus.cc:2804] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:27.211890 14891 raft_consensus.cc:493] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.212309 14891 raft_consensus.cc:3060] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.208838 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
W20260709 13:04:27.207899 13767 leader_election.cc:336] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:27.206888 13693 leader_election.cc:336] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.217555 13693 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
W20260709 13:04:27.220983 13767 consensus_peers.cc:597] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.222158 14891 raft_consensus.cc:515] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.256132 14891 leader_election.cc:290] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:27.193840 14899 raft_consensus.cc:515] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.234112 14839 raft_consensus.cc:2749] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:27.259372 14899 leader_election.cc:290] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.260845 14810 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.261670 14810 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.264101 14810 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.264015 14825 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.264932 14825 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:27.265313 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35763cd4283147759ec2c744a06238e3" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:27.265852 13724 raft_consensus.cc:3060] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.267360 14825 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:27.268812 13719 raft_consensus.cc:2468] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 4.
I20260709 13:04:27.235755 14833 raft_consensus.cc:515] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:27.237588 13619 consensus_peers.cc:597] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.274117 13724 raft_consensus.cc:2468] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:27.242739 13616 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.243396 14887 leader_election.cc:290] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:27.244226 13693 consensus_peers.cc:597] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.276073 13693 leader_election.cc:336] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.276504 13693 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, da3d66493d2f419fb8eda6491ce13df0
I20260709 13:04:27.264272 14896 leader_election.cc:290] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.278590 14891 raft_consensus.cc:2804] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:27.279390 14839 raft_consensus.cc:2749] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:27.279070 14891 raft_consensus.cc:493] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.279780 13653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:27.280494 13653 raft_consensus.cc:2468] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:27.279979 14891 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:27.281910 13619 consensus_peers.cc:597] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.282819 13619 consensus_peers.cc:597] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.279330 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:27.285183 13766 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:27.285957 14896 raft_consensus.cc:2804] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:27.286451 14896 raft_consensus.cc:493] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
W20260709 13:04:27.287487 13693 leader_election.cc:336] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.287951 13693 leader_election.cc:304] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
I20260709 13:04:27.288909 13720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb2600ae8d741429738e3887b811cef" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:27.286818 14896 raft_consensus.cc:3060] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:27.250329 13767 leader_election.cc:336] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.292634 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.295066 14839 raft_consensus.cc:2749] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:27.289582 13619 consensus_peers.cc:597] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.285470 13647 raft_consensus.cc:2393] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3a9103ce8543f5aae6be46c1f76bd8 in current term 3: Already voted for candidate e3683af201ac41948aaa81cea02de029 in this term.
I20260709 13:04:27.272908 14833 leader_election.cc:290] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.289637 13720 raft_consensus.cc:3060] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.295312 13724 raft_consensus.cc:2468] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:27.300761 14792 raft_consensus.cc:493] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.337450 14896 raft_consensus.cc:515] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
W20260709 13:04:27.340610 13619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 51069.1us
W20260709 13:04:27.341091 13619 leader_election.cc:336] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.343642 13647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceb1a953ae04c22a73b2911d54d6b10" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:27.344303 13647 raft_consensus.cc:3060] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.344779 14891 raft_consensus.cc:515] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.297976 13721 raft_consensus.cc:1275] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.345470 14896 leader_election.cc:290] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:27.300477 13693 leader_election.cc:336] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.327036 13649 raft_consensus.cc:1240] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Rejecting Update request from peer da3d66493d2f419fb8eda6491ce13df0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:27.349468 13767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 54560.8us
I20260709 13:04:27.349882 13692 leader_election.cc:304] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68, e3683af201ac41948aaa81cea02de029
W20260709 13:04:27.352623 13693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 52186.9us
I20260709 13:04:27.316964 13653 raft_consensus.cc:1275] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:27.354704 14796 consensus_queue.cc:1048] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.357467 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d98df69890142c4894e28b58aefd8d8" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
W20260709 13:04:27.357865 13619 consensus_peers.cc:597] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.339500 14792 raft_consensus.cc:515] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.363916 14792 leader_election.cc:290] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:27.347818 13764 leader_election.cc:304] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.365487 13647 raft_consensus.cc:2468] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:27.367372 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95a37a01c349a08590fc8b4e1a355a" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:27.365674 14896 raft_consensus.cc:2804] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:27.368146 14896 raft_consensus.cc:697] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 4 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.368630 13724 raft_consensus.cc:3060] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.366390 14899 consensus_queue.cc:1048] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.369194 13766 leader_election.cc:304] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:27.369488 14896 consensus_queue.cc:237] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.366755 13721 raft_consensus.cc:3060] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:27.366091 13619 leader_election.cc:336] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.366482 14833 consensus_queue.cc:1059] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:04:27.369957 14825 raft_consensus.cc:2804] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.375169 14825 raft_consensus.cc:697] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.375366 14899 raft_consensus.cc:3055] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:27.365522 13764 leader_election.cc:304] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:27.375751 14899 raft_consensus.cc:740] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.376595 14810 raft_consensus.cc:2804] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.376452 14825 consensus_queue.cc:237] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:27.377141 14810 raft_consensus.cc:697] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.378007 14810 consensus_queue.cc:237] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.376645 14899 consensus_queue.cc:260] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:27.382638 14899 raft_consensus.cc:3060] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.383090 14833 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.383735 14833 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.388264 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.388947 13718 raft_consensus.cc:2468] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 2.
I20260709 13:04:27.389746 14897 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.390303 14897 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:27.391599 14891 leader_election.cc:290] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:27.392310 14897 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:27.393985 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:27.394421 13616 leader_election.cc:304] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:27.395013 13649 raft_consensus.cc:2468] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:27.394403 13764 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 
I20260709 13:04:27.395941 14897 raft_consensus.cc:2804] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:27.396380 14897 raft_consensus.cc:493] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.395397 14891 raft_consensus.cc:2804] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:27.396950 13766 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:27.397414 14891 raft_consensus.cc:493] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.397915 14895 raft_consensus.cc:2804] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:27.398355 14895 raft_consensus.cc:493] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.398694 14895 raft_consensus.cc:3060] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.397794 14891 raft_consensus.cc:3060] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.400152 14897 raft_consensus.cc:3060] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.401266 14833 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:27.402294 13767 leader_election.cc:336] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:27.409688 13767 leader_election.cc:336] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:27.413141 13767 leader_election.cc:336] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:27.415987 13767 leader_election.cc:336] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.416836 13792 raft_consensus.cc:1275] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.426748 13646 raft_consensus.cc:1275] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:04:27.432711 13767 consensus_peers.cc:597] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.435433 13767 leader_election.cc:336] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.437207 13718 raft_consensus.cc:1275] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:27.437651 14839 consensus_queue.cc:1048] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.440203 13724 raft_consensus.cc:2468] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 4.
W20260709 13:04:27.440263 13619 leader_election.cc:336] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.442374 13616 leader_election.cc:304] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
W20260709 13:04:27.442785 13619 consensus_peers.cc:597] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.442660 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:27.443446 13724 raft_consensus.cc:2468] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
W20260709 13:04:27.446956 13767 consensus_peers.cc:597] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.447546 13767 leader_election.cc:336] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:27.448226 13767 consensus_peers.cc:597] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.448635 13767 leader_election.cc:336] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.450955 14796 raft_consensus.cc:2804] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:27.451454 14796 raft_consensus.cc:697] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 4 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:27.470999 14835 consensus_queue.cc:1048] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:27.452299 14796 consensus_queue.cc:237] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.492014 13721 raft_consensus.cc:2468] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 4.
I20260709 13:04:27.502611 13475 catalog_manager.cc:5697] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 3 to 4, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 4 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.469205 13720 raft_consensus.cc:2468] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:27.508760 14887 raft_consensus.cc:2749] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:27.539239 14891 raft_consensus.cc:515] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
W20260709 13:04:27.542382 13767 consensus_peers.cc:597] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.556565 13616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:45411, user_credentials={real_user=slave}} blocked reactor thread for 52281.1us
W20260709 13:04:27.563733 13619 consensus_peers.cc:597] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:27.566627 13767 consensus_peers.cc:597] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.567073 13767 consensus_peers.cc:597] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.566774 13616 leader_election.cc:304] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.578437 14921 raft_consensus.cc:2804] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.578990 14921 raft_consensus.cc:697] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:27.581329 14921 consensus_queue.cc:237] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.558184 14895 raft_consensus.cc:515] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:27.568337 14899 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
W20260709 13:04:27.589326 13767 consensus_peers.cc:597] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.581032 14897 raft_consensus.cc:515] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
W20260709 13:04:27.591661 13693 consensus_peers.cc:597] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.592353 14897 leader_election.cc:290] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
I20260709 13:04:27.589767 14899 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
W20260709 13:04:27.594147 13767 leader_election.cc:336] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.594651 14899 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:27.602345 13619 consensus_peers.cc:597] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.603355 13619 leader_election.cc:336] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
W20260709 13:04:27.606107 13767 leader_election.cc:336] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.606792 14891 leader_election.cc:290] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:27.589558 14895 leader_election.cc:290] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
W20260709 13:04:27.608891 13619 consensus_peers.cc:597] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:27.609815 13767 leader_election.cc:336] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.619481 13800 raft_consensus.cc:1275] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Refusing update from remote peer fd3a9103ce8543f5aae6be46c1f76bd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:04:27.619905 13800 pending_rounds.cc:85] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0: Aborting all ops after (but not including) 1
I20260709 13:04:27.620098 13800 pending_rounds.cc:107] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:04:27.620332 13800 raft_consensus.cc:2889] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:27.627674 13473 catalog_manager.cc:5697] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.629040 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570d47d923e646698c8d1cb50881806a" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:27.629784 13721 raft_consensus.cc:3060] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.634187 14839 consensus_queue.cc:1048] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:27.637897 13721 raft_consensus.cc:2468] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:27.642877 13473 catalog_manager.cc:5697] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.625468 13475 catalog_manager.cc:5697] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 3 to 4, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 4 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.638772 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9d6a51fea243bf921646c100c91f8b" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:27.653405 13718 raft_consensus.cc:3060] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.658366 14895 consensus_queue.cc:1048] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.659471 13764 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.660209 14895 raft_consensus.cc:2804] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:27.660565 14895 raft_consensus.cc:493] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.660905 14895 raft_consensus.cc:3060] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.662180 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029" is_pre_election: true
I20260709 13:04:27.662813 13649 raft_consensus.cc:2468] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 2.
I20260709 13:04:27.664017 13764 leader_election.cc:304] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.666497 14899 raft_consensus.cc:2804] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:27.666986 14899 raft_consensus.cc:697] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 4 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.667788 14899 consensus_queue.cc:237] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.671772 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ba941f0f3547dab9f990d24133749f" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:27.672441 13646 raft_consensus.cc:3060] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.676630 14895 raft_consensus.cc:515] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.678756 14895 leader_election.cc:290] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147)
W20260709 13:04:27.684033 13767 leader_election.cc:336] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.685288 13764 leader_election.cc:304] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.685876 13766 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.687666 14810 raft_consensus.cc:2804] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.688297 14810 raft_consensus.cc:697] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.691263 14899 raft_consensus.cc:2804] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:27.691880 14899 raft_consensus.cc:493] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 816d755a8270492d88dac41d1d303c68)
I20260709 13:04:27.692226 14899 raft_consensus.cc:3060] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.689291 14810 consensus_queue.cc:237] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.693121 13646 raft_consensus.cc:2468] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
W20260709 13:04:27.695037 13619 consensus_peers.cc:597] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:27.699888 14899 raft_consensus.cc:515] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:27.701980 13766 leader_election.cc:304] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.703522 14895 raft_consensus.cc:2804] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.704190 14895 raft_consensus.cc:697] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.705258 14895 consensus_queue.cc:237] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
W20260709 13:04:27.705879 13767 leader_election.cc:336] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111)
I20260709 13:04:27.707520 13718 raft_consensus.cc:2468] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:27.710781 13646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7303d87314c5440cbf299237115d818c" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3683af201ac41948aaa81cea02de029"
I20260709 13:04:27.711701 13646 raft_consensus.cc:3060] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.702005 14899 leader_election.cc:290] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Requested vote from peers 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147), e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455)
I20260709 13:04:27.715327 13616 leader_election.cc:304] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.721597 14921 raft_consensus.cc:2804] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.722116 14921 raft_consensus.cc:697] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:27.722929 14921 consensus_queue.cc:237] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } }
I20260709 13:04:27.733047 13721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea8762178341d5a08d0758292d2a50" candidate_uuid: "da3d66493d2f419fb8eda6491ce13df0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:27.733646 13721 raft_consensus.cc:3060] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.733459 13476 catalog_manager.cc:5697] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 3 to 4, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 4 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.739584 13646 raft_consensus.cc:2468] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:27.743291 13721 raft_consensus.cc:2468] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3d66493d2f419fb8eda6491ce13df0 in term 3.
I20260709 13:04:27.735059 13476 catalog_manager.cc:5697] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.763862 13475 catalog_manager.cc:5697] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.778517 13766 leader_election.cc:304] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.784893 14810 raft_consensus.cc:2804] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.778103 13764 leader_election.cc:304] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, fd3a9103ce8543f5aae6be46c1f76bd8; no voters: 816d755a8270492d88dac41d1d303c68
I20260709 13:04:27.785354 14810 raft_consensus.cc:697] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.786113 14833 raft_consensus.cc:2804] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.786692 14833 raft_consensus.cc:697] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Becoming Leader. State: Replica: da3d66493d2f419fb8eda6491ce13df0, State: Running, Role: LEADER
I20260709 13:04:27.786250 14810 consensus_queue.cc:237] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } }
I20260709 13:04:27.787525 14833 consensus_queue.cc:237] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } }
I20260709 13:04:27.825982 13475 catalog_manager.cc:5697] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.839143 13473 catalog_manager.cc:5697] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.840703 13473 catalog_manager.cc:5697] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.842435 13473 catalog_manager.cc:5697] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 reported cstate change: term changed from 2 to 3, leader changed from 816d755a8270492d88dac41d1d303c68 (127.6.236.1) to da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4). New cstate: current_term: 3 leader_uuid: "da3d66493d2f419fb8eda6491ce13df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816d755a8270492d88dac41d1d303c68" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:27.853380 13767 consensus_peers.cc:597] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.863420 13721 raft_consensus.cc:1275] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:27.873102 14895 consensus_queue.cc:1048] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:27.877194 13721 raft_consensus.cc:1275] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.886142 14833 consensus_queue.cc:1048] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.925608 13646 raft_consensus.cc:1275] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.927175 14899 consensus_queue.cc:1048] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:27.978529 13619 consensus_peers.cc:597] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:27.980834 13767 consensus_peers.cc:597] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:27.998353 13767 consensus_peers.cc:597] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:28.014575 13767 consensus_peers.cc:597] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:28.072868 13718 raft_consensus.cc:1275] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.077171 14921 consensus_queue.cc:1048] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.091121 13721 raft_consensus.cc:1275] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:28.093393 14891 consensus_queue.cc:1048] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:28.096807 13767 consensus_peers.cc:597] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.107014 13719 raft_consensus.cc:1275] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.108469 14810 consensus_queue.cc:1048] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:28.123035 13619 consensus_peers.cc:597] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:28.134225  7088 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 14549)
I20260709 13:04:28.172161 13646 raft_consensus.cc:1275] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.174005 14895 consensus_queue.cc:1048] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.184345 13719 raft_consensus.cc:1275] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:28.190147 14897 consensus_queue.cc:1048] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:28.209239 13767 consensus_peers.cc:597] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.218432 13653 raft_consensus.cc:1275] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.220557 14833 consensus_queue.cc:1048] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:28.240818 13767 consensus_peers.cc:597] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:28.259593 13767 consensus_peers.cc:597] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:28.273523 13767 consensus_peers.cc:597] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.285351 14796 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:28.285952 14796 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:28.288105 14796 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:28.289677 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0" is_pre_election: true
I20260709 13:04:28.290413 13792 raft_consensus.cc:2468] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:28.291720 13617 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:28.292567 14930 raft_consensus.cc:2804] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:28.292922 14930 raft_consensus.cc:493] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da3d66493d2f419fb8eda6491ce13df0)
I20260709 13:04:28.293241 14930 raft_consensus.cc:3060] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.290328 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" is_pre_election: true
I20260709 13:04:28.295151 13718 raft_consensus.cc:2393] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 3: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
W20260709 13:04:28.306555 13619 consensus_peers.cc:597] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.305080 14930 raft_consensus.cc:515] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:28.314385 14930 leader_election.cc:290] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Requested vote from peers fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411), da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4:45577)
I20260709 13:04:28.317219 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8"
I20260709 13:04:28.318424 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e36c72e3a2641ba9cfeeedc71e853e6" candidate_uuid: "e3683af201ac41948aaa81cea02de029" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da3d66493d2f419fb8eda6491ce13df0"
I20260709 13:04:28.319172 13718 raft_consensus.cc:2393] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3683af201ac41948aaa81cea02de029 in current term 3: Already voted for candidate fd3a9103ce8543f5aae6be46c1f76bd8 in this term.
I20260709 13:04:28.328204 13792 raft_consensus.cc:2468] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3683af201ac41948aaa81cea02de029 in term 3.
I20260709 13:04:28.386184 13617 leader_election.cc:304] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0, e3683af201ac41948aaa81cea02de029; no voters: 
I20260709 13:04:28.387055 14921 raft_consensus.cc:2804] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:28.387537 14921 raft_consensus.cc:697] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Becoming Leader. State: Replica: e3683af201ac41948aaa81cea02de029, State: Running, Role: LEADER
I20260709 13:04:28.388312 14921 consensus_queue.cc:237] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:28.405112 13719 raft_consensus.cc:1275] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.404554 13475 catalog_manager.cc:5697] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 reported cstate change: term changed from 2 to 3, leader changed from da3d66493d2f419fb8eda6491ce13df0 (127.6.236.4) to e3683af201ac41948aaa81cea02de029 (127.6.236.2). New cstate: current_term: 3 leader_uuid: "e3683af201ac41948aaa81cea02de029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:28.405400 13617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.4:45577, user_credentials={real_user=slave}} blocked reactor thread for 72269.3us
I20260709 13:04:28.410844 14930 consensus_queue.cc:1048] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:04:28.424193 13719 raft_consensus.cc:1275] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer da3d66493d2f419fb8eda6491ce13df0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:04:28.436424 13619 consensus_peers.cc:597] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:28.439900 14810 consensus_queue.cc:1048] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.855374 13792 raft_consensus.cc:1275] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.857962 14921 consensus_queue.cc:1048] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.891897 13721 raft_consensus.cc:1275] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Refusing update from remote peer e3683af201ac41948aaa81cea02de029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.901448 14792 consensus_queue.cc:1048] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:29.044705 13693 consensus_peers.cc:597] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.134789  7088 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 14549)
W20260709 13:04:29.372615 13619 consensus_peers.cc:597] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.517704 13693 consensus_peers.cc:597] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.535295 13619 consensus_peers.cc:597] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.546594 13693 consensus_peers.cc:597] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.548805 13619 consensus_peers.cc:597] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.567765 13693 consensus_peers.cc:597] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.597165 13767 consensus_peers.cc:597] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.614218 13693 consensus_peers.cc:597] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.676834 13619 consensus_peers.cc:597] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.724687 13693 consensus_peers.cc:597] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.749402 13693 consensus_peers.cc:597] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.757699 13619 consensus_peers.cc:597] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.771629 13619 consensus_peers.cc:597] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.779775 13767 consensus_peers.cc:597] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.794054 13767 consensus_peers.cc:597] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.825570 13693 consensus_peers.cc:597] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.829290 13767 consensus_peers.cc:597] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.837813 13619 consensus_peers.cc:597] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.850829 13619 consensus_peers.cc:597] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.851307 13619 consensus_peers.cc:597] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.867839 13767 consensus_peers.cc:597] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.947458 13693 consensus_peers.cc:597] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.963757 13767 consensus_peers.cc:597] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.967465 13619 consensus_peers.cc:597] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:29.978008 13619 consensus_peers.cc:597] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.020344 13619 consensus_peers.cc:597] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.020761 13767 consensus_peers.cc:597] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:30.048594 13619 consensus_peers.cc:597] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:30.135300  7088 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 14549)
W20260709 13:04:30.219928 13767 consensus_peers.cc:597] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:30.239006 13693 consensus_peers.cc:597] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:30.564972 13619 consensus_peers.cc:597] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:30.578996 13767 consensus_peers.cc:597] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.593935 13767 consensus_peers.cc:597] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.594432 13767 consensus_peers.cc:597] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:30.594836 13767 consensus_peers.cc:597] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.602427 13767 consensus_peers.cc:597] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.608367 13767 consensus_peers.cc:597] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.617659 13619 consensus_peers.cc:597] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.625427 13619 consensus_peers.cc:597] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.656292 13767 consensus_peers.cc:597] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:30.713459 13619 consensus_peers.cc:597] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:31.026549 13767 consensus_peers.cc:597] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:31.064638 13767 consensus_peers.cc:597] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:31.115471 13619 consensus_peers.cc:597] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:31.136351  7088 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 14549)
W20260709 13:04:31.489372 13822 debug-util.cc:398] Leaking SignalData structure 0x7b08001ada60 after lost signal to thread 7091
W20260709 13:04:31.493225 13822 debug-util.cc:398] Leaking SignalData structure 0x7b08002312c0 after lost signal to thread 13510
W20260709 13:04:31.495190 13822 debug-util.cc:398] Leaking SignalData structure 0x7b0800432240 after lost signal to thread 13677
W20260709 13:04:31.497013 13822 debug-util.cc:398] Leaking SignalData structure 0x7b08001bbb40 after lost signal to thread 13751
W20260709 13:04:31.508306 13822 debug-util.cc:398] Leaking SignalData structure 0x7b08002dae60 after lost signal to thread 13825
W20260709 13:04:31.661588 13693 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 13:04:31.822695 13619 consensus_peers.cc:597] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:31.839226 13693 consensus_peers.cc:597] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.066213 13767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:40147, user_credentials={real_user=slave}} blocked reactor thread for 47010.5us
W20260709 13:04:32.080709 13619 consensus_peers.cc:597] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.105651 13693 consensus_peers.cc:597] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.106312 13693 consensus_peers.cc:597] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.110908 13693 consensus_peers.cc:597] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.136879  7088 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 14549)
W20260709 13:04:32.174296 13619 consensus_peers.cc:597] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:32.180210 13767 consensus_peers.cc:597] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.194860 13619 consensus_peers.cc:597] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.232287 13693 consensus_peers.cc:597] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.241284 13693 consensus_peers.cc:597] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.242633 13767 consensus_peers.cc:597] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.285965 13619 consensus_peers.cc:597] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.321310 13619 consensus_peers.cc:597] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.330971 13693 consensus_peers.cc:597] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.332180 13767 consensus_peers.cc:597] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.338161 13693 consensus_peers.cc:597] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.381953 13693 consensus_peers.cc:597] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.382387 13619 consensus_peers.cc:597] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.412307 13619 consensus_peers.cc:597] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.435470 13619 consensus_peers.cc:597] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.441184 13767 consensus_peers.cc:597] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.473065 13619 consensus_peers.cc:597] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:32.510759 13619 consensus_peers.cc:597] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.569020 13767 consensus_peers.cc:597] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.569130 13619 consensus_peers.cc:597] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.669519 13767 consensus_peers.cc:597] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.676522 13619 consensus_peers.cc:597] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.755815 13693 consensus_peers.cc:597] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.785054 13619 consensus_peers.cc:597] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.798187 13767 consensus_peers.cc:597] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:32.899096 13767 consensus_peers.cc:597] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:33.013640 13619 consensus_peers.cc:597] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:33.050325 13619 consensus_peers.cc:597] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:33.137434  7088 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 14549)
W20260709 13:04:33.156091 13767 consensus_peers.cc:597] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:33.211429 13767 consensus_peers.cc:597] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:33.268075 13619 consensus_peers.cc:597] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:33.285339 13767 consensus_peers.cc:597] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:33.286037 13767 consensus_peers.cc:597] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:33.288709 13767 consensus_peers.cc:597] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:33.289906 13767 consensus_peers.cc:597] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:33.383733  7088 tablet_server.cc:196] TabletServer@127.6.236.1:40147 shutdown complete.
W20260709 13:04:33.385968 13767 consensus_peers.cc:597] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:33.501901 13767 consensus_peers.cc:597] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:33.538067  7088 tablet_server.cc:179] TabletServer@127.6.236.2:0 shutting down...
W20260709 13:04:33.561887 13692 consensus_peers.cc:597] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.570503 13766 consensus_peers.cc:597] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.605715  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.607424  7088 tablet_replica.cc:333] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.608469  7088 raft_consensus.cc:2243] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:33.608938 13766 consensus_peers.cc:597] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.609386  7088 raft_consensus.cc:2272] T b764a88e92eb45b59fdd342348e09439 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.612071 13692 consensus_peers.cc:597] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.612892  7088 tablet_replica.cc:333] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.613790  7088 raft_consensus.cc:2243] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.614903  7088 raft_consensus.cc:2272] T 46592c7f545042849b442d72dcc3979f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.617619  7088 tablet_replica.cc:333] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.618414  7088 raft_consensus.cc:2243] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.619457  7088 raft_consensus.cc:2272] T 9dfa4c53a9364ccf8cf7c241664c6538 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.622370  7088 tablet_replica.cc:333] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.623178  7088 raft_consensus.cc:2243] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.624382  7088 raft_consensus.cc:2272] T ebb2600ae8d741429738e3887b811cef P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.627499  7088 tablet_replica.cc:333] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.628446  7088 raft_consensus.cc:2243] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.629614  7088 raft_consensus.cc:2272] T 2a9d6a51fea243bf921646c100c91f8b P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.632913  7088 tablet_replica.cc:333] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029: stopping tablet replica
W20260709 13:04:33.633651 13766 consensus_peers.cc:597] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.633769  7088 raft_consensus.cc:2243] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.634474  7088 raft_consensus.cc:2272] T 84008f69faa047d1b47f08ea114c506a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.637434  7088 tablet_replica.cc:333] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.638343  7088 raft_consensus.cc:2243] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.638864  7088 raft_consensus.cc:2272] T bceb1a953ae04c22a73b2911d54d6b10 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.641762  7088 tablet_replica.cc:333] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.642616  7088 raft_consensus.cc:2243] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.643184  7088 raft_consensus.cc:2272] T 60c9f55bf0434c59813efb44039ba4ae P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.645896  7088 tablet_replica.cc:333] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.646833  7088 raft_consensus.cc:2243] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.647946  7088 raft_consensus.cc:2272] T 79c7c53b44db41d9a56cff5d00be5010 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.650733  7088 tablet_replica.cc:333] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.651546  7088 raft_consensus.cc:2243] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.652110  7088 raft_consensus.cc:2272] T 11ab7e9fc8c34bc99d9f07c85304f21b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.654956  7088 tablet_replica.cc:333] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.655781  7088 raft_consensus.cc:2243] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.656899  7088 raft_consensus.cc:2272] T 907d3c0b010e4d80b4aa0eeb2068b21b P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.659821  7088 tablet_replica.cc:333] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.660620  7088 raft_consensus.cc:2243] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.661207  7088 raft_consensus.cc:2272] T 9ae6ae2455024cde872a6cce314120f9 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.664062  7088 tablet_replica.cc:333] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.664868  7088 raft_consensus.cc:2243] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.665510  7088 raft_consensus.cc:2272] T 7d1fa6c68f5c4c54ad078f62fd387651 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.668355  7088 tablet_replica.cc:333] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.669142  7088 raft_consensus.cc:2243] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.670279  7088 raft_consensus.cc:2272] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.673014  7088 tablet_replica.cc:333] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.673776  7088 raft_consensus.cc:2243] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.675434  7088 raft_consensus.cc:2272] T 225960baa6af41d187116bada579f2f4 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.679075  7088 tablet_replica.cc:333] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.679925  7088 raft_consensus.cc:2243] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.680976  7088 raft_consensus.cc:2272] T 8b9ef826114749218e503fce75ebe00b P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.683678  7088 tablet_replica.cc:333] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.684253  7088 raft_consensus.cc:2243] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.685112  7088 raft_consensus.cc:2272] T 7e36c72e3a2641ba9cfeeedc71e853e6 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.687397  7088 tablet_replica.cc:333] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.688040  7088 raft_consensus.cc:2243] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.688591  7088 raft_consensus.cc:2272] T 341bc78504924367be418f9f9efdce67 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.691138  7088 tablet_replica.cc:333] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
W20260709 13:04:33.691534 13692 consensus_peers.cc:597] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.691855  7088 raft_consensus.cc:2243] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.692420  7088 raft_consensus.cc:2272] T 72da2bb06f304ae68d7bc48e326c2b84 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.694634  7088 tablet_replica.cc:333] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.695185  7088 raft_consensus.cc:2243] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.695618  7088 raft_consensus.cc:2272] T fe580baf6e25431f8421912ec7fcc66f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.697942  7088 tablet_replica.cc:333] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.698518  7088 raft_consensus.cc:2243] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.699420  7088 raft_consensus.cc:2272] T 5e95a37a01c349a08590fc8b4e1a355a P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.701872  7088 tablet_replica.cc:333] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.702867  7088 raft_consensus.cc:2243] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.703426  7088 raft_consensus.cc:2272] T 635dc98fdf3042ecba64ee28b17f4713 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.705708  7088 tablet_replica.cc:333] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.706311  7088 raft_consensus.cc:2243] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.707129  7088 raft_consensus.cc:2272] T 399df00a17e541e98fae8d4664b4566c P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.709514  7088 tablet_replica.cc:333] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.710270  7088 raft_consensus.cc:2243] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.710831  7088 raft_consensus.cc:2272] T 87ba941f0f3547dab9f990d24133749f P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.711871 13766 consensus_peers.cc:597] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.713347  7088 tablet_replica.cc:333] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.713934  7088 raft_consensus.cc:2243] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.714816  7088 raft_consensus.cc:2272] T c288c22a5bfd4771bddaaf7a39264407 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.717232  7088 tablet_replica.cc:333] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.717900  7088 raft_consensus.cc:2243] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.718498  7088 raft_consensus.cc:2272] T 2e1234620eb0424eb5ab654a8bb1dac9 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.720899  7088 tablet_replica.cc:333] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.721401  7088 raft_consensus.cc:2243] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.722425  7088 raft_consensus.cc:2272] T a9f715bd53db44c9897c1bc9af541e5c P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.724326  7088 tablet_replica.cc:333] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.724901  7088 raft_consensus.cc:2243] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.725641  7088 raft_consensus.cc:2272] T c6d05fd940f54f5284d55861d78ae249 P e3683af201ac41948aaa81cea02de029 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.727697  7088 tablet_replica.cc:333] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.728231  7088 raft_consensus.cc:2243] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.728663  7088 raft_consensus.cc:2272] T 40fef40743044169b7338f2d22113320 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.730690  7088 tablet_replica.cc:333] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.731242  7088 raft_consensus.cc:2243] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.731683  7088 raft_consensus.cc:2272] T 0e1653f547204758a0cd6a122be125cc P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.733677  7088 tablet_replica.cc:333] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.734315  7088 raft_consensus.cc:2243] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.734756  7088 raft_consensus.cc:2272] T 30707476881c44db89b44a8a2e812372 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.738562  7088 tablet_replica.cc:333] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.740777  7088 raft_consensus.cc:2243] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.741942  7088 raft_consensus.cc:2272] T 00c0045f00654855a3d672f639e01b17 P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.747017  7088 tablet_replica.cc:333] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.747833  7088 raft_consensus.cc:2243] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.748433  7088 raft_consensus.cc:2272] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.751302  7088 tablet_replica.cc:333] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029: stopping tablet replica
W20260709 13:04:33.751915 13766 consensus_peers.cc:597] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.752097  7088 raft_consensus.cc:2243] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.754026  7088 raft_consensus.cc:2272] T 94cfd7b05f864022974fc28bfacd9c0d P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.755980 13767 consensus_peers.cc:597] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:33.757068  7088 tablet_replica.cc:333] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.759709  7088 raft_consensus.cc:2243] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.760842  7088 raft_consensus.cc:2272] T bc89eeba61904cf58fc52c2ef8809a70 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.764881  7088 tablet_replica.cc:333] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.765578  7088 raft_consensus.cc:2243] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.766158  7088 raft_consensus.cc:2272] T 320e88d5ea5446bf95970895e068d9b5 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.768853  7088 tablet_replica.cc:333] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.769593  7088 raft_consensus.cc:2243] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.770164  7088 raft_consensus.cc:2272] T e32f0a6ac7f748819c2a4796bb279d80 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.772912  7088 tablet_replica.cc:333] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.773572  7088 raft_consensus.cc:2243] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.774654  7088 raft_consensus.cc:2272] T 93d68fc7290844b39bac589ab8ce83a3 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.777382  7088 tablet_replica.cc:333] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.778090  7088 raft_consensus.cc:2243] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.778609  7088 raft_consensus.cc:2272] T 7303d87314c5440cbf299237115d818c P e3683af201ac41948aaa81cea02de029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.781500  7088 tablet_replica.cc:333] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.783224  7088 raft_consensus.cc:2243] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.784310  7088 raft_consensus.cc:2272] T d226b35af23040529bd02af17994d615 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.786700  7088 tablet_replica.cc:333] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.787251  7088 raft_consensus.cc:2243] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.788218  7088 raft_consensus.cc:2272] T 3d09546ee4ea492f8b5ebef6afa028f0 P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.790395  7088 tablet_replica.cc:333] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.790844  7088 raft_consensus.cc:2243] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.791752  7088 raft_consensus.cc:2272] T 4375b1ee962c4bdab7ed9a4744ac1abf P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.794453  7088 tablet_replica.cc:333] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.795043  7088 raft_consensus.cc:2243] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.796085  7088 raft_consensus.cc:2272] T c7b482cf0234463ea074fc05017ed5b4 P e3683af201ac41948aaa81cea02de029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.798338  7088 tablet_replica.cc:333] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029: stopping tablet replica
I20260709 13:04:33.798826  7088 raft_consensus.cc:2243] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.799639  7088 raft_consensus.cc:2272] T 08af1fe4826543f6928324c919a96c4b P e3683af201ac41948aaa81cea02de029 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.845629 13766 consensus_peers.cc:597] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.852020 13692 consensus_peers.cc:597] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.869653 13766 consensus_peers.cc:597] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.892516 13692 consensus_peers.cc:597] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.893128 13692 consensus_peers.cc:597] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.901780 13692 consensus_peers.cc:597] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.915516 13766 consensus_peers.cc:597] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.922518  7088 tablet_server.cc:196] TabletServer@127.6.236.2:0 shutdown complete.
W20260709 13:04:33.965907 13766 consensus_peers.cc:597] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.985147 13766 consensus_peers.cc:597] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.993288 13692 consensus_peers.cc:597] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.013584  7088 tablet_server.cc:179] TabletServer@127.6.236.3:0 shutting down...
W20260709 13:04:34.068131 13764 consensus_peers.cc:597] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.071036 13692 consensus_peers.cc:597] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.074400 13766 consensus_peers.cc:597] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 -> Peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Couldn't send request to peer e3683af201ac41948aaa81cea02de029. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.118841  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:34.120005  7088 tablet_replica.cc:333] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.121055  7088 raft_consensus.cc:2243] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.121747  7088 raft_consensus.cc:2272] T 46592c7f545042849b442d72dcc3979f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.124356  7088 tablet_replica.cc:333] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.124984  7088 raft_consensus.cc:2243] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.125401  7088 raft_consensus.cc:2272] T ebb2600ae8d741429738e3887b811cef P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.127415  7088 tablet_replica.cc:333] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.128041  7088 raft_consensus.cc:2243] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.128494  7088 raft_consensus.cc:2272] T 944b6716b88040be900d0421aa382a29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.130702  7088 tablet_replica.cc:333] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.131266  7088 raft_consensus.cc:2243] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.131762  7088 raft_consensus.cc:2272] T 2a9d6a51fea243bf921646c100c91f8b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.133975  7088 tablet_replica.cc:333] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.134580  7088 raft_consensus.cc:2243] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.135070  7088 raft_consensus.cc:2272] T 570d47d923e646698c8d1cb50881806a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.137223  7088 tablet_replica.cc:333] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.137742  7088 raft_consensus.cc:2243] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.138603  7088 raft_consensus.cc:2272] T 54e397de8fed4278ac1e623f0bb77e7c P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.140591  7088 tablet_replica.cc:333] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.141116  7088 raft_consensus.cc:2243] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.141520  7088 raft_consensus.cc:2272] T 84008f69faa047d1b47f08ea114c506a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.143541  7088 tablet_replica.cc:333] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.144114  7088 raft_consensus.cc:2243] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.144968  7088 raft_consensus.cc:2272] T 60c9f55bf0434c59813efb44039ba4ae P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.147185  7088 tablet_replica.cc:333] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.147746  7088 raft_consensus.cc:2243] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.148648  7088 raft_consensus.cc:2272] T 11ab7e9fc8c34bc99d9f07c85304f21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.150804  7088 tablet_replica.cc:333] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.151335  7088 raft_consensus.cc:2243] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.151841  7088 raft_consensus.cc:2272] T 907d3c0b010e4d80b4aa0eeb2068b21b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.153992  7088 tablet_replica.cc:333] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.154628  7088 raft_consensus.cc:2243] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.155107  7088 raft_consensus.cc:2272] T 635dc98fdf3042ecba64ee28b17f4713 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.157286  7088 tablet_replica.cc:333] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.157816  7088 raft_consensus.cc:2243] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.158346  7088 raft_consensus.cc:2272] T 8c6632785442492484d7bd8e03442d29 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.160619  7088 tablet_replica.cc:333] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.161194  7088 raft_consensus.cc:2243] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.161643  7088 raft_consensus.cc:2272] T 3d09546ee4ea492f8b5ebef6afa028f0 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.163522  7088 tablet_replica.cc:333] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.164033  7088 raft_consensus.cc:2243] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.164526  7088 raft_consensus.cc:2272] T c6d05fd940f54f5284d55861d78ae249 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.167426  7088 tablet_replica.cc:333] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.168273  7088 raft_consensus.cc:2243] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.170714  7088 raft_consensus.cc:2272] T a0411d9d92994ad9be1464bd3c136064 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.174883  7088 tablet_replica.cc:333] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.175681  7088 raft_consensus.cc:2243] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.176334  7088 raft_consensus.cc:2272] T 7e36c72e3a2641ba9cfeeedc71e853e6 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.178679  7088 tablet_replica.cc:333] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.179324  7088 raft_consensus.cc:2243] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.180426  7088 raft_consensus.cc:2272] T 341bc78504924367be418f9f9efdce67 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.182493  7088 tablet_replica.cc:333] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.183063  7088 raft_consensus.cc:2243] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.183959  7088 raft_consensus.cc:2272] T 72da2bb06f304ae68d7bc48e326c2b84 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.186385  7088 tablet_replica.cc:333] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.187037  7088 raft_consensus.cc:2243] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.188064  7088 raft_consensus.cc:2272] T f8e9ad8a90dd49fcbe84e5a6fd2cca45 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.190733  7088 tablet_replica.cc:333] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.191443  7088 raft_consensus.cc:2243] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:34.191478 13764 consensus_peers.cc:597] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.192028  7088 raft_consensus.cc:2272] T 35763cd4283147759ec2c744a06238e3 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.194377  7088 tablet_replica.cc:333] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.194977  7088 raft_consensus.cc:2243] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.195837  7088 raft_consensus.cc:2272] T fe580baf6e25431f8421912ec7fcc66f P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.198248  7088 tablet_replica.cc:333] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.198928  7088 raft_consensus.cc:2243] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.199481  7088 raft_consensus.cc:2272] T 9fd55ddae5c64d3a9093174906446c68 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.201900  7088 tablet_replica.cc:333] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.202498  7088 raft_consensus.cc:2243] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.203456  7088 raft_consensus.cc:2272] T 2e1234620eb0424eb5ab654a8bb1dac9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.205395  7088 tablet_replica.cc:333] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.205935  7088 raft_consensus.cc:2243] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.206842  7088 raft_consensus.cc:2272] T 40fef40743044169b7338f2d22113320 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.208899  7088 tablet_replica.cc:333] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.209434  7088 raft_consensus.cc:2243] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.209844  7088 raft_consensus.cc:2272] T 0e1653f547204758a0cd6a122be125cc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.211841  7088 tablet_replica.cc:333] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.212390  7088 raft_consensus.cc:2243] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.212837  7088 raft_consensus.cc:2272] T 00c0045f00654855a3d672f639e01b17 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.215070  7088 tablet_replica.cc:333] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.215857  7088 raft_consensus.cc:2243] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.216835  7088 raft_consensus.cc:2272] T 30707476881c44db89b44a8a2e812372 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.219691  7088 tablet_replica.cc:333] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.220469  7088 raft_consensus.cc:2243] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.221086  7088 raft_consensus.cc:2272] T 79c7c53b44db41d9a56cff5d00be5010 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.223963  7088 tablet_replica.cc:333] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.224713  7088 raft_consensus.cc:2243] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.225371  7088 raft_consensus.cc:2272] T 5d98df69890142c4894e28b58aefd8d8 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.226545 13764 consensus_peers.cc:597] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.228116  7088 tablet_replica.cc:333] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.228947  7088 raft_consensus.cc:2243] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.229527  7088 raft_consensus.cc:2272] T 4375b1ee962c4bdab7ed9a4744ac1abf P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.231868 13764 consensus_peers.cc:597] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.232478  7088 tablet_replica.cc:333] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.233314  7088 raft_consensus.cc:2243] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.233773  7088 raft_consensus.cc:2272] T 08af1fe4826543f6928324c919a96c4b P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.235998  7088 tablet_replica.cc:333] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.236500  7088 raft_consensus.cc:2243] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.237002  7088 raft_consensus.cc:2272] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.239333  7088 tablet_replica.cc:333] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.239854  7088 raft_consensus.cc:2243] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.240249  7088 raft_consensus.cc:2272] T 225960baa6af41d187116bada579f2f4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.242322  7088 tablet_replica.cc:333] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.242812  7088 raft_consensus.cc:2243] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.243228  7088 raft_consensus.cc:2272] T 5e95a37a01c349a08590fc8b4e1a355a P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.245128  7088 tablet_replica.cc:333] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.245620  7088 raft_consensus.cc:2243] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.246121  7088 raft_consensus.cc:2272] T d381a014c4f543909a33453b71bff652 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.248910  7088 tablet_replica.cc:333] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.249711  7088 raft_consensus.cc:2243] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.250315  7088 raft_consensus.cc:2272] T e08d4a4a907f4921a9e03d12d58b8bb4 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.253218  7088 tablet_replica.cc:333] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.253966  7088 raft_consensus.cc:2243] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:34.254184 13764 consensus_peers.cc:597] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.255117  7088 raft_consensus.cc:2272] T be6cb9bb386e4e21b297137851efdc10 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.258240  7088 tablet_replica.cc:333] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.259001  7088 raft_consensus.cc:2243] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:34.259419 13764 consensus_peers.cc:597] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.260095  7088 raft_consensus.cc:2272] T d44b221b69f84c5b92e7df2779fa16dc P fd3a9103ce8543f5aae6be46c1f76bd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.262360  7088 tablet_replica.cc:333] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.262848  7088 raft_consensus.cc:2243] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.263288  7088 raft_consensus.cc:2272] T e1c0cb319af54e149630d921dcb04084 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.265305  7088 tablet_replica.cc:333] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.265986  7088 raft_consensus.cc:2243] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.266583  7088 raft_consensus.cc:2272] T 9ae6ae2455024cde872a6cce314120f9 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.269253  7088 tablet_replica.cc:333] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.269975  7088 raft_consensus.cc:2243] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.270501  7088 raft_consensus.cc:2272] T b5c13150952941e18c09fb91de8dbaa7 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.273253  7088 tablet_replica.cc:333] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.273976  7088 raft_consensus.cc:2243] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.274554  7088 raft_consensus.cc:2272] T bc89eeba61904cf58fc52c2ef8809a70 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.276737 13764 consensus_peers.cc:597] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.277375  7088 tablet_replica.cc:333] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.278201  7088 raft_consensus.cc:2243] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.278821  7088 raft_consensus.cc:2272] T 52ea8762178341d5a08d0758292d2a50 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.281440  7088 tablet_replica.cc:333] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8: stopping tablet replica
I20260709 13:04:34.281889  7088 raft_consensus.cc:2243] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.282321  7088 raft_consensus.cc:2272] T 320e88d5ea5446bf95970895e068d9b5 P fd3a9103ce8543f5aae6be46c1f76bd8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.340998 13764 consensus_peers.cc:597] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.371651 13764 consensus_peers.cc:597] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.390404 13764 consensus_peers.cc:597] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.394400  7088 tablet_server.cc:196] TabletServer@127.6.236.3:0 shutdown complete.
W20260709 13:04:34.470567 13764 consensus_peers.cc:597] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.493436 13764 consensus_peers.cc:597] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.494043 13764 consensus_peers.cc:597] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.498526  7088 tablet_server.cc:179] TabletServer@127.6.236.4:0 shutting down...
W20260709 13:04:34.525065 13767 consensus_peers.cc:597] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 -> Peer 816d755a8270492d88dac41d1d303c68 (127.6.236.1:40147): Couldn't send request to peer 816d755a8270492d88dac41d1d303c68. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:40147: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:34.543732 13764 consensus_peers.cc:597] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.554908 13764 consensus_peers.cc:597] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.563828  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:34.564174 13764 consensus_peers.cc:597] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 -> Peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Couldn't send request to peer fd3a9103ce8543f5aae6be46c1f76bd8. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.564941  7088 tablet_replica.cc:333] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.565934  7088 raft_consensus.cc:2243] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.566905  7088 raft_consensus.cc:2272] T 944b6716b88040be900d0421aa382a29 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.569442  7088 tablet_replica.cc:333] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.570066  7088 raft_consensus.cc:2243] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.570947  7088 raft_consensus.cc:2272] T b764a88e92eb45b59fdd342348e09439 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.573230  7088 tablet_replica.cc:333] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.573907  7088 raft_consensus.cc:2243] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.574429  7088 raft_consensus.cc:2272] T 54e397de8fed4278ac1e623f0bb77e7c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.576668  7088 tablet_replica.cc:333] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.577211  7088 raft_consensus.cc:2243] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.577999  7088 raft_consensus.cc:2272] T bceb1a953ae04c22a73b2911d54d6b10 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.580320  7088 tablet_replica.cc:333] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.580885  7088 raft_consensus.cc:2243] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.581705  7088 raft_consensus.cc:2272] T 84008f69faa047d1b47f08ea114c506a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.583642  7088 tablet_replica.cc:333] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.584218  7088 raft_consensus.cc:2243] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.585021  7088 raft_consensus.cc:2272] T 8c6632785442492484d7bd8e03442d29 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.587100  7088 tablet_replica.cc:333] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.587615  7088 raft_consensus.cc:2243] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.588403  7088 raft_consensus.cc:2272] T 570d47d923e646698c8d1cb50881806a P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.590445  7088 tablet_replica.cc:333] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.591029  7088 raft_consensus.cc:2243] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.591468  7088 raft_consensus.cc:2272] T 46592c7f545042849b442d72dcc3979f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.593439  7088 tablet_replica.cc:333] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.593982  7088 raft_consensus.cc:2243] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.594429  7088 raft_consensus.cc:2272] T 9dfa4c53a9364ccf8cf7c241664c6538 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.596302  7088 tablet_replica.cc:333] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.596838  7088 raft_consensus.cc:2243] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.597393  7088 raft_consensus.cc:2272] T 7e36c72e3a2641ba9cfeeedc71e853e6 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.600082  7088 tablet_replica.cc:333] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.600840  7088 raft_consensus.cc:2243] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.601984  7088 raft_consensus.cc:2272] T 5d98df69890142c4894e28b58aefd8d8 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.604511  7088 tablet_replica.cc:333] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.605118  7088 raft_consensus.cc:2243] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.605929  7088 raft_consensus.cc:2272] T 9ae6ae2455024cde872a6cce314120f9 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.608134  7088 tablet_replica.cc:333] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.608718  7088 raft_consensus.cc:2243] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.609299  7088 raft_consensus.cc:2272] T a9f715bd53db44c9897c1bc9af541e5c P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.611778  7088 tablet_replica.cc:333] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.612560  7088 raft_consensus.cc:2243] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.613364  7088 raft_consensus.cc:2272] T c6d05fd940f54f5284d55861d78ae249 P da3d66493d2f419fb8eda6491ce13df0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.616106  7088 tablet_replica.cc:333] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.616781  7088 raft_consensus.cc:2243] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.617174  7088 raft_consensus.cc:2272] T be6cb9bb386e4e21b297137851efdc10 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.619411  7088 tablet_replica.cc:333] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.619967  7088 raft_consensus.cc:2243] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.620348  7088 raft_consensus.cc:2272] T d44b221b69f84c5b92e7df2779fa16dc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.622356  7088 tablet_replica.cc:333] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.622853  7088 raft_consensus.cc:2243] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.623391  7088 raft_consensus.cc:2272] T 94cfd7b05f864022974fc28bfacd9c0d P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.623282 14976 raft_consensus.cc:493] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3683af201ac41948aaa81cea02de029)
I20260709 13:04:34.624004 14976 raft_consensus.cc:515] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3683af201ac41948aaa81cea02de029" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37455 } } peers { permanent_uuid: "fd3a9103ce8543f5aae6be46c1f76bd8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 45411 } } peers { permanent_uuid: "da3d66493d2f419fb8eda6491ce13df0" member_type: VOTER last_known_addr { host: "127.6.236.4" port: 45577 } }
I20260709 13:04:34.625746  7088 tablet_replica.cc:333] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.626609  7088 raft_consensus.cc:2243] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.627290  7088 raft_consensus.cc:2272] T 93d68fc7290844b39bac589ab8ce83a3 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.626554 14976 leader_election.cc:290] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455), fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411)
I20260709 13:04:34.630474  7088 tablet_replica.cc:333] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.631108  7088 raft_consensus.cc:2243] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:34.631102 13766 leader_election.cc:336] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3683af201ac41948aaa81cea02de029 (127.6.236.2:37455): Network error: Client connection negotiation failed: client connection to 127.6.236.2:37455: connect: Connection refused (error 111)
I20260709 13:04:34.631934  7088 raft_consensus.cc:2272] T a0411d9d92994ad9be1464bd3c136064 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.633433 13764 leader_election.cc:336] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fd3a9103ce8543f5aae6be46c1f76bd8 (127.6.236.3:45411): Network error: Client connection negotiation failed: client connection to 127.6.236.3:45411: connect: Connection refused (error 111)
I20260709 13:04:34.633891 13764 leader_election.cc:304] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da3d66493d2f419fb8eda6491ce13df0; no voters: e3683af201ac41948aaa81cea02de029, fd3a9103ce8543f5aae6be46c1f76bd8
I20260709 13:04:34.634519  7088 tablet_replica.cc:333] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.634583 14976 raft_consensus.cc:2749] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:34.635560  7088 raft_consensus.cc:2243] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.636025  7088 raft_consensus.cc:2272] T 6fe49ba6d20a41ebbd9b9b9f8b8f083a P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.638042  7088 tablet_replica.cc:333] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.638700  7088 raft_consensus.cc:2243] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.639165  7088 raft_consensus.cc:2272] T 225960baa6af41d187116bada579f2f4 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.641111  7088 tablet_replica.cc:333] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.641629  7088 raft_consensus.cc:2243] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.642040  7088 raft_consensus.cc:2272] T 8b9ef826114749218e503fce75ebe00b P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.643977  7088 tablet_replica.cc:333] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.644480  7088 raft_consensus.cc:2243] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.645306  7088 raft_consensus.cc:2272] T 35763cd4283147759ec2c744a06238e3 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.647153  7088 tablet_replica.cc:333] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.647686  7088 raft_consensus.cc:2243] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.648175  7088 raft_consensus.cc:2272] T fe580baf6e25431f8421912ec7fcc66f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.650260  7088 tablet_replica.cc:333] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.651000  7088 raft_consensus.cc:2243] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.651789  7088 raft_consensus.cc:2272] T 635dc98fdf3042ecba64ee28b17f4713 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.653982  7088 tablet_replica.cc:333] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.654559  7088 raft_consensus.cc:2243] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.654982  7088 raft_consensus.cc:2272] T 399df00a17e541e98fae8d4664b4566c P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.656951  7088 tablet_replica.cc:333] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.657469  7088 raft_consensus.cc:2243] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.658483  7088 raft_consensus.cc:2272] T 87ba941f0f3547dab9f990d24133749f P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.660902  7088 tablet_replica.cc:333] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.661585  7088 raft_consensus.cc:2243] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.662288  7088 raft_consensus.cc:2272] T c288c22a5bfd4771bddaaf7a39264407 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.664667  7088 tablet_replica.cc:333] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.665212  7088 raft_consensus.cc:2243] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.665987  7088 raft_consensus.cc:2272] T 9fd55ddae5c64d3a9093174906446c68 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.668008  7088 tablet_replica.cc:333] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.668506  7088 raft_consensus.cc:2243] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.668908  7088 raft_consensus.cc:2272] T 2e1234620eb0424eb5ab654a8bb1dac9 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.670928  7088 tablet_replica.cc:333] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.671407  7088 raft_consensus.cc:2243] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.672174  7088 raft_consensus.cc:2272] T 7303d87314c5440cbf299237115d818c P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.674331  7088 tablet_replica.cc:333] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.674854  7088 raft_consensus.cc:2243] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.675642  7088 raft_consensus.cc:2272] T e1c0cb319af54e149630d921dcb04084 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.677642  7088 tablet_replica.cc:333] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.678269  7088 raft_consensus.cc:2243] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.678663  7088 raft_consensus.cc:2272] T d226b35af23040529bd02af17994d615 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.680648  7088 tablet_replica.cc:333] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.681232  7088 raft_consensus.cc:2243] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.682134  7088 raft_consensus.cc:2272] T 7d1fa6c68f5c4c54ad078f62fd387651 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.684458  7088 tablet_replica.cc:333] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.685061  7088 raft_consensus.cc:2243] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.685998  7088 raft_consensus.cc:2272] T e08d4a4a907f4921a9e03d12d58b8bb4 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.688249  7088 tablet_replica.cc:333] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.688982  7088 raft_consensus.cc:2243] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.689796  7088 raft_consensus.cc:2272] T b5c13150952941e18c09fb91de8dbaa7 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.692234  7088 tablet_replica.cc:333] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.692981  7088 raft_consensus.cc:2243] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.694087  7088 raft_consensus.cc:2272] T 52ea8762178341d5a08d0758292d2a50 P da3d66493d2f419fb8eda6491ce13df0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.696600  7088 tablet_replica.cc:333] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.697119  7088 raft_consensus.cc:2243] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.697834  7088 raft_consensus.cc:2272] T 320e88d5ea5446bf95970895e068d9b5 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.699779  7088 tablet_replica.cc:333] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.700258  7088 raft_consensus.cc:2243] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.701014  7088 raft_consensus.cc:2272] T 0e1653f547204758a0cd6a122be125cc P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.703099  7088 tablet_replica.cc:333] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.703591  7088 raft_consensus.cc:2243] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.703995  7088 raft_consensus.cc:2272] T 30707476881c44db89b44a8a2e812372 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.706188  7088 tablet_replica.cc:333] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.706707  7088 raft_consensus.cc:2243] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.707584  7088 raft_consensus.cc:2272] T d381a014c4f543909a33453b71bff652 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.709558  7088 tablet_replica.cc:333] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.710163  7088 raft_consensus.cc:2243] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.710582  7088 raft_consensus.cc:2272] T c7b482cf0234463ea074fc05017ed5b4 P da3d66493d2f419fb8eda6491ce13df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.712572  7088 tablet_replica.cc:333] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.713020  7088 raft_consensus.cc:2243] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.713466  7088 raft_consensus.cc:2272] T 08af1fe4826543f6928324c919a96c4b P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.715406  7088 tablet_replica.cc:333] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0: stopping tablet replica
I20260709 13:04:34.715843  7088 raft_consensus.cc:2243] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.716570  7088 raft_consensus.cc:2272] T e32f0a6ac7f748819c2a4796bb279d80 P da3d66493d2f419fb8eda6491ce13df0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.451725  7088 tablet_server.cc:196] TabletServer@127.6.236.4:0 shutdown complete.
I20260709 13:04:35.513809  7088 master.cc:562] Master@127.6.236.62:37525 shutting down...
W20260709 13:04:35.541604 13524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:04:35.542622  7088 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.543191  7088 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.543502  7088 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8b4a5002f9c84c33adf22ac6ab2d36da: stopping tablet replica
I20260709 13:04:35.565057  7088 master.cc:584] Master@127.6.236.62:37525 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (44726 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:04:35.654371  7088 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.236.62:43199
I20260709 13:04:35.655503  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:35.662309 14986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.662309 14985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.664149 14988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.664309  7088 server_base.cc:1061] running on GCE node
I20260709 13:04:35.665493  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:35.665673  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:35.665787  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602275665776 us; error 0 us; skew 500 ppm
I20260709 13:04:35.666311  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:35.668771  7088 webserver.cc:533] Webserver started at http://127.6.236.62:44725/ using document root <none> and password file <none>
I20260709 13:04:35.669209  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:35.669368  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:35.669587  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:35.670707  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/master-0-root/instance:
uuid: "858a75791f8b41f895cf41d6bc2d1e9e"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-j4mc"
I20260709 13:04:35.675050  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:35.678779 14993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.679582  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:04:35.679913  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/master-0-root
uuid: "858a75791f8b41f895cf41d6bc2d1e9e"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-j4mc"
I20260709 13:04:35.680182  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:35.708240  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:35.710000  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:35.749645  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.62:43199
I20260709 13:04:35.749774 15044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.62:43199 every 8 connection(s)
I20260709 13:04:35.753525 15045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.764701 15045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e: Bootstrap starting.
I20260709 13:04:35.769388 15045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.773608 15045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e: No bootstrap required, opened a new log
I20260709 13:04:35.775791 15045 raft_consensus.cc:359] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858a75791f8b41f895cf41d6bc2d1e9e" member_type: VOTER }
I20260709 13:04:35.776175 15045 raft_consensus.cc:385] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.776386 15045 raft_consensus.cc:740] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858a75791f8b41f895cf41d6bc2d1e9e, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.776970 15045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858a75791f8b41f895cf41d6bc2d1e9e" member_type: VOTER }
I20260709 13:04:35.777400 15045 raft_consensus.cc:399] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:35.777608 15045 raft_consensus.cc:493] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:35.777855 15045 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.782511 15045 raft_consensus.cc:515] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858a75791f8b41f895cf41d6bc2d1e9e" member_type: VOTER }
I20260709 13:04:35.783044 15045 leader_election.cc:304] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 858a75791f8b41f895cf41d6bc2d1e9e; no voters: 
I20260709 13:04:35.784111 15045 leader_election.cc:290] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:35.784447 15048 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.785771 15048 raft_consensus.cc:697] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 1 LEADER]: Becoming Leader. State: Replica: 858a75791f8b41f895cf41d6bc2d1e9e, State: Running, Role: LEADER
I20260709 13:04:35.786500 15048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858a75791f8b41f895cf41d6bc2d1e9e" member_type: VOTER }
I20260709 13:04:35.786919 15045 sys_catalog.cc:565] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:35.790982 15049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "858a75791f8b41f895cf41d6bc2d1e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858a75791f8b41f895cf41d6bc2d1e9e" member_type: VOTER } }
I20260709 13:04:35.791657 15049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:35.793277 15050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 858a75791f8b41f895cf41d6bc2d1e9e. Latest consensus state: current_term: 1 leader_uuid: "858a75791f8b41f895cf41d6bc2d1e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858a75791f8b41f895cf41d6bc2d1e9e" member_type: VOTER } }
I20260709 13:04:35.793699 15055 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:35.794093 15050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:35.800060 15055 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:35.801818  7088 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:35.809814 15055 catalog_manager.cc:1383] Generated new cluster ID: 44fd2ca037ac4a3bad2c9dd30cf9cf87
I20260709 13:04:35.810209 15055 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:35.846915 15055 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:35.848165 15055 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:35.862154 15055 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e: Generated new TSK 0
I20260709 13:04:35.862932 15055 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:35.868584  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:35.874629 15066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.875279 15067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.877213  7088 server_base.cc:1061] running on GCE node
W20260709 13:04:35.877979 15069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.878948  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:35.879133  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:35.879262  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602275879251 us; error 0 us; skew 500 ppm
I20260709 13:04:35.879709  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:35.882066  7088 webserver.cc:533] Webserver started at http://127.6.236.1:40217/ using document root <none> and password file <none>
I20260709 13:04:35.882670  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:35.882829  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:35.883033  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:35.884099  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root/instance:
uuid: "6506133b29194d41a950da4450fd512e"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-j4mc"
I20260709 13:04:35.888468  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:35.891695 15074 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.892429  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:35.892691  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "6506133b29194d41a950da4450fd512e"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-j4mc"
I20260709 13:04:35.892952  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:35.922402  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:35.923635  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:35.925212  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:35.927551  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:35.927759  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.928009  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:35.928165  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.970994  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:46799
I20260709 13:04:35.971109 15136 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:46799 every 8 connection(s)
I20260709 13:04:35.975791  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:35.984385 15141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.988205  7088 server_base.cc:1061] running on GCE node
W20260709 13:04:35.987828 15142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.989697 15144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.990881  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:35.991093  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:35.991252  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602275991233 us; error 0 us; skew 500 ppm
I20260709 13:04:35.991686 15137 heartbeater.cc:344] Connected to a master server at 127.6.236.62:43199
I20260709 13:04:35.991803  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:35.992100 15137 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:35.993139 15137 heartbeater.cc:507] Master 127.6.236.62:43199 requested a full tablet report, sending...
I20260709 13:04:35.994585  7088 webserver.cc:533] Webserver started at http://127.6.236.2:33363/ using document root <none> and password file <none>
I20260709 13:04:35.995121  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:35.995308  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:35.995550  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:35.995461 15010 ts_manager.cc:194] Registered new tserver with Master: 6506133b29194d41a950da4450fd512e (127.6.236.1:46799)
I20260709 13:04:35.996867  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-1-root/instance:
uuid: "8095e4d04eb044faa83dd2f65ce64ece"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-j4mc"
I20260709 13:04:35.997452 15010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52782
I20260709 13:04:36.001398  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:36.005168 15149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:36.006197  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:36.006498  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-1-root
uuid: "8095e4d04eb044faa83dd2f65ce64ece"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-j4mc"
I20260709 13:04:36.006770  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:36.028679  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:36.029874  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:36.031375  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:36.033499  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:36.033703  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:36.033915  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:36.034062  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:36.073053  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.2:42147
I20260709 13:04:36.073164 15211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.2:42147 every 8 connection(s)
I20260709 13:04:36.078001  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:36.084980 15215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:36.085354 15216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:36.088604 15218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:36.091506 15212 heartbeater.cc:344] Connected to a master server at 127.6.236.62:43199
I20260709 13:04:36.091686  7088 server_base.cc:1061] running on GCE node
I20260709 13:04:36.092197 15212 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:36.092926  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:36.093119 15212 heartbeater.cc:507] Master 127.6.236.62:43199 requested a full tablet report, sending...
W20260709 13:04:36.093277  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:36.093508  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602276093489 us; error 0 us; skew 500 ppm
I20260709 13:04:36.094300  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:36.095431 15010 ts_manager.cc:194] Registered new tserver with Master: 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:36.096915 15010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52790
I20260709 13:04:36.097344  7088 webserver.cc:533] Webserver started at http://127.6.236.3:38481/ using document root <none> and password file <none>
I20260709 13:04:36.097957  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:36.098186  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:36.098436  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:36.099536  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-2-root/instance:
uuid: "81a8fd56615a412295a21e31c7c4e5f8"
format_stamp: "Formatted at 2026-07-09 13:04:36 on dist-test-slave-j4mc"
I20260709 13:04:36.104014  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:04:36.107635 15223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:36.108400  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:36.108731  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-2-root
uuid: "81a8fd56615a412295a21e31c7c4e5f8"
format_stamp: "Formatted at 2026-07-09 13:04:36 on dist-test-slave-j4mc"
I20260709 13:04:36.109006  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:36.142884  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:36.144102  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:36.145596  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:36.147873  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:36.148080  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:36.148306  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:36.148459  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:36.192814  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.3:46031
I20260709 13:04:36.192966 15285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.3:46031 every 8 connection(s)
I20260709 13:04:36.206727 15286 heartbeater.cc:344] Connected to a master server at 127.6.236.62:43199
I20260709 13:04:36.207221 15286 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:36.207976 15286 heartbeater.cc:507] Master 127.6.236.62:43199 requested a full tablet report, sending...
I20260709 13:04:36.209882 15010 ts_manager.cc:194] Registered new tserver with Master: 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.210808  7088 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014701216s
I20260709 13:04:36.211781 15010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52798
I20260709 13:04:36.236057 15010 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52814:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:36.238765 15010 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:36.315265 15177 tablet_service.cc:1511] Processing CreateTablet for tablet b7994e4e643e4514a8efe762bce940e2 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:36.316711 15177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7994e4e643e4514a8efe762bce940e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.319172 15102 tablet_service.cc:1511] Processing CreateTablet for tablet b7994e4e643e4514a8efe762bce940e2 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:36.320672 15102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7994e4e643e4514a8efe762bce940e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.327728 15101 tablet_service.cc:1511] Processing CreateTablet for tablet 1e32c07523ff48e38fe095566aeff5db (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:36.329208 15101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e32c07523ff48e38fe095566aeff5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.331085 15100 tablet_service.cc:1511] Processing CreateTablet for tablet 905435f46f1947fd81bc08cc528d4b34 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:36.333355 15099 tablet_service.cc:1511] Processing CreateTablet for tablet 58ec9f19d24e4ea19194835e45c909a2 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:36.333554 15093 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbb1761ef954248bdde85567da93f89 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:36.335172 15098 tablet_service.cc:1511] Processing CreateTablet for tablet c69765c5abe14043b1090cc869ffe751 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:36.335868 15094 tablet_service.cc:1511] Processing CreateTablet for tablet 2507735673c74f19834b29dedad54129 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:36.337414 15097 tablet_service.cc:1511] Processing CreateTablet for tablet b97f0506d2e54642b50de2f4bff6736c (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:36.338047 15095 tablet_service.cc:1511] Processing CreateTablet for tablet 2369acf4d806439a97293f6fae739cd7 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:36.339586 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2507735673c74f19834b29dedad54129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.339650 15096 tablet_service.cc:1511] Processing CreateTablet for tablet a6bd6ac1f01a468c994430980794c8e9 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:36.341521 15099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ec9f19d24e4ea19194835e45c909a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.343685 15100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905435f46f1947fd81bc08cc528d4b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.345511 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369acf4d806439a97293f6fae739cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.346490 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bd6ac1f01a468c994430980794c8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.349261 15176 tablet_service.cc:1511] Processing CreateTablet for tablet 1e32c07523ff48e38fe095566aeff5db (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:36.350790 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e32c07523ff48e38fe095566aeff5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.351091 15251 tablet_service.cc:1511] Processing CreateTablet for tablet b7994e4e643e4514a8efe762bce940e2 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:36.352139 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69765c5abe14043b1090cc869ffe751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.352643 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7994e4e643e4514a8efe762bce940e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.353533 15097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f0506d2e54642b50de2f4bff6736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.354880 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbb1761ef954248bdde85567da93f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.354573 15250 tablet_service.cc:1511] Processing CreateTablet for tablet 1e32c07523ff48e38fe095566aeff5db (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:36.356096 15250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e32c07523ff48e38fe095566aeff5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.358067 15249 tablet_service.cc:1511] Processing CreateTablet for tablet 905435f46f1947fd81bc08cc528d4b34 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:36.359577 15249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905435f46f1947fd81bc08cc528d4b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.368453 15248 tablet_service.cc:1511] Processing CreateTablet for tablet 58ec9f19d24e4ea19194835e45c909a2 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:36.369861 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ec9f19d24e4ea19194835e45c909a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.370754 15175 tablet_service.cc:1511] Processing CreateTablet for tablet 905435f46f1947fd81bc08cc528d4b34 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:36.372116 15175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905435f46f1947fd81bc08cc528d4b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.375821 15174 tablet_service.cc:1511] Processing CreateTablet for tablet 58ec9f19d24e4ea19194835e45c909a2 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:36.377467 15174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ec9f19d24e4ea19194835e45c909a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.379752 15173 tablet_service.cc:1511] Processing CreateTablet for tablet c69765c5abe14043b1090cc869ffe751 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:36.380717 15246 tablet_service.cc:1511] Processing CreateTablet for tablet b97f0506d2e54642b50de2f4bff6736c (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:36.381218 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69765c5abe14043b1090cc869ffe751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.381706 15247 tablet_service.cc:1511] Processing CreateTablet for tablet c69765c5abe14043b1090cc869ffe751 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:36.383051 15247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69765c5abe14043b1090cc869ffe751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.386790 15246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f0506d2e54642b50de2f4bff6736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.386703 15244 tablet_service.cc:1511] Processing CreateTablet for tablet 2369acf4d806439a97293f6fae739cd7 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:36.388243 15244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369acf4d806439a97293f6fae739cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.395527 15243 tablet_service.cc:1511] Processing CreateTablet for tablet 2507735673c74f19834b29dedad54129 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:36.396996 15243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2507735673c74f19834b29dedad54129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.383225 15245 tablet_service.cc:1511] Processing CreateTablet for tablet a6bd6ac1f01a468c994430980794c8e9 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:36.399428 15245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bd6ac1f01a468c994430980794c8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.390707 15242 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbb1761ef954248bdde85567da93f89 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:36.403275 15242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbb1761ef954248bdde85567da93f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.433102 15172 tablet_service.cc:1511] Processing CreateTablet for tablet b97f0506d2e54642b50de2f4bff6736c (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:36.434634 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f0506d2e54642b50de2f4bff6736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.456797 15303 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:36.487875 15173 tablet_service.cc:1511] Processing CreateTablet for tablet 2369acf4d806439a97293f6fae739cd7 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:36.489326 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369acf4d806439a97293f6fae739cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.497833 15301 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:36.502599 15176 tablet_service.cc:1511] Processing CreateTablet for tablet a6bd6ac1f01a468c994430980794c8e9 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:36.503607 15170 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbb1761ef954248bdde85567da93f89 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:36.504051 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bd6ac1f01a468c994430980794c8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.502592 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 2507735673c74f19834b29dedad54129 (DEFAULT_TABLE table=test-workload [id=8b4bc761f27e4d738e61984b99b958bf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:36.506667 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbb1761ef954248bdde85567da93f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.522023 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2507735673c74f19834b29dedad54129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.517273 15302 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:36.532215 15303 tablet_bootstrap.cc:654] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.506232 15301 tablet_bootstrap.cc:654] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.540758 15302 tablet_bootstrap.cc:654] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.555290 15301 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.555826 15301 ts_tablet_manager.cc:1403] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.058s	user 0.005s	sys 0.006s
I20260709 13:04:36.555963 15302 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:36.556501 15302 ts_tablet_manager.cc:1403] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.040s	user 0.001s	sys 0.010s
I20260709 13:04:36.558775 15301 raft_consensus.cc:359] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.559602 15301 raft_consensus.cc:385] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.559433 15302 raft_consensus.cc:359] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.559969 15301 raft_consensus.cc:740] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.560212 15302 raft_consensus.cc:385] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.560413 15303 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:36.560604 15302 raft_consensus.cc:740] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.560983 15303 ts_tablet_manager.cc:1403] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.020s
I20260709 13:04:36.560940 15301 consensus_queue.cc:260] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.561586 15302 consensus_queue.cc:260] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.564155 15212 heartbeater.cc:499] Master 127.6.236.62:43199 was elected leader, sending a full tablet report...
I20260709 13:04:36.563819 15303 raft_consensus.cc:359] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.564590 15303 raft_consensus.cc:385] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.564770 15302 ts_tablet_manager.cc:1434] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:36.564872 15303 raft_consensus.cc:740] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.566310 15302 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:36.566051 15303 consensus_queue.cc:260] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.569497 15137 heartbeater.cc:499] Master 127.6.236.62:43199 was elected leader, sending a full tablet report...
I20260709 13:04:36.569995 15301 ts_tablet_manager.cc:1434] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.003s
I20260709 13:04:36.571056 15301 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:36.575981 15303 ts_tablet_manager.cc:1434] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:04:36.576864 15286 heartbeater.cc:499] Master 127.6.236.62:43199 was elected leader, sending a full tablet report...
W20260709 13:04:36.577200 15213 tablet.cc:2406] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:36.578872 15301 tablet_bootstrap.cc:654] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.581451 15302 tablet_bootstrap.cc:654] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.585548 15303 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:36.590158 15307 raft_consensus.cc:493] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.591904 15307 raft_consensus.cc:515] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.594828 15307 leader_election.cc:290] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.595403 15302 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:36.596048 15302 ts_tablet_manager.cc:1403] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.004s
I20260709 13:04:36.598863 15303 tablet_bootstrap.cc:654] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.598970 15302 raft_consensus.cc:359] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.599668 15301 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.599867 15302 raft_consensus.cc:385] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.600212 15301 ts_tablet_manager.cc:1403] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.005s
I20260709 13:04:36.600298 15302 raft_consensus.cc:740] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.601358 15302 consensus_queue.cc:260] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.603238 15301 raft_consensus.cc:359] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.603772 15302 ts_tablet_manager.cc:1434] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:36.604067 15301 raft_consensus.cc:385] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.604386 15301 raft_consensus.cc:740] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.605017 15302 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:36.605118 15301 consensus_queue.cc:260] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.607537 15301 ts_tablet_manager.cc:1434] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:36.608533 15301 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:36.612633 15302 tablet_bootstrap.cc:654] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.614574 15301 tablet_bootstrap.cc:654] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.614787 15303 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:36.615463 15303 ts_tablet_manager.cc:1403] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 13:04:36.618635 15303 raft_consensus.cc:359] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.619544 15303 raft_consensus.cc:385] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.619905 15303 raft_consensus.cc:740] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.620795 15303 consensus_queue.cc:260] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.623292 15303 ts_tablet_manager.cc:1434] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:36.624354 15303 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:36.626523 15301 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.627133 15301 ts_tablet_manager.cc:1403] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:04:36.630236 15302 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:36.630587 15303 tablet_bootstrap.cc:654] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.630168 15301 raft_consensus.cc:359] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.631273 15301 raft_consensus.cc:385] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.631635 15301 raft_consensus.cc:740] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.630892 15302 ts_tablet_manager.cc:1403] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:04:36.632381 15301 consensus_queue.cc:260] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.634989 15301 ts_tablet_manager.cc:1434] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:04:36.635993 15301 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:36.635738 15302 raft_consensus.cc:359] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.638720 15302 raft_consensus.cc:385] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.639130 15302 raft_consensus.cc:740] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.642127 15301 tablet_bootstrap.cc:654] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.643901 15302 consensus_queue.cc:260] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.644616 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
W20260709 13:04:36.646484 15075 leader_election.cc:343] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.648541 15302 ts_tablet_manager.cc:1434] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:36.649873 15302 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:36.650337 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:36.651158 15187 raft_consensus.cc:2468] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:36.652710 15075 leader_election.cc:304] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:36.653885 15307 raft_consensus.cc:2804] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.654337 15307 raft_consensus.cc:493] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.654666 15307 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.657127 15302 tablet_bootstrap.cc:654] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.663667 15301 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.664228 15301 ts_tablet_manager.cc:1403] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.008s
I20260709 13:04:36.665570 15302 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:36.666303 15308 raft_consensus.cc:493] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.666890 15308 raft_consensus.cc:515] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.667447 15301 raft_consensus.cc:359] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.668254 15301 raft_consensus.cc:385] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.668552 15301 raft_consensus.cc:740] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.669795 15308 leader_election.cc:290] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.669495 15301 consensus_queue.cc:260] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.670672 15302 ts_tablet_manager.cc:1403] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.006s
I20260709 13:04:36.672981 15303 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:36.673555 15303 ts_tablet_manager.cc:1403] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.011s
I20260709 13:04:36.674099 15302 raft_consensus.cc:359] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.664376 15307 raft_consensus.cc:515] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.676556 15307 leader_election.cc:290] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Requested vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.676697 15303 raft_consensus.cc:359] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.677491 15302 raft_consensus.cc:385] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.678040 15302 raft_consensus.cc:740] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.678956 15302 consensus_queue.cc:260] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.677634 15303 raft_consensus.cc:385] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.680167 15303 raft_consensus.cc:740] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.681155 15303 consensus_queue.cc:260] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.684558 15303 ts_tablet_manager.cc:1434] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:04:36.688032 15303 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:36.684983 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:36.690119 15301 ts_tablet_manager.cc:1434] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.026s	user 0.018s	sys 0.008s
I20260709 13:04:36.691354 15301 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:36.693543 15261 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.695330 15303 tablet_bootstrap.cc:654] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.698040 15301 tablet_bootstrap.cc:654] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.698923 15309 raft_consensus.cc:493] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.699522 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:36.700109 15187 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.699082 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32c07523ff48e38fe095566aeff5db" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:36.699492 15309 raft_consensus.cc:515] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.703653 15261 raft_consensus.cc:2468] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:36.686163 15302 ts_tablet_manager.cc:1434] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:36.705624 15309 leader_election.cc:290] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
W20260709 13:04:36.706632 15150 leader_election.cc:343] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.705825 15302 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:36.710216 15301 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.710943 15301 ts_tablet_manager.cc:1403] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:04:36.714625 15302 tablet_bootstrap.cc:654] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.714346 15301 raft_consensus.cc:359] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.718760 15301 raft_consensus.cc:385] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.719210 15301 raft_consensus.cc:740] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.720077 15301 consensus_queue.cc:260] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.725559 15075 leader_election.cc:304] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:36.726289 15302 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:36.727201 15321 raft_consensus.cc:2804] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.727732 15321 raft_consensus.cc:697] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Becoming Leader. State: Replica: 6506133b29194d41a950da4450fd512e, State: Running, Role: LEADER
I20260709 13:04:36.728626 15321 consensus_queue.cc:237] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:36.730515 15301 ts_tablet_manager.cc:1434] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:04:36.732445 15302 ts_tablet_manager.cc:1403] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.011s
I20260709 13:04:36.735494 15302 raft_consensus.cc:359] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.736235 15302 raft_consensus.cc:385] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.736522 15302 raft_consensus.cc:740] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.736894 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:36.730439 15187 raft_consensus.cc:2468] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:36.739846 15301 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
W20260709 13:04:36.738649 15224 leader_election.cc:343] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.740476 15303 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:36.741035 15303 ts_tablet_manager.cc:1403] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.011s
I20260709 13:04:36.737299 15302 consensus_queue.cc:260] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.744263 15302 ts_tablet_manager.cc:1434] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:36.745299 15302 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:36.745841 15303 raft_consensus.cc:359] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.746666 15303 raft_consensus.cc:385] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.746969 15303 raft_consensus.cc:740] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.751137 15303 consensus_queue.cc:260] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.752357 15302 tablet_bootstrap.cc:654] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.755311 15303 ts_tablet_manager.cc:1434] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:36.755858 15301 tablet_bootstrap.cc:654] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.756392 15303 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:36.763747 15303 tablet_bootstrap.cc:654] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.769786 15301 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.770545 15301 ts_tablet_manager.cc:1403] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 13:04:36.773563 15303 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:36.773563 15301 raft_consensus.cc:359] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.774298 15303 ts_tablet_manager.cc:1403] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 13:04:36.774555 15301 raft_consensus.cc:385] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.774931 15301 raft_consensus.cc:740] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.775704 15301 consensus_queue.cc:260] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.777458 15303 raft_consensus.cc:359] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.778054 15301 ts_tablet_manager.cc:1434] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:36.778285 15303 raft_consensus.cc:385] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.778671 15303 raft_consensus.cc:740] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.779484 15301 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:36.779556 15303 consensus_queue.cc:260] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.784147 15303 ts_tablet_manager.cc:1434] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:36.785300 15303 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:36.786962 15301 tablet_bootstrap.cc:654] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.792402 15303 tablet_bootstrap.cc:654] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.792371 15308 raft_consensus.cc:493] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.793133 15308 raft_consensus.cc:515] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
W20260709 13:04:36.797564 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:36.797837 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:36.795557 15308 leader_election.cc:290] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
W20260709 13:04:36.799463 15150 leader_election.cc:343] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.805370 15308 raft_consensus.cc:493] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.805887 15308 raft_consensus.cc:515] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.808375 15308 leader_election.cc:290] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.809571 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369acf4d806439a97293f6fae739cd7" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:36.810812 15303 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
W20260709 13:04:36.811275 15150 leader_election.cc:343] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.811415 15303 ts_tablet_manager.cc:1403] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:04:36.814218 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e" is_pre_election: true
I20260709 13:04:36.805852 15009 catalog_manager.cc:5697] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6506133b29194d41a950da4450fd512e (127.6.236.1). New cstate: current_term: 1 leader_uuid: "6506133b29194d41a950da4450fd512e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:36.817072 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e" is_pre_election: true
I20260709 13:04:36.818626 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369acf4d806439a97293f6fae739cd7" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e" is_pre_election: true
I20260709 13:04:36.819432 15110 raft_consensus.cc:2468] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 0.
W20260709 13:04:36.821175 15152 leader_election.cc:343] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.821604 15152 leader_election.cc:304] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece; no voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:36.822817 15152 leader_election.cc:304] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:36.823071 15302 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:36.823349 15301 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.823812 15308 raft_consensus.cc:2749] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.824163 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32c07523ff48e38fe095566aeff5db" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e" is_pre_election: true
I20260709 13:04:36.824731 15308 raft_consensus.cc:2804] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.824810 15112 raft_consensus.cc:2468] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 0.
I20260709 13:04:36.825145 15308 raft_consensus.cc:493] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.825516 15308 raft_consensus.cc:3060] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.823954 15301 ts_tablet_manager.cc:1403] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.017s
W20260709 13:04:36.826475 15226 leader_election.cc:343] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.826948 15226 leader_election.cc:304] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:36.828253 15309 raft_consensus.cc:2749] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.829454 15301 raft_consensus.cc:359] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.830683 15301 raft_consensus.cc:385] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.831025 15301 raft_consensus.cc:740] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.831866 15301 consensus_queue.cc:260] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.834306 15301 ts_tablet_manager.cc:1434] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:36.823809 15302 ts_tablet_manager.cc:1403] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.079s	user 0.029s	sys 0.040s
I20260709 13:04:36.834818 15303 raft_consensus.cc:359] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.835474 15301 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:36.837615 15303 raft_consensus.cc:385] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.837965 15303 raft_consensus.cc:740] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.839931 15303 consensus_queue.cc:260] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.840463 15308 raft_consensus.cc:515] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.843739 15301 tablet_bootstrap.cc:654] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.844091 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369acf4d806439a97293f6fae739cd7" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:36.844812 15261 raft_consensus.cc:3060] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.844988 15302 raft_consensus.cc:359] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.846374 15302 raft_consensus.cc:385] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.846784 15302 raft_consensus.cc:740] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.845911 15308 leader_election.cc:290] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.848029 15302 consensus_queue.cc:260] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.850431 15302 ts_tablet_manager.cc:1434] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:04:36.855660 15302 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:36.851182 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369acf4d806439a97293f6fae739cd7" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:36.857825 15112 raft_consensus.cc:3060] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.862344 15302 tablet_bootstrap.cc:654] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.853056 15261 raft_consensus.cc:2468] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 1.
I20260709 13:04:36.853868 15303 ts_tablet_manager.cc:1434] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:04:36.853598 15321 raft_consensus.cc:493] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.863230 15309 raft_consensus.cc:493] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.868034 15150 leader_election.cc:304] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:36.868366 15309 raft_consensus.cc:515] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.851938 15152 leader_election.cc:304] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:36.867630 15321 raft_consensus.cc:515] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.866258 15112 raft_consensus.cc:2468] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 1.
I20260709 13:04:36.871322 15309 leader_election.cc:290] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:36.872067 15321 leader_election.cc:290] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.873862 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:36.874261 15308 raft_consensus.cc:2804] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.874838 15308 raft_consensus.cc:697] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
W20260709 13:04:36.875561 15075 leader_election.cc:343] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.875700 15308 consensus_queue.cc:237] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.876663 15336 raft_consensus.cc:2804] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.877131 15336 raft_consensus.cc:493] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.877494 15336 raft_consensus.cc:3060] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.878501 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb1761ef954248bdde85567da93f89" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
W20260709 13:04:36.880218 15224 leader_election.cc:343] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.884183 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb1761ef954248bdde85567da93f89" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e" is_pre_election: true
I20260709 13:04:36.887166 15303 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:36.888487 15112 raft_consensus.cc:2468] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 0.
I20260709 13:04:36.891762 15226 leader_election.cc:304] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:36.892665 15301 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.893122 15301 ts_tablet_manager.cc:1403] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.058s	user 0.030s	sys 0.017s
I20260709 13:04:36.894307 15309 raft_consensus.cc:2804] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.894860 15309 raft_consensus.cc:493] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.895399 15303 tablet_bootstrap.cc:654] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.895263 15301 raft_consensus.cc:359] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.895918 15301 raft_consensus.cc:385] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.896166 15301 raft_consensus.cc:740] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.896840 15301 consensus_queue.cc:260] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.898360 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:36.898617 15301 ts_tablet_manager.cc:1434] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:04:36.899693 15301 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:36.895213 15309 raft_consensus.cc:3060] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.903690 15302 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:36.904279 15302 ts_tablet_manager.cc:1403] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.016s
W20260709 13:04:36.904973 15075 leader_election.cc:343] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.905462 15301 tablet_bootstrap.cc:654] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.905483 15075 leader_election.cc:304] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6506133b29194d41a950da4450fd512e; no voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:36.906644 15321 raft_consensus.cc:2749] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.907193 15302 raft_consensus.cc:359] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.908059 15302 raft_consensus.cc:385] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.908464 15302 raft_consensus.cc:740] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.909153 15321 raft_consensus.cc:493] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.909657 15321 raft_consensus.cc:515] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.909512 15302 consensus_queue.cc:260] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.911811 15321 leader_election.cc:290] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.912245 15302 ts_tablet_manager.cc:1434] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:36.913336 15302 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:36.913981 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f0506d2e54642b50de2f4bff6736c" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:36.914714 15261 raft_consensus.cc:2468] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:36.915983 15075 leader_election.cc:304] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:36.916868 15321 raft_consensus.cc:2804] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.917245 15321 raft_consensus.cc:493] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.917584 15321 raft_consensus.cc:3060] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.923298 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f0506d2e54642b50de2f4bff6736c" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:36.924180 15187 raft_consensus.cc:2468] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:36.927299 15302 tablet_bootstrap.cc:654] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.929239 15321 raft_consensus.cc:515] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.937721 15301 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:36.938011 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f0506d2e54642b50de2f4bff6736c" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:36.938369 15301 ts_tablet_manager.cc:1403] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.012s
I20260709 13:04:36.939303 15187 raft_consensus.cc:3060] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.940337 15321 leader_election.cc:290] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Requested vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.938211 15010 catalog_manager.cc:5697] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 0 to 1, leader changed from <none> to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 1 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.934890 15336 raft_consensus.cc:515] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.945040 15336 leader_election.cc:290] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:36.945334 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f0506d2e54642b50de2f4bff6736c" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:36.935055 15309 raft_consensus.cc:515] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.945674 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32c07523ff48e38fe095566aeff5db" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:36.947217 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32c07523ff48e38fe095566aeff5db" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:36.947431 15112 raft_consensus.cc:3060] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.947881 15260 raft_consensus.cc:3060] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.954926 15112 raft_consensus.cc:2468] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 1.
I20260709 13:04:36.956668 15152 leader_election.cc:304] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:36.957614 15261 raft_consensus.cc:3060] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.959340 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb1761ef954248bdde85567da93f89" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:36.961730 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb1761ef954248bdde85567da93f89" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:36.962369 15112 raft_consensus.cc:3060] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:36.963806 15224 leader_election.cc:343] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.953649 15187 raft_consensus.cc:2468] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:36.967147 15075 leader_election.cc:304] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:36.968055 15321 raft_consensus.cc:2804] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.968606 15321 raft_consensus.cc:697] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Becoming Leader. State: Replica: 6506133b29194d41a950da4450fd512e, State: Running, Role: LEADER
I20260709 13:04:36.969524 15321 consensus_queue.cc:237] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.970201 15112 raft_consensus.cc:2468] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 1.
I20260709 13:04:36.971513 15226 leader_election.cc:304] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:36.965862 15336 raft_consensus.cc:2804] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.970340 15309 leader_election.cc:290] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:36.979548 15303 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:36.980180 15303 ts_tablet_manager.cc:1403] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.007s
I20260709 13:04:36.978559 15260 raft_consensus.cc:2468] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 1.
I20260709 13:04:36.973872 15336 raft_consensus.cc:697] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 1 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:36.986752 15336 consensus_queue.cc:237] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.987483 15303 raft_consensus.cc:359] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.988483 15303 raft_consensus.cc:385] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.988890 15303 raft_consensus.cc:740] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.985646 15309 raft_consensus.cc:2804] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.990016 15309 raft_consensus.cc:697] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:36.989738 15303 consensus_queue.cc:260] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.991093 15309 consensus_queue.cc:237] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:36.995663 15261 raft_consensus.cc:2468] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:36.999912 15301 raft_consensus.cc:359] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.000650 15301 raft_consensus.cc:385] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.000916 15301 raft_consensus.cc:740] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.001559 15301 consensus_queue.cc:260] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.005333 15007 catalog_manager.cc:5697] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 0 to 1, leader changed from <none> to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 1 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.006428 15303 ts_tablet_manager.cc:1434] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 13:04:37.007536 15303 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:37.009054 15302 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:37.010787 15302 ts_tablet_manager.cc:1403] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.098s	user 0.036s	sys 0.023s
I20260709 13:04:37.010232 15301 ts_tablet_manager.cc:1434] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:04:37.014586 15009 catalog_manager.cc:5697] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:37.014528 15302 raft_consensus.cc:359] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.015561 15301 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:37.016263 15309 raft_consensus.cc:493] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.016782 15309 raft_consensus.cc:515] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.018474 15303 tablet_bootstrap.cc:654] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.019503 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e" is_pre_election: true
I20260709 13:04:37.020172 15112 raft_consensus.cc:2468] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 0.
I20260709 13:04:37.021425 15226 leader_election.cc:304] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:37.022625 15301 tablet_bootstrap.cc:654] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.022941 15302 raft_consensus.cc:385] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.023345 15302 raft_consensus.cc:740] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.023801 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:37.024489 15187 raft_consensus.cc:2468] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 0.
I20260709 13:04:37.024101 15302 consensus_queue.cc:260] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.026707 15347 raft_consensus.cc:2804] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.027422 15302 ts_tablet_manager.cc:1434] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:04:37.028492 15309 leader_election.cc:290] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:37.029486 15347 raft_consensus.cc:493] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.029735 15302 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:37.029808 15303 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:37.030512 15303 ts_tablet_manager.cc:1403] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.009s
I20260709 13:04:37.029954 15347 raft_consensus.cc:3060] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.033407 15303 raft_consensus.cc:359] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.034111 15303 raft_consensus.cc:385] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.034375 15303 raft_consensus.cc:740] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.020371 15010 catalog_manager.cc:5697] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6506133b29194d41a950da4450fd512e (127.6.236.1). New cstate: current_term: 1 leader_uuid: "6506133b29194d41a950da4450fd512e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.038704 15303 consensus_queue.cc:260] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.041013 15303 ts_tablet_manager.cc:1434] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:37.041950 15303 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:37.042896 15301 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: No bootstrap required, opened a new log
I20260709 13:04:37.043320 15302 tablet_bootstrap.cc:654] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.043361 15301 ts_tablet_manager.cc:1403] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 13:04:37.046267 15301 raft_consensus.cc:359] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.046912 15301 raft_consensus.cc:385] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.047230 15301 raft_consensus.cc:740] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.047003 15347 raft_consensus.cc:515] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.048085 15301 consensus_queue.cc:260] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.050411 15301 ts_tablet_manager.cc:1434] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:37.050833 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:37.051249 15347 leader_election.cc:290] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:37.051347 15112 raft_consensus.cc:3060] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.052433 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:37.053097 15187 raft_consensus.cc:3060] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.047047 15303 tablet_bootstrap.cc:654] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.060752 15187 raft_consensus.cc:2468] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 1.
I20260709 13:04:37.062449 15224 leader_election.cc:304] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:37.063591 15302 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:37.064131 15302 ts_tablet_manager.cc:1403] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.011s
I20260709 13:04:37.064178 15347 raft_consensus.cc:2804] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.060598 15112 raft_consensus.cc:2468] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 1.
I20260709 13:04:37.067499 15302 raft_consensus.cc:359] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.068228 15302 raft_consensus.cc:385] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.068495 15302 raft_consensus.cc:740] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.069404 15302 consensus_queue.cc:260] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.071448 15302 ts_tablet_manager.cc:1434] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:37.072624 15302 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece: Bootstrap starting.
I20260709 13:04:37.075519 15303 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:37.076151 15303 ts_tablet_manager.cc:1403] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.003s
I20260709 13:04:37.076257 15347 raft_consensus.cc:697] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:37.077028 15347 consensus_queue.cc:237] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.077613 15302 tablet_bootstrap.cc:654] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.078881 15303 raft_consensus.cc:359] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.079645 15303 raft_consensus.cc:385] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.079908 15303 raft_consensus.cc:740] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.080667 15303 consensus_queue.cc:260] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.082829 15303 ts_tablet_manager.cc:1434] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:37.083783 15303 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8: Bootstrap starting.
I20260709 13:04:37.087917 15302 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece: No bootstrap required, opened a new log
I20260709 13:04:37.088445 15302 ts_tablet_manager.cc:1403] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.001s
I20260709 13:04:37.089213 15303 tablet_bootstrap.cc:654] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.091233 15302 raft_consensus.cc:359] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.091960 15302 raft_consensus.cc:385] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.092263 15302 raft_consensus.cc:740] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.091498 15009 catalog_manager.cc:5697] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:37.092973 15302 consensus_queue.cc:260] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.095706 15302 ts_tablet_manager.cc:1434] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:04:37.100438 15303 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8: No bootstrap required, opened a new log
I20260709 13:04:37.100946 15303 ts_tablet_manager.cc:1403] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:04:37.103572 15303 raft_consensus.cc:359] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.104243 15303 raft_consensus.cc:385] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.104485 15303 raft_consensus.cc:740] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.105120 15303 consensus_queue.cc:260] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.107412 15303 ts_tablet_manager.cc:1434] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:37.111297 15321 raft_consensus.cc:493] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.112003 15321 raft_consensus.cc:515] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.113771 15321 leader_election.cc:290] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:37.114460 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:37.114923 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:37.115118 15187 raft_consensus.cc:2468] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:37.115587 15261 raft_consensus.cc:2468] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:37.116485 15075 leader_election.cc:304] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:37.117137 15321 raft_consensus.cc:2804] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.117413 15321 raft_consensus.cc:493] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.117707 15321 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.122542 15307 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.122473 15321 raft_consensus.cc:515] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.123050 15307 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.124342 15321 leader_election.cc:290] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Requested vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:37.124763 15307 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:37.125085 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:37.125559 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:37.125664 15187 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.126060 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:37.126240 15261 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.126119 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:37.126765 15186 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:37.127138 15260 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:37.128182 15075 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:37.128973 15321 raft_consensus.cc:2804] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.129379 15321 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.129717 15321 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.132618 15187 raft_consensus.cc:2468] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:37.133775 15261 raft_consensus.cc:2468] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:37.133909 15075 leader_election.cc:304] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:37.134831 15307 raft_consensus.cc:2804] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.135370 15321 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.135957 15307 raft_consensus.cc:697] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Becoming Leader. State: Replica: 6506133b29194d41a950da4450fd512e, State: Running, Role: LEADER
I20260709 13:04:37.136765 15307 consensus_queue.cc:237] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.137184 15321 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Requested vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:37.138258 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:37.138332 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:37.138927 15261 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.139045 15187 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.146239 15261 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:37.146579 15187 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:37.146416 15010 catalog_manager.cc:5697] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6506133b29194d41a950da4450fd512e (127.6.236.1). New cstate: current_term: 1 leader_uuid: "6506133b29194d41a950da4450fd512e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.147622 15075 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:37.148392 15307 raft_consensus.cc:2804] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.148792 15307 raft_consensus.cc:697] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Becoming Leader. State: Replica: 6506133b29194d41a950da4450fd512e, State: Running, Role: LEADER
I20260709 13:04:37.149557 15307 consensus_queue.cc:237] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.150913 15321 raft_consensus.cc:493] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.151444 15321 raft_consensus.cc:515] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.153491 15321 leader_election.cc:290] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:37.155155 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:37.155905 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:37.155925 15261 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:37.156798 15187 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:37.157447 15075 leader_election.cc:304] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:37.158221 15321 raft_consensus.cc:2804] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.158581 15321 raft_consensus.cc:493] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.158908 15321 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.163067 15010 catalog_manager.cc:5697] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6506133b29194d41a950da4450fd512e (127.6.236.1). New cstate: current_term: 1 leader_uuid: "6506133b29194d41a950da4450fd512e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.164520 15321 raft_consensus.cc:515] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.166337 15321 leader_election.cc:290] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Requested vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:37.167063 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:37.167279 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:37.167690 15187 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.167824 15261 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.173580 15187 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:37.174624 15075 leader_election.cc:304] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:37.174855 15261 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:37.175333 15321 raft_consensus.cc:2804] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.175741 15321 raft_consensus.cc:697] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Becoming Leader. State: Replica: 6506133b29194d41a950da4450fd512e, State: Running, Role: LEADER
I20260709 13:04:37.176466 15321 consensus_queue.cc:237] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.184083 15010 catalog_manager.cc:5697] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6506133b29194d41a950da4450fd512e (127.6.236.1). New cstate: current_term: 1 leader_uuid: "6506133b29194d41a950da4450fd512e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.330978 15321 raft_consensus.cc:493] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.331429 15321 raft_consensus.cc:515] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.332818 15307 consensus_queue.cc:1048] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.333246 15321 leader_election.cc:290] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:37.334062 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2507735673c74f19834b29dedad54129" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:37.334203 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2507735673c74f19834b29dedad54129" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:37.334828 15187 raft_consensus.cc:2468] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:37.334893 15261 raft_consensus.cc:2468] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 0.
I20260709 13:04:37.336354 15075 leader_election.cc:304] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:37.337769 15307 raft_consensus.cc:2804] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.338166 15307 raft_consensus.cc:493] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.338495 15307 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.342370 15336 consensus_queue.cc:1048] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.346505 15307 raft_consensus.cc:515] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.348783 15321 consensus_queue.cc:1048] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.349802 15307 leader_election.cc:290] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Requested vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:37.351058 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2507735673c74f19834b29dedad54129" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:37.351675 15186 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.352692 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2507735673c74f19834b29dedad54129" candidate_uuid: "6506133b29194d41a950da4450fd512e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:37.353302 15261 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.363647 15321 consensus_queue.cc:1048] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:37.365131 15261 raft_consensus.cc:2468] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:37.367339 15075 leader_election.cc:304] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:37.367743 15308 consensus_queue.cc:1048] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.369235 15186 raft_consensus.cc:2468] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6506133b29194d41a950da4450fd512e in term 1.
I20260709 13:04:37.371239 15321 raft_consensus.cc:2804] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.376125 15321 raft_consensus.cc:697] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Becoming Leader. State: Replica: 6506133b29194d41a950da4450fd512e, State: Running, Role: LEADER
I20260709 13:04:37.377004 15321 consensus_queue.cc:237] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:37.399703 15010 catalog_manager.cc:5697] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6506133b29194d41a950da4450fd512e (127.6.236.1). New cstate: current_term: 1 leader_uuid: "6506133b29194d41a950da4450fd512e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.410037 15321 consensus_queue.cc:1048] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.416884 15187 raft_consensus.cc:3060] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.424427 15347 consensus_queue.cc:1048] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.436966 15345 consensus_queue.cc:1048] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.503852 15308 consensus_queue.cc:1048] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.513811 15375 consensus_queue.cc:1048] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:37.524432 15321 consensus_queue.cc:1048] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.535331 15307 consensus_queue.cc:1048] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.537165 15309 consensus_queue.cc:1048] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.557147 15345 consensus_queue.cc:1048] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.592912 15307 consensus_queue.cc:1048] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.604099 15321 consensus_queue.cc:1048] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.606846 15321 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.623687 15307 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.680888  7088 ts_manager.cc:295] Set tserver state for 6506133b29194d41a950da4450fd512e to MAINTENANCE_MODE
I20260709 13:04:37.681710  7088 tablet_server.cc:179] TabletServer@127.6.236.1:0 shutting down...
I20260709 13:04:37.711395  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:37.712055  7088 tablet_replica.cc:333] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.712723  7088 raft_consensus.cc:2243] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.713584  7088 raft_consensus.cc:2272] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.715996  7088 tablet_replica.cc:333] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.716526  7088 raft_consensus.cc:2243] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.717249  7088 raft_consensus.cc:2272] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.719476  7088 tablet_replica.cc:333] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.719997  7088 raft_consensus.cc:2243] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.720546  7088 pending_rounds.cc:70] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Trying to abort 1 pending ops.
I20260709 13:04:37.720709  7088 pending_rounds.cc:77] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634928182632448 op_type: NO_OP noop_request { }
I20260709 13:04:37.721015  7088 raft_consensus.cc:2889] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:37.721272  7088 raft_consensus.cc:2272] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.723327  7088 tablet_replica.cc:333] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.723866  7088 raft_consensus.cc:2243] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.724622  7088 raft_consensus.cc:2272] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.726680  7088 tablet_replica.cc:333] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.727176  7088 raft_consensus.cc:2243] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.727573  7088 raft_consensus.cc:2272] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.729707  7088 tablet_replica.cc:333] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.730270  7088 raft_consensus.cc:2243] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.730639  7088 raft_consensus.cc:2272] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.732784  7088 tablet_replica.cc:333] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.733331  7088 raft_consensus.cc:2243] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.733711  7088 raft_consensus.cc:2272] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.735873  7088 tablet_replica.cc:333] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.736377  7088 raft_consensus.cc:2243] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.736760  7088 raft_consensus.cc:2272] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.738896  7088 tablet_replica.cc:333] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.739380  7088 raft_consensus.cc:2243] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.740150  7088 raft_consensus.cc:2272] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.742288  7088 tablet_replica.cc:333] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: stopping tablet replica
I20260709 13:04:37.742741  7088 raft_consensus.cc:2243] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.743505  7088 raft_consensus.cc:2272] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:37.748430 15152 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 285 similar messages]
W20260709 13:04:37.751300 15152 consensus_peers.cc:597] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.772583  7088 tablet_server.cc:196] TabletServer@127.6.236.1:0 shutdown complete.
W20260709 13:04:37.798623 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:37.924455 15152 consensus_peers.cc:597] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:38.038429 15226 consensus_peers.cc:597] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:38.073619 15226 consensus_peers.cc:597] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:38.799636 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:38.849243 15375 raft_consensus.cc:493] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:38.849821 15375 raft_consensus.cc:515] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:38.851460 15375 leader_election.cc:290] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031), 6506133b29194d41a950da4450fd512e (127.6.236.1:46799)
I20260709 13:04:38.852334 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
W20260709 13:04:38.854880 15152 leader_election.cc:336] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:38.855209 15152 leader_election.cc:304] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece; no voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:38.855782 15375 raft_consensus.cc:2749] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:38.856693 15309 raft_consensus.cc:493] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:38.857132 15309 raft_consensus.cc:515] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:38.858989 15309 leader_election.cc:290] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 6506133b29194d41a950da4450fd512e (127.6.236.1:46799)
I20260709 13:04:38.859943 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:38.860656 15187 raft_consensus.cc:2468] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 1.
I20260709 13:04:38.861711 15224 leader_election.cc:304] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:38.862524 15309 raft_consensus.cc:2804] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:38.862864 15309 raft_consensus.cc:493] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6506133b29194d41a950da4450fd512e)
W20260709 13:04:38.862989 15226 leader_election.cc:336] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:38.863291 15309 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.869032 15309 raft_consensus.cc:515] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:38.870551 15309 leader_election.cc:290] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Requested vote from peers 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147), 6506133b29194d41a950da4450fd512e (127.6.236.1:46799)
I20260709 13:04:38.871245 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:38.871842 15187 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:38.874383 15226 leader_election.cc:336] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:38.877519 15187 raft_consensus.cc:2468] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 2.
I20260709 13:04:38.878507 15224 leader_election.cc:304] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e
I20260709 13:04:38.879177 15309 raft_consensus.cc:2804] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.879624 15309 raft_consensus.cc:697] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:38.880221 15309 consensus_queue.cc:237] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:38.887274 15007 catalog_manager.cc:5697] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 1 to 2, leader changed from 6506133b29194d41a950da4450fd512e (127.6.236.1) to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.905381 15375 raft_consensus.cc:493] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:38.905948 15375 raft_consensus.cc:515] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:38.908385 15375 leader_election.cc:290] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:38.909873 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f0506d2e54642b50de2f4bff6736c" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
W20260709 13:04:38.912412 15152 leader_election.cc:336] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:38.912758 15152 leader_election.cc:304] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece; no voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:38.913357 15375 raft_consensus.cc:2749] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:38.916759 15309 raft_consensus.cc:493] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:38.917241 15309 raft_consensus.cc:515] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:38.919049 15309 leader_election.cc:290] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:38.920238 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f0506d2e54642b50de2f4bff6736c" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:38.920897 15187 raft_consensus.cc:2468] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 1.
I20260709 13:04:38.921810 15224 leader_election.cc:304] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:38.922499 15309 raft_consensus.cc:2804] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:38.922680 15226 leader_election.cc:336] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:38.922878 15309 raft_consensus.cc:493] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:38.923270 15309 raft_consensus.cc:3060] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.928345 15309 raft_consensus.cc:515] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:38.929937 15309 leader_election.cc:290] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:38.931119 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f0506d2e54642b50de2f4bff6736c" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:38.931752 15187 raft_consensus.cc:3060] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:38.933491 15226 leader_election.cc:336] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:38.937211 15187 raft_consensus.cc:2468] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 2.
I20260709 13:04:38.938222 15224 leader_election.cc:304] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e
I20260709 13:04:38.938853 15309 raft_consensus.cc:2804] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.939236 15309 raft_consensus.cc:697] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:38.939898 15309 consensus_queue.cc:237] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:38.947234 15007 catalog_manager.cc:5697] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 1 to 2, leader changed from 6506133b29194d41a950da4450fd512e (127.6.236.1) to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.033885 15309 raft_consensus.cc:493] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.034433 15309 raft_consensus.cc:515] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.036224 15309 leader_election.cc:290] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:39.037330 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
W20260709 13:04:39.039742 15226 leader_election.cc:336] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.040174 15226 leader_election.cc:304] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:39.040179 15375 raft_consensus.cc:493] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.040782 15309 raft_consensus.cc:2749] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:39.040766 15375 raft_consensus.cc:515] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.042487 15375 leader_election.cc:290] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:39.043577 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:39.044215 15259 raft_consensus.cc:2468] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 1.
I20260709 13:04:39.045173 15150 leader_election.cc:304] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:39.045913 15375 raft_consensus.cc:2804] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:39.046191 15152 leader_election.cc:336] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.046350 15375 raft_consensus.cc:493] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.046830 15375 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.052460 15375 raft_consensus.cc:515] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.054273 15375 leader_election.cc:290] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:39.055239 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:39.055737 15259 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.057773 15152 leader_election.cc:336] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.060957 15259 raft_consensus.cc:2468] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 2.
I20260709 13:04:39.061988 15150 leader_election.cc:304] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e
I20260709 13:04:39.062644 15375 raft_consensus.cc:2804] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.063028 15375 raft_consensus.cc:697] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:39.063717 15375 consensus_queue.cc:237] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.070804 15007 catalog_manager.cc:5697] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 1 to 2, leader changed from 6506133b29194d41a950da4450fd512e (127.6.236.1) to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 2 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.099355 15309 raft_consensus.cc:493] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.099992 15309 raft_consensus.cc:515] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.101686 15309 leader_election.cc:290] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:39.102705 15375 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.102828 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2507735673c74f19834b29dedad54129" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:39.103549 15187 raft_consensus.cc:2468] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 1.
I20260709 13:04:39.103293 15375 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.104537 15224 leader_election.cc:304] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:39.105255 15309 raft_consensus.cc:2804] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:39.105352 15375 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:39.105654 15309 raft_consensus.cc:493] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:39.105655 15226 leader_election.cc:336] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.106125 15309 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.107488 15345 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.107880 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:39.108013 15345 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.110327 15345 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:39.111522 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:39.112164 15187 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 1.
I20260709 13:04:39.113292 15224 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:39.113809 15259 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 1.
I20260709 13:04:39.114427 15345 raft_consensus.cc:2804] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:39.114387 15309 raft_consensus.cc:515] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.115041 15345 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.115437 15345 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.117316 15226 leader_election.cc:336] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.117552 15309 leader_election.cc:290] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:39.117815 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2507735673c74f19834b29dedad54129" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:39.118403 15187 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.120057 15226 leader_election.cc:336] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.121415 15309 raft_consensus.cc:493] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.121948 15309 raft_consensus.cc:515] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.123376 15345 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.124043 15187 raft_consensus.cc:2468] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 2.
W20260709 13:04:39.116704 15152 leader_election.cc:336] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.124541 15309 leader_election.cc:290] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:39.125190 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece" is_pre_election: true
I20260709 13:04:39.126447 15186 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 1.
I20260709 13:04:39.127350 15345 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:39.127437 15224 leader_election.cc:304] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e
I20260709 13:04:39.128007 15150 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e
I20260709 13:04:39.129122 15224 leader_election.cc:304] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:39.129366 15345 raft_consensus.cc:2804] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.128896 15375 raft_consensus.cc:2804] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:39.129815 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:39.129987 15345 raft_consensus.cc:697] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:39.130017 15375 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.130867 15375 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.131173 15309 raft_consensus.cc:2804] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:39.131124 15345 consensus_queue.cc:237] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.131644 15309 raft_consensus.cc:493] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6506133b29194d41a950da4450fd512e)
I20260709 13:04:39.132052 15309 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.129978 15226 leader_election.cc:336] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
W20260709 13:04:39.136909 15226 leader_election.cc:336] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.139088 15007 catalog_manager.cc:5697] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 1 to 2, leader changed from 6506133b29194d41a950da4450fd512e (127.6.236.1) to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.139220 15375 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.140425 15187 raft_consensus.cc:2393] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 81a8fd56615a412295a21e31c7c4e5f8 in current term 2: Already voted for candidate 8095e4d04eb044faa83dd2f65ce64ece in this term.
I20260709 13:04:39.140424 15309 raft_consensus.cc:515] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.142196 15375 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:39.142635 15309 leader_election.cc:290] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:39.144351 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:39.144704 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:39.145226 15259 raft_consensus.cc:2393] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8095e4d04eb044faa83dd2f65ce64ece in current term 2: Already voted for candidate 81a8fd56615a412295a21e31c7c4e5f8 in this term.
I20260709 13:04:39.145305 15187 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.148159 15152 leader_election.cc:336] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.148600 15152 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece; no voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:39.149333 15375 raft_consensus.cc:2749] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:39.150218 15226 leader_election.cc:336] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:39.151073 15224 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:39.151707 15309 raft_consensus.cc:2749] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:39.151767 15187 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 2.
I20260709 13:04:39.153040 15224 leader_election.cc:304] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e
I20260709 13:04:39.153673 15309 raft_consensus.cc:2804] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.154048 15309 raft_consensus.cc:697] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:39.154673 15309 consensus_queue.cc:237] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:39.161549 15007 catalog_manager.cc:5697] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 1 to 2, leader changed from 6506133b29194d41a950da4450fd512e (127.6.236.1) to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:39.284880 15226 consensus_peers.cc:597] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.357023 15187 raft_consensus.cc:1275] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.358235 15309 consensus_queue.cc:1048] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:39.374270 15226 consensus_peers.cc:597] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.485591 15187 raft_consensus.cc:1275] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.486914 15345 consensus_queue.cc:1048] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:39.493532 15259 raft_consensus.cc:1275] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.495775 15375 consensus_queue.cc:1048] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:39.503504 15152 consensus_peers.cc:597] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:39.546955 15226 consensus_peers.cc:597] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.580369 15187 raft_consensus.cc:1275] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:39.581630 15345 consensus_queue.cc:1048] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:39.645465 15226 consensus_peers.cc:597] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.725651 15187 raft_consensus.cc:1275] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.726918 15309 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:39.800609 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:40.211437 15152 consensus_peers.cc:597] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:40.330494 15152 consensus_peers.cc:597] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:40.422689 15226 consensus_peers.cc:597] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:40.502296 15226 consensus_peers.cc:597] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:40.801640 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:41.299556 15375 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.300307 15375 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:41.302479 15375 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:41.303745 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8" is_pre_election: true
I20260709 13:04:41.304680 15259 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 2.
W20260709 13:04:41.305922 15152 leader_election.cc:336] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:41.306541 15150 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e
I20260709 13:04:41.307147 15375 raft_consensus.cc:2804] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:41.307468 15375 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.307713 15375 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:41.315568 15375 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:41.317337 15375 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:41.318459 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:41.319000 15259 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:41.320600 15152 leader_election.cc:336] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111)
I20260709 13:04:41.325691 15259 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 3.
I20260709 13:04:41.326785 15150 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8095e4d04eb044faa83dd2f65ce64ece, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 6506133b29194d41a950da4450fd512e
I20260709 13:04:41.327441 15375 raft_consensus.cc:2804] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:41.328338 15375 raft_consensus.cc:697] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:41.329289 15375 consensus_queue.cc:237] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:41.342921 15007 catalog_manager.cc:5697] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 1 to 3, leader changed from 6506133b29194d41a950da4450fd512e (127.6.236.1) to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 3 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:41.620535 15226 consensus_peers.cc:597] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:41.721042 15152 consensus_peers.cc:597] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:41.802865 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:41.831879 15152 consensus_peers.cc:597] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:41.922479 15259 raft_consensus.cc:1275] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:41.923687 15375 consensus_queue.cc:1048] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:41.966483 15226 consensus_peers.cc:597] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:41.966821 15226 consensus_peers.cc:597] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:42.148733 15226 consensus_peers.cc:597] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:42.456733 15152 consensus_peers.cc:597] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:42.752285 15226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111) [suppressed 97 similar messages]
I20260709 13:04:42.792490  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:42.800233 15418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:42.800316 15419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:42.801934 15421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:42.803125  7088 server_base.cc:1061] running on GCE node
W20260709 13:04:42.803875 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:42.804229  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:42.804493  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:42.804657  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602282804642 us; error 0 us; skew 500 ppm
I20260709 13:04:42.805294  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:42.808185  7088 webserver.cc:533] Webserver started at http://127.6.236.1:40217/ using document root <none> and password file <none>
I20260709 13:04:42.808712  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:42.808902  7088 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:42.812964  7088 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:04:42.817224 15426 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:42.818151  7088 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:42.818567  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "6506133b29194d41a950da4450fd512e"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-j4mc"
I20260709 13:04:42.819062  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:04:42.821177 15152 consensus_peers.cc:597] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:42.833935  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:42.835319  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:42.836772  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:42.840674 15433 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:04:42.891343  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:04:42.891655  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.001s	sys 0.002s
I20260709 13:04:42.891937  7088 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:04:42.897342 15433 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:42.911962 15433 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.912792 15433 tablet_bootstrap.cc:492] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:42.913452 15433 ts_tablet_manager.cc:1403] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:04:42.915705 15433 raft_consensus.cc:359] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:42.916209 15433 raft_consensus.cc:740] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.916793 15433 consensus_queue.cc:260] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:42.919070 15433 ts_tablet_manager.cc:1434] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:04:42.919721 15433 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:42.932440 15433 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.933213 15433 tablet_bootstrap.cc:492] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:42.933807 15433 ts_tablet_manager.cc:1403] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:04:42.934419  7088 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:04:42.935067  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.043s	user 0.040s	sys 0.004s
I20260709 13:04:42.936527 15433 raft_consensus.cc:359] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:42.937107 15433 raft_consensus.cc:740] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.937752 15433 consensus_queue.cc:260] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:42.939353 15433 ts_tablet_manager.cc:1434] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:42.940119 15433 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:42.954957 15433 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.955761 15433 tablet_bootstrap.cc:492] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:42.956488 15433 ts_tablet_manager.cc:1403] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.006s
I20260709 13:04:42.958653 15433 raft_consensus.cc:359] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:42.959259 15433 raft_consensus.cc:740] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.960004 15433 consensus_queue.cc:260] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:42.961494 15433 ts_tablet_manager.cc:1434] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:04:42.962177 15433 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:42.974471 15433 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:42.975322 15433 tablet_bootstrap.cc:492] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:42.975939 15433 ts_tablet_manager.cc:1403] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:04:42.978386 15433 raft_consensus.cc:359] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:42.979326 15433 raft_consensus.cc:740] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.980271 15433 consensus_queue.cc:260] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:42.982605 15433 ts_tablet_manager.cc:1434] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:04:42.983579 15433 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:42.997942 15433 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.998863 15433 tablet_bootstrap.cc:492] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:42.999405 15433 ts_tablet_manager.cc:1403] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:04:43.001650 15433 raft_consensus.cc:359] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.002179 15433 raft_consensus.cc:740] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.002897  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:46799
I20260709 13:04:43.003057 15496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:46799 every 8 connection(s)
I20260709 13:04:43.002843 15433 consensus_queue.cc:260] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.004763 15433 ts_tablet_manager.cc:1434] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:43.005460 15433 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:43.007978  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.023967 15433 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.025053 15433 tablet_bootstrap.cc:492] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:43.025729 15433 ts_tablet_manager.cc:1403] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 13:04:43.028601 15433 raft_consensus.cc:359] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.029318 15433 raft_consensus.cc:740] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.030097 15433 consensus_queue.cc:260] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.032208 15433 ts_tablet_manager.cc:1434] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:43.033099 15433 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:43.033547 15497 heartbeater.cc:344] Connected to a master server at 127.6.236.62:43199
I20260709 13:04:43.034015 15497 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:43.034986 15497 heartbeater.cc:507] Master 127.6.236.62:43199 requested a full tablet report, sending...
I20260709 13:04:43.041934 15007 ts_manager.cc:194] Re-registered known tserver with Master: 6506133b29194d41a950da4450fd512e (127.6.236.1:46799)
I20260709 13:04:43.048429 15433 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.049407 15433 tablet_bootstrap.cc:492] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:43.050128 15433 ts_tablet_manager.cc:1403] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.004s
I20260709 13:04:43.050683 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
mode: GRACEFUL
new_leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:04:43.051462 15260 raft_consensus.cc:606] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Received request to transfer leadership to TS 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:43.052379 15007 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42428
I20260709 13:04:43.052919 15433 raft_consensus.cc:359] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.053620 15433 raft_consensus.cc:740] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.054395 15433 consensus_queue.cc:260] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.054404 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
mode: GRACEFUL
new_leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:04:43.055094 15260 raft_consensus.cc:606] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Received request to transfer leadership to TS 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:43.056028 15497 heartbeater.cc:499] Master 127.6.236.62:43199 was elected leader, sending a full tablet report...
I20260709 13:04:43.056296 15433 ts_tablet_manager.cc:1434] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:04:43.056242  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:43.057135  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:43.057278 15433 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:43.057912  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.081012 15433 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.082157 15433 tablet_bootstrap.cc:492] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:43.082840 15433 ts_tablet_manager.cc:1403] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 13:04:43.085305 15433 raft_consensus.cc:359] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.085983 15433 raft_consensus.cc:740] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.086623 15433 consensus_queue.cc:260] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.088176 15433 ts_tablet_manager.cc:1434] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:43.088943 15433 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:43.095659 15470 raft_consensus.cc:3060] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.102555 15433 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.103564 15433 tablet_bootstrap.cc:492] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:43.104205 15433 ts_tablet_manager.cc:1403] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:04:43.106953 15433 raft_consensus.cc:359] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.107738 15433 raft_consensus.cc:740] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.108662 15433 consensus_queue.cc:260] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.110585 15433 ts_tablet_manager.cc:1434] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:04:43.111389 15433 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Bootstrap starting.
I20260709 13:04:43.123389 15433 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.124218 15433 tablet_bootstrap.cc:492] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Bootstrap complete.
I20260709 13:04:43.124738 15433 ts_tablet_manager.cc:1403] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:04:43.124810 15470 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.126554 15433 raft_consensus.cc:359] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.127110 15433 raft_consensus.cc:740] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6506133b29194d41a950da4450fd512e, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.127708 15433 consensus_queue.cc:260] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.129411 15433 ts_tablet_manager.cc:1434] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:43.130409 15470 pending_rounds.cc:85] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Aborting all ops after (but not including) 0
I20260709 13:04:43.130697 15470 pending_rounds.cc:107] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:43.130977 15470 raft_consensus.cc:2889] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:43.138047 15470 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.167418 15345 raft_consensus.cc:993] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8: : Instructing follower 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:43.167948 15479 raft_consensus.cc:1081] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Signalling peer 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:43.169489 15187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:60980
I20260709 13:04:43.170055 15187 raft_consensus.cc:493] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.170398 15187 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.175707 15187 raft_consensus.cc:515] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.177104 15187 leader_election.cc:290] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:43.178107 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:43.178128 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:43.178679 15260 raft_consensus.cc:3055] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.178794 15470 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.178972 15260 raft_consensus.cc:740] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:43.179780 15260 consensus_queue.cc:260] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.180927 15260 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.185092 15470 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 3.
I20260709 13:04:43.186259 15152 leader_election.cc:304] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:43.186952 15375 raft_consensus.cc:2804] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.187261 15260 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 3.
I20260709 13:04:43.187345 15375 raft_consensus.cc:697] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:43.188540 15375 consensus_queue.cc:237] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:43.194962 15007 catalog_manager.cc:5697] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 2 to 3, leader changed from 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3) to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 3 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.208657 15470 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.347472 15470 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.458721 15345 raft_consensus.cc:993] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8: : Instructing follower 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:43.459190 15479 raft_consensus.cc:1081] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Signalling peer 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:43.460588 15187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:60980
I20260709 13:04:43.461087 15187 raft_consensus.cc:493] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.461336 15187 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.465778 15187 raft_consensus.cc:515] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:43.467255 15187 leader_election.cc:290] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: Requested vote from peers 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031), 6506133b29194d41a950da4450fd512e (127.6.236.1:46799)
I20260709 13:04:43.468104 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:43.468372 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7994e4e643e4514a8efe762bce940e2" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:43.468680 15260 raft_consensus.cc:3055] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.468897 15470 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.469167 15260 raft_consensus.cc:740] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:43.470065 15260 consensus_queue.cc:260] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:43.471143 15260 raft_consensus.cc:3060] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.474517 15470 raft_consensus.cc:2468] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 3.
I20260709 13:04:43.475639 15152 leader_election.cc:304] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:43.476315 15375 raft_consensus.cc:2804] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.476691 15375 raft_consensus.cc:697] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:43.478384 15260 raft_consensus.cc:2468] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 3.
I20260709 13:04:43.477658 15375 consensus_queue.cc:237] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } }
I20260709 13:04:43.489550 15007 catalog_manager.cc:5697] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 2 to 3, leader changed from 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3) to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 3 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.584295 15260 raft_consensus.cc:1275] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:43.585650 15414 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:43.596339 15470 raft_consensus.cc:1275] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:43.597998 15414 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:43.804740 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:43.978001 15470 raft_consensus.cc:1275] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:43.979444 15414 consensus_queue.cc:1048] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:43.986469 15260 raft_consensus.cc:1275] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:43.988802 15375 consensus_queue.cc:1048] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.067559  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:44.083997 15187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
mode: GRACEFUL
new_leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
 from {username='slave'} at 127.0.0.1:57818
I20260709 13:04:44.084470 15187 raft_consensus.cc:606] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Received request to transfer leadership to TS 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:44.086977 15187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
mode: GRACEFUL
new_leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
 from {username='slave'} at 127.0.0.1:57818
I20260709 13:04:44.087442 15187 raft_consensus.cc:606] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Received request to transfer leadership to TS 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:44.088373  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:44.088832  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:44.089408  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:44.166735 15375 raft_consensus.cc:993] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece: : Instructing follower 81a8fd56615a412295a21e31c7c4e5f8 to start an election
I20260709 13:04:44.167240 15414 raft_consensus.cc:1081] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Signalling peer 81a8fd56615a412295a21e31c7c4e5f8 to start an election
I20260709 13:04:44.168691 15260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
 from {username='slave'} at 127.0.0.1:59898
I20260709 13:04:44.169166 15260 raft_consensus.cc:493] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.169497 15260 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.174615 15260 raft_consensus.cc:515] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:44.176205 15260 leader_election.cc:290] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 4 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:44.177042 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:44.177224 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:44.177713 15470 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.177762 15187 raft_consensus.cc:3055] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:44.178215 15187 raft_consensus.cc:740] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:44.178949 15187 consensus_queue.cc:260] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:44.180109 15187 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.184808 15470 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 4.
I20260709 13:04:44.185969 15226 leader_election.cc:304] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:44.186645 15187 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 4.
I20260709 13:04:44.186753 15345 raft_consensus.cc:2804] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:44.187340 15345 raft_consensus.cc:697] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:44.188138 15345 consensus_queue.cc:237] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:44.194106 15010 catalog_manager.cc:5697] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 3 to 4, leader changed from 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2) to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 4 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.454054 15375 raft_consensus.cc:993] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece: : Instructing follower 81a8fd56615a412295a21e31c7c4e5f8 to start an election
I20260709 13:04:44.454561 15414 raft_consensus.cc:1081] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Signalling peer 81a8fd56615a412295a21e31c7c4e5f8 to start an election
I20260709 13:04:44.455892 15260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
 from {username='slave'} at 127.0.0.1:59898
I20260709 13:04:44.456341 15260 raft_consensus.cc:493] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.456625 15260 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.461620 15260 raft_consensus.cc:515] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:44.463289 15260 leader_election.cc:290] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 4 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:44.464172 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:44.464241 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bd6ac1f01a468c994430980794c8e9" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:44.464735 15470 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.464807 15187 raft_consensus.cc:3055] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:44.465139 15187 raft_consensus.cc:740] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:44.465685 15187 consensus_queue.cc:260] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:44.466557 15187 raft_consensus.cc:3060] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.470942 15470 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 4.
I20260709 13:04:44.472178 15226 leader_election.cc:304] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:44.472222 15187 raft_consensus.cc:2468] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 4.
I20260709 13:04:44.473050 15345 raft_consensus.cc:2804] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:44.473541 15345 raft_consensus.cc:697] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:44.474529 15345 consensus_queue.cc:237] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:44.481132 15010 catalog_manager.cc:5697] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 3 to 4, leader changed from 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2) to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 4 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.661134 15470 raft_consensus.cc:1275] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 4 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:44.662449 15345 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:44.672895 15187 raft_consensus.cc:1275] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 4 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:44.674392 15538 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:44.805702 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:44.922870 15470 raft_consensus.cc:1275] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 4 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:44.924191 15345 consensus_queue.cc:1048] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.932437 15187 raft_consensus.cc:1275] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 4 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:44.934296 15538 consensus_queue.cc:1048] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:45.095533  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.102730 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dbb1761ef954248bdde85567da93f89"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
mode: GRACEFUL
new_leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:04:45.103255 15260 raft_consensus.cc:606] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Received request to transfer leadership to TS 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:45.105774 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
mode: GRACEFUL
new_leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:04:45.106276 15260 raft_consensus.cc:606] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 LEADER]: Received request to transfer leadership to TS 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:45.107335  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:45.107875  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:45.108469  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.199410 15521 raft_consensus.cc:993] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8: : Instructing follower 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:45.199983 15538 raft_consensus.cc:1081] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 LEADER]: Signalling peer 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:45.201388 15187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:60980
I20260709 13:04:45.201808 15187 raft_consensus.cc:493] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.202114 15187 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:45.206466 15187 raft_consensus.cc:515] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:45.207845 15187 leader_election.cc:290] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 5 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:45.208647 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:45.208782 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ec9f19d24e4ea19194835e45c909a2" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:45.209389 15470 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:45.209442 15260 raft_consensus.cc:3055] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:45.209867 15260 raft_consensus.cc:740] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:45.210731 15260 consensus_queue.cc:260] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:45.212016 15260 raft_consensus.cc:3060] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:45.216583 15470 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 5.
I20260709 13:04:45.217761 15152 leader_election.cc:304] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:45.218428 15414 raft_consensus.cc:2804] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:45.218462 15260 raft_consensus.cc:2468] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 5.
I20260709 13:04:45.219450 15414 raft_consensus.cc:697] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 5 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:45.220199 15414 consensus_queue.cc:237] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:45.226135 15010 catalog_manager.cc:5697] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 4 to 5, leader changed from 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3) to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 5 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.300410 15521 raft_consensus.cc:993] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8: : Instructing follower 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:45.300849 15538 raft_consensus.cc:1081] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Signalling peer 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:45.302196 15187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dbb1761ef954248bdde85567da93f89"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:60980
I20260709 13:04:45.302589 15187 raft_consensus.cc:493] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.302838 15187 raft_consensus.cc:3060] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.307018 15187 raft_consensus.cc:515] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:45.308441 15187 leader_election.cc:290] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:45.309192 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb1761ef954248bdde85567da93f89" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:45.309367 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb1761ef954248bdde85567da93f89" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:45.309953 15470 raft_consensus.cc:3060] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.310104 15260 raft_consensus.cc:3055] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.310527 15260 raft_consensus.cc:740] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:45.311479 15260 consensus_queue.cc:260] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:45.312817 15260 raft_consensus.cc:3060] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.317152 15470 raft_consensus.cc:2468] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 2.
I20260709 13:04:45.318286 15152 leader_election.cc:304] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:45.318949 15414 raft_consensus.cc:2804] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.319271 15260 raft_consensus.cc:2468] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 2.
I20260709 13:04:45.319353 15414 raft_consensus.cc:697] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:45.320328 15414 consensus_queue.cc:237] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:45.327358 15010 catalog_manager.cc:5697] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 1 to 2, leader changed from 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3) to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 2 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.611579 15470 raft_consensus.cc:1275] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 5 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:45.612885 15414 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:45.623260 15260 raft_consensus.cc:1275] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 5 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:45.624497 15551 consensus_queue.cc:1048] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:04:45.806725 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:45.811389 15260 raft_consensus.cc:1275] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.812644 15551 consensus_queue.cc:1048] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:45.824515 15470 raft_consensus.cc:1275] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.826201 15414 consensus_queue.cc:1048] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:46.115381  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.122493 15186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2369acf4d806439a97293f6fae739cd7"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
mode: GRACEFUL
new_leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
 from {username='slave'} at 127.0.0.1:57818
I20260709 13:04:46.123005 15186 raft_consensus.cc:606] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 LEADER]: Received request to transfer leadership to TS 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:46.125422 15186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
mode: GRACEFUL
new_leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
 from {username='slave'} at 127.0.0.1:57818
I20260709 13:04:46.125865 15186 raft_consensus.cc:606] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Received request to transfer leadership to TS 81a8fd56615a412295a21e31c7c4e5f8
I20260709 13:04:46.126853  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:46.127300  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:46.127802  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.321606 15551 raft_consensus.cc:993] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece: : Instructing follower 81a8fd56615a412295a21e31c7c4e5f8 to start an election
I20260709 13:04:46.322155 15414 raft_consensus.cc:1081] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Signalling peer 81a8fd56615a412295a21e31c7c4e5f8 to start an election
I20260709 13:04:46.323792 15260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
 from {username='slave'} at 127.0.0.1:59898
I20260709 13:04:46.324271 15260 raft_consensus.cc:493] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.324579 15260 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.329737 15260 raft_consensus.cc:515] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:46.331575 15260 leader_election.cc:290] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 3 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:46.332254 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:46.332495 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69765c5abe14043b1090cc869ffe751" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:46.332829 15470 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.333060 15186 raft_consensus.cc:3055] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:46.333365 15186 raft_consensus.cc:740] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:46.334043 15186 consensus_queue.cc:260] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:46.335117 15186 raft_consensus.cc:3060] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.337757 15470 raft_consensus.cc:2468] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 3.
I20260709 13:04:46.339046 15226 leader_election.cc:304] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:46.339794 15556 raft_consensus.cc:2804] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.340161 15556 raft_consensus.cc:697] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:46.340983 15556 consensus_queue.cc:237] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:46.341218 15186 raft_consensus.cc:2468] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 3.
I20260709 13:04:46.347688 15010 catalog_manager.cc:5697] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 2 to 3, leader changed from 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2) to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.356312 15551 raft_consensus.cc:993] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece: : Instructing follower 81a8fd56615a412295a21e31c7c4e5f8 to start an election
I20260709 13:04:46.356799 15551 raft_consensus.cc:1081] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 LEADER]: Signalling peer 81a8fd56615a412295a21e31c7c4e5f8 to start an election
I20260709 13:04:46.358292 15260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2369acf4d806439a97293f6fae739cd7"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
 from {username='slave'} at 127.0.0.1:59898
I20260709 13:04:46.358776 15260 raft_consensus.cc:493] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.359062 15260 raft_consensus.cc:3060] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.363843 15260 raft_consensus.cc:515] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:46.365356 15260 leader_election.cc:290] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147)
I20260709 13:04:46.366231 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369acf4d806439a97293f6fae739cd7" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:46.366381 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369acf4d806439a97293f6fae739cd7" candidate_uuid: "81a8fd56615a412295a21e31c7c4e5f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
I20260709 13:04:46.366911 15470 raft_consensus.cc:3060] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.366977 15186 raft_consensus.cc:3055] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:46.367421 15186 raft_consensus.cc:740] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:46.368223 15186 consensus_queue.cc:260] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:46.369547 15186 raft_consensus.cc:3060] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.373637 15470 raft_consensus.cc:2468] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 2.
I20260709 13:04:46.374891 15226 leader_election.cc:304] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 81a8fd56615a412295a21e31c7c4e5f8; no voters: 
I20260709 13:04:46.375550 15556 raft_consensus.cc:2804] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.376025 15556 raft_consensus.cc:697] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Becoming Leader. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:46.376039 15186 raft_consensus.cc:2468] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81a8fd56615a412295a21e31c7c4e5f8 in term 2.
I20260709 13:04:46.377013 15556 consensus_queue.cc:237] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:46.384040 15010 catalog_manager.cc:5697] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 reported cstate change: term changed from 1 to 2, leader changed from 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2) to 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "81a8fd56615a412295a21e31c7c4e5f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.792675 15470 raft_consensus.cc:1275] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.793846 15556 consensus_queue.cc:1048] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.803274 15186 raft_consensus.cc:1275] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.804903 15556 consensus_queue.cc:1048] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:46.807934 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:46.919967 15470 raft_consensus.cc:1275] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.921336 15566 consensus_queue.cc:1048] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:46.932605 15186 raft_consensus.cc:1275] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Refusing update from remote peer 81a8fd56615a412295a21e31c7c4e5f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.933959 15571 consensus_queue.cc:1048] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.134055  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:47.141106 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2507735673c74f19834b29dedad54129"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
mode: GRACEFUL
new_leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:04:47.141616 15260 raft_consensus.cc:606] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Received request to transfer leadership to TS 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:47.144110 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34"
dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
mode: GRACEFUL
new_leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:35736
I20260709 13:04:47.144564 15260 raft_consensus.cc:606] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Received request to transfer leadership to TS 8095e4d04eb044faa83dd2f65ce64ece
I20260709 13:04:47.145622  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:47.146111  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:47.146646  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:47.444640 15538 raft_consensus.cc:993] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8: : Instructing follower 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:47.445070 15571 raft_consensus.cc:1081] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Signalling peer 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:47.446564 15186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2507735673c74f19834b29dedad54129"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:60980
I20260709 13:04:47.447184 15186 raft_consensus.cc:493] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.447482 15186 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.452733 15186 raft_consensus.cc:515] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:47.454433 15186 leader_election.cc:290] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:47.455104 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2507735673c74f19834b29dedad54129" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:47.455303 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2507735673c74f19834b29dedad54129" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:47.455734 15470 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.455834 15260 raft_consensus.cc:3055] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:47.456208 15260 raft_consensus.cc:740] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:47.456825 15260 consensus_queue.cc:260] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:47.457679 15260 raft_consensus.cc:3060] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.461265 15470 raft_consensus.cc:2468] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 3.
I20260709 13:04:47.462400 15152 leader_election.cc:304] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:47.462617 15260 raft_consensus.cc:2468] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 3.
I20260709 13:04:47.463102 15414 raft_consensus.cc:2804] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:47.464167 15414 raft_consensus.cc:697] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:47.465135 15414 consensus_queue.cc:237] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:47.472676 15010 catalog_manager.cc:5697] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 2 to 3, leader changed from 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3) to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 3 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.630455 15538 raft_consensus.cc:993] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8: : Instructing follower 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:47.630892 15571 raft_consensus.cc:1081] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Signalling peer 8095e4d04eb044faa83dd2f65ce64ece to start an election
I20260709 13:04:47.632289 15186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34"
dest_uuid: "8095e4d04eb044faa83dd2f65ce64ece"
 from {username='slave'} at 127.0.0.1:60980
I20260709 13:04:47.632769 15186 raft_consensus.cc:493] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.633097 15186 raft_consensus.cc:3060] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.638026 15186 raft_consensus.cc:515] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:47.639720 15186 leader_election.cc:290] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: Requested vote from peers 6506133b29194d41a950da4450fd512e (127.6.236.1:46799), 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3:46031)
I20260709 13:04:47.640620 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6506133b29194d41a950da4450fd512e"
I20260709 13:04:47.640952 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905435f46f1947fd81bc08cc528d4b34" candidate_uuid: "8095e4d04eb044faa83dd2f65ce64ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81a8fd56615a412295a21e31c7c4e5f8"
I20260709 13:04:47.641233 15470 raft_consensus.cc:3060] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.641719 15260 raft_consensus.cc:3055] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.642046 15260 raft_consensus.cc:740] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81a8fd56615a412295a21e31c7c4e5f8, State: Running, Role: LEADER
I20260709 13:04:47.642804 15260 consensus_queue.cc:260] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:47.643723 15260 raft_consensus.cc:3060] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.646247 15470 raft_consensus.cc:2468] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 2.
I20260709 13:04:47.647228 15152 leader_election.cc:304] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6506133b29194d41a950da4450fd512e, 8095e4d04eb044faa83dd2f65ce64ece; no voters: 
I20260709 13:04:47.647854 15260 raft_consensus.cc:2468] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8095e4d04eb044faa83dd2f65ce64ece in term 2.
I20260709 13:04:47.648109 15414 raft_consensus.cc:2804] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:47.648626 15414 raft_consensus.cc:697] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Becoming Leader. State: Replica: 8095e4d04eb044faa83dd2f65ce64ece, State: Running, Role: LEADER
I20260709 13:04:47.649452 15414 consensus_queue.cc:237] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } }
I20260709 13:04:47.655925 15010 catalog_manager.cc:5697] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece reported cstate change: term changed from 1 to 2, leader changed from 81a8fd56615a412295a21e31c7c4e5f8 (127.6.236.3) to 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2). New cstate: current_term: 2 leader_uuid: "8095e4d04eb044faa83dd2f65ce64ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8095e4d04eb044faa83dd2f65ce64ece" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:47.808936 15058 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:47.907445 15260 raft_consensus.cc:1275] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:47.908809 15414 consensus_queue.cc:1048] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.917968 15470 raft_consensus.cc:1275] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:47.919495 15414 consensus_queue.cc:1048] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6506133b29194d41a950da4450fd512e" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.152598  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:48.180982  7088 tablet_server.cc:179] TabletServer@127.6.236.1:46799 shutting down...
W20260709 13:04:48.190310 15152 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:04:48.193131 15152 consensus_peers.cc:597] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.200654  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:48.201339  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.201906  7088 raft_consensus.cc:2243] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.202358  7088 raft_consensus.cc:2272] T 2369acf4d806439a97293f6fae739cd7 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.204214  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.204741  7088 raft_consensus.cc:2243] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.205171  7088 raft_consensus.cc:2272] T 58ec9f19d24e4ea19194835e45c909a2 P 6506133b29194d41a950da4450fd512e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.206921  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.207414  7088 raft_consensus.cc:2243] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.207785  7088 raft_consensus.cc:2272] T c69765c5abe14043b1090cc869ffe751 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.209554  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.210027  7088 raft_consensus.cc:2243] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.210440  7088 raft_consensus.cc:2272] T 0dbb1761ef954248bdde85567da93f89 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.212212  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.212688  7088 raft_consensus.cc:2243] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.213017  7088 raft_consensus.cc:2272] T 905435f46f1947fd81bc08cc528d4b34 P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.214754  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.215289  7088 raft_consensus.cc:2243] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.215682  7088 raft_consensus.cc:2272] T 2507735673c74f19834b29dedad54129 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.217882  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.218415  7088 raft_consensus.cc:2243] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.218803  7088 raft_consensus.cc:2272] T b97f0506d2e54642b50de2f4bff6736c P 6506133b29194d41a950da4450fd512e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.220507  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.221020  7088 raft_consensus.cc:2243] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.221402  7088 raft_consensus.cc:2272] T a6bd6ac1f01a468c994430980794c8e9 P 6506133b29194d41a950da4450fd512e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.223153  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.223584  7088 raft_consensus.cc:2243] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.223933  7088 raft_consensus.cc:2272] T b7994e4e643e4514a8efe762bce940e2 P 6506133b29194d41a950da4450fd512e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.225775  7088 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:48.226373  7088 raft_consensus.cc:2243] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.226794  7088 raft_consensus.cc:2272] T 1e32c07523ff48e38fe095566aeff5db P 6506133b29194d41a950da4450fd512e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.232219 15260 raft_consensus.cc:1275] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Refusing update from remote peer 8095e4d04eb044faa83dd2f65ce64ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.233573 15414 consensus_queue.cc:1048] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a8fd56615a412295a21e31c7c4e5f8" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.249454  7088 tablet_server.cc:196] TabletServer@127.6.236.1:46799 shutdown complete.
I20260709 13:04:48.268146  7088 tablet_server.cc:179] TabletServer@127.6.236.2:0 shutting down...
I20260709 13:04:48.287803  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:48.288591  7088 tablet_replica.cc:333] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.289254  7088 raft_consensus.cc:2243] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.290019  7088 raft_consensus.cc:2272] T 0dbb1761ef954248bdde85567da93f89 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.292335  7088 tablet_replica.cc:333] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.292954  7088 raft_consensus.cc:2243] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.293746  7088 raft_consensus.cc:2272] T 905435f46f1947fd81bc08cc528d4b34 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.296283  7088 tablet_replica.cc:333] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.296813  7088 raft_consensus.cc:2243] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.297606  7088 raft_consensus.cc:2272] T 58ec9f19d24e4ea19194835e45c909a2 P 8095e4d04eb044faa83dd2f65ce64ece [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.299937  7088 tablet_replica.cc:333] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.300500  7088 raft_consensus.cc:2243] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.300909  7088 raft_consensus.cc:2272] T 2369acf4d806439a97293f6fae739cd7 P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.302932  7088 tablet_replica.cc:333] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.303428  7088 raft_consensus.cc:2243] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.304210  7088 raft_consensus.cc:2272] T 1e32c07523ff48e38fe095566aeff5db P 8095e4d04eb044faa83dd2f65ce64ece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.306241  7088 tablet_replica.cc:333] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.306732  7088 raft_consensus.cc:2243] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.307128  7088 raft_consensus.cc:2272] T c69765c5abe14043b1090cc869ffe751 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.309444  7088 tablet_replica.cc:333] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.310216  7088 raft_consensus.cc:2243] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.311039  7088 raft_consensus.cc:2272] T 2507735673c74f19834b29dedad54129 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.313715  7088 tablet_replica.cc:333] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
W20260709 13:04:48.314307 15226 consensus_peers.cc:597] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.314438  7088 raft_consensus.cc:2243] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.315078  7088 raft_consensus.cc:2272] T b97f0506d2e54642b50de2f4bff6736c P 8095e4d04eb044faa83dd2f65ce64ece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.317338  7088 tablet_replica.cc:333] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.317983  7088 raft_consensus.cc:2243] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.318545  7088 raft_consensus.cc:2272] T a6bd6ac1f01a468c994430980794c8e9 P 8095e4d04eb044faa83dd2f65ce64ece [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.321332  7088 tablet_replica.cc:333] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece: stopping tablet replica
I20260709 13:04:48.321836  7088 raft_consensus.cc:2243] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.322784  7088 raft_consensus.cc:2272] T b7994e4e643e4514a8efe762bce940e2 P 8095e4d04eb044faa83dd2f65ce64ece [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:48.322949 15226 consensus_peers.cc:597] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 6506133b29194d41a950da4450fd512e (127.6.236.1:46799): Couldn't send request to peer 6506133b29194d41a950da4450fd512e. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.355374  7088 tablet_server.cc:196] TabletServer@127.6.236.2:0 shutdown complete.
W20260709 13:04:48.376189 15224 consensus_peers.cc:597] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147): Couldn't send request to peer 8095e4d04eb044faa83dd2f65ce64ece. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:42147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.381218  7088 tablet_server.cc:179] TabletServer@127.6.236.3:0 shutting down...
W20260709 13:04:48.384199 15224 consensus_peers.cc:597] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147): Couldn't send request to peer 8095e4d04eb044faa83dd2f65ce64ece. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:42147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:48.408293 15224 consensus_peers.cc:597] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 -> Peer 8095e4d04eb044faa83dd2f65ce64ece (127.6.236.2:42147): Couldn't send request to peer 8095e4d04eb044faa83dd2f65ce64ece. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:42147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.411599  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:48.412324  7088 tablet_replica.cc:333] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.413023  7088 raft_consensus.cc:2243] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.413839  7088 raft_consensus.cc:2272] T c69765c5abe14043b1090cc869ffe751 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.416038  7088 tablet_replica.cc:333] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.416605  7088 raft_consensus.cc:2243] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.417353  7088 raft_consensus.cc:2272] T 2369acf4d806439a97293f6fae739cd7 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.419502  7088 tablet_replica.cc:333] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.420034  7088 raft_consensus.cc:2243] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.420475  7088 raft_consensus.cc:2272] T 1e32c07523ff48e38fe095566aeff5db P 81a8fd56615a412295a21e31c7c4e5f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.422784  7088 tablet_replica.cc:333] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.423252  7088 raft_consensus.cc:2243] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.423607  7088 raft_consensus.cc:2272] T 2507735673c74f19834b29dedad54129 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.426177  7088 tablet_replica.cc:333] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.426694  7088 raft_consensus.cc:2243] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.427428  7088 raft_consensus.cc:2272] T b97f0506d2e54642b50de2f4bff6736c P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.429379  7088 tablet_replica.cc:333] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.429970  7088 raft_consensus.cc:2243] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.430794  7088 raft_consensus.cc:2272] T a6bd6ac1f01a468c994430980794c8e9 P 81a8fd56615a412295a21e31c7c4e5f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.432787  7088 tablet_replica.cc:333] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.433352  7088 raft_consensus.cc:2243] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.433729  7088 raft_consensus.cc:2272] T b7994e4e643e4514a8efe762bce940e2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.435804  7088 tablet_replica.cc:333] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.436244  7088 raft_consensus.cc:2243] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.436589  7088 raft_consensus.cc:2272] T 905435f46f1947fd81bc08cc528d4b34 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.439004  7088 tablet_replica.cc:333] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.439467  7088 raft_consensus.cc:2243] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.439836  7088 raft_consensus.cc:2272] T 0dbb1761ef954248bdde85567da93f89 P 81a8fd56615a412295a21e31c7c4e5f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.441660  7088 tablet_replica.cc:333] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8: stopping tablet replica
I20260709 13:04:48.442103  7088 raft_consensus.cc:2243] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.442466  7088 raft_consensus.cc:2272] T 58ec9f19d24e4ea19194835e45c909a2 P 81a8fd56615a412295a21e31c7c4e5f8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.471509  7088 tablet_server.cc:196] TabletServer@127.6.236.3:0 shutdown complete.
I20260709 13:04:48.494346  7088 master.cc:562] Master@127.6.236.62:43199 shutting down...
I20260709 13:04:48.515477  7088 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.516002  7088 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.516307  7088 tablet_replica.cc:333] T 00000000000000000000000000000000 P 858a75791f8b41f895cf41d6bc2d1e9e: stopping tablet replica
I20260709 13:04:48.535893  7088 master.cc:584] Master@127.6.236.62:43199 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12922 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:04:48.577347  7088 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.236.62:36921
I20260709 13:04:48.578492  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:48.583863 15594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:48.583858 15593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:48.584539 15596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:48.585366  7088 server_base.cc:1061] running on GCE node
I20260709 13:04:48.586265  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:48.586440  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:48.586594  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602288586578 us; error 0 us; skew 500 ppm
I20260709 13:04:48.587136  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:48.589514  7088 webserver.cc:533] Webserver started at http://127.6.236.62:45417/ using document root <none> and password file <none>
I20260709 13:04:48.589986  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:48.590453  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:48.590728  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:48.591775  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/master-0-root/instance:
uuid: "57f55bf945cc4661b930141950410909"
format_stamp: "Formatted at 2026-07-09 13:04:48 on dist-test-slave-j4mc"
I20260709 13:04:48.596101  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:04:48.599849 15601 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:48.600714  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:48.600973  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/master-0-root
uuid: "57f55bf945cc4661b930141950410909"
format_stamp: "Formatted at 2026-07-09 13:04:48 on dist-test-slave-j4mc"
I20260709 13:04:48.601257  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:48.615897  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:48.617084  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:48.657809  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.62:36921
I20260709 13:04:48.657935 15652 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.62:36921 every 8 connection(s)
I20260709 13:04:48.661638 15653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.672524 15653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909: Bootstrap starting.
I20260709 13:04:48.677191 15653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.681334 15653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909: No bootstrap required, opened a new log
I20260709 13:04:48.683481 15653 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f55bf945cc4661b930141950410909" member_type: VOTER }
I20260709 13:04:48.683844 15653 raft_consensus.cc:385] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.684020 15653 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f55bf945cc4661b930141950410909, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.684543 15653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f55bf945cc4661b930141950410909" member_type: VOTER }
I20260709 13:04:48.684935 15653 raft_consensus.cc:399] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:48.685123 15653 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:48.685321 15653 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.689894 15653 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f55bf945cc4661b930141950410909" member_type: VOTER }
I20260709 13:04:48.690394 15653 leader_election.cc:304] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57f55bf945cc4661b930141950410909; no voters: 
I20260709 13:04:48.691696 15653 leader_election.cc:290] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:48.691866 15656 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.693459 15656 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 1 LEADER]: Becoming Leader. State: Replica: 57f55bf945cc4661b930141950410909, State: Running, Role: LEADER
I20260709 13:04:48.694151 15656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f55bf945cc4661b930141950410909" member_type: VOTER }
I20260709 13:04:48.695017 15653 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:48.698442 15658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57f55bf945cc4661b930141950410909. Latest consensus state: current_term: 1 leader_uuid: "57f55bf945cc4661b930141950410909" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f55bf945cc4661b930141950410909" member_type: VOTER } }
I20260709 13:04:48.698323 15657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57f55bf945cc4661b930141950410909" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f55bf945cc4661b930141950410909" member_type: VOTER } }
I20260709 13:04:48.699599 15658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:48.699795 15657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:48.707948 15662 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:48.713246 15662 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:48.714263  7088 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:48.722057 15662 catalog_manager.cc:1383] Generated new cluster ID: ebc687146bbd4574bde85645917a9f29
I20260709 13:04:48.722450 15662 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:48.744776 15662 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:48.746055 15662 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:48.762488 15662 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909: Generated new TSK 0
I20260709 13:04:48.763166 15662 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:48.781267  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:48.787569 15674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:48.788326 15675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:48.791723  7088 server_base.cc:1061] running on GCE node
W20260709 13:04:48.791826 15677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:48.792927  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:48.793121  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:48.793243  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602288793232 us; error 0 us; skew 500 ppm
I20260709 13:04:48.793710  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:48.796103  7088 webserver.cc:533] Webserver started at http://127.6.236.1:37701/ using document root <none> and password file <none>
I20260709 13:04:48.796540  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:48.796715  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:48.796986  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:48.798223  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-0-root/instance:
uuid: "c1aa34caab9b438987f76495593b07f8"
format_stamp: "Formatted at 2026-07-09 13:04:48 on dist-test-slave-j4mc"
I20260709 13:04:48.802922  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:04:48.806409 15682 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:48.807276  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:48.807576  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "c1aa34caab9b438987f76495593b07f8"
format_stamp: "Formatted at 2026-07-09 13:04:48 on dist-test-slave-j4mc"
I20260709 13:04:48.807854  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:48.820609  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:48.821743  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:48.823199  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:48.825343  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:48.825565  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:48.825773  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:48.825917  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:48.864400  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:44693
I20260709 13:04:48.864498 15744 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:44693 every 8 connection(s)
I20260709 13:04:48.869077  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:48.875619 15749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:48.877202 15750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:48.878880 15752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:48.879716  7088 server_base.cc:1061] running on GCE node
I20260709 13:04:48.880681  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:48.880935  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:48.881134  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602288881115 us; error 0 us; skew 500 ppm
I20260709 13:04:48.881728  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:48.881937 15745 heartbeater.cc:344] Connected to a master server at 127.6.236.62:36921
I20260709 13:04:48.882375 15745 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:48.883265 15745 heartbeater.cc:507] Master 127.6.236.62:36921 requested a full tablet report, sending...
I20260709 13:04:48.884418  7088 webserver.cc:533] Webserver started at http://127.6.236.2:44395/ using document root <none> and password file <none>
I20260709 13:04:48.885032  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:48.885206  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:48.885449  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:48.885603 15618 ts_manager.cc:194] Registered new tserver with Master: c1aa34caab9b438987f76495593b07f8 (127.6.236.1:44693)
I20260709 13:04:48.886586  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-1-root/instance:
uuid: "95c6dba187af4db285616ddf29bf48ca"
format_stamp: "Formatted at 2026-07-09 13:04:48 on dist-test-slave-j4mc"
I20260709 13:04:48.887508 15618 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45520
I20260709 13:04:48.891655  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:48.894999 15757 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:48.895737  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:48.895999  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-1-root
uuid: "95c6dba187af4db285616ddf29bf48ca"
format_stamp: "Formatted at 2026-07-09 13:04:48 on dist-test-slave-j4mc"
I20260709 13:04:48.896277  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:48.914439  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:48.915629  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:48.917042  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:48.919428  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:48.919649  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:48.919889  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:48.920118  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:48.961483  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.2:35411
I20260709 13:04:48.961601 15819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.2:35411 every 8 connection(s)
I20260709 13:04:48.966027  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:48.973246 15823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:48.974911 15824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:48.975998  7088 server_base.cc:1061] running on GCE node
W20260709 13:04:48.977630 15826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:48.978366 15820 heartbeater.cc:344] Connected to a master server at 127.6.236.62:36921
I20260709 13:04:48.978731 15820 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:48.978736  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:48.979130  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:48.979288  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602288979273 us; error 0 us; skew 500 ppm
I20260709 13:04:48.979492 15820 heartbeater.cc:507] Master 127.6.236.62:36921 requested a full tablet report, sending...
I20260709 13:04:48.979883  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:48.981755 15618 ts_manager.cc:194] Registered new tserver with Master: 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411)
I20260709 13:04:48.982662  7088 webserver.cc:533] Webserver started at http://127.6.236.3:40739/ using document root <none> and password file <none>
I20260709 13:04:48.983124 15618 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45524
I20260709 13:04:48.983192  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:48.983592  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:48.983846  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:48.985065  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-2-root/instance:
uuid: "2ad0f68a4cd649889706e30acfc7f02c"
format_stamp: "Formatted at 2026-07-09 13:04:48 on dist-test-slave-j4mc"
I20260709 13:04:48.989528  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:04:48.993049 15831 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:48.994234  7088 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:48.994681  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-2-root
uuid: "2ad0f68a4cd649889706e30acfc7f02c"
format_stamp: "Formatted at 2026-07-09 13:04:48 on dist-test-slave-j4mc"
I20260709 13:04:48.994993  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602033297011-7088-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:49.006067  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:49.007280  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:49.008838  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:49.011157  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:49.011363  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:49.011579  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:49.011729  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:49.052371  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.3:43891
I20260709 13:04:49.052485 15893 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.3:43891 every 8 connection(s)
I20260709 13:04:49.065649 15894 heartbeater.cc:344] Connected to a master server at 127.6.236.62:36921
I20260709 13:04:49.066118 15894 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:49.066826 15894 heartbeater.cc:507] Master 127.6.236.62:36921 requested a full tablet report, sending...
I20260709 13:04:49.068734 15618 ts_manager.cc:194] Registered new tserver with Master: 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3:43891)
I20260709 13:04:49.069149  7088 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013673042s
I20260709 13:04:49.070452 15618 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45530
I20260709 13:04:49.095472 15618 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45538:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:49.097810 15618 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:49.147779 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 78a992e6296e49ef8b18ed476bf54f44 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=55229568255b46009c9e9366324d09a8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:49.149245 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a992e6296e49ef8b18ed476bf54f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.149852 15859 tablet_service.cc:1511] Processing CreateTablet for tablet 78a992e6296e49ef8b18ed476bf54f44 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=55229568255b46009c9e9366324d09a8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:49.151266 15859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a992e6296e49ef8b18ed476bf54f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.151259 15858 tablet_service.cc:1511] Processing CreateTablet for tablet 77dd67a14e704bb1a6166b3d1ae0a0d6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=55229568255b46009c9e9366324d09a8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:49.152674 15858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77dd67a14e704bb1a6166b3d1ae0a0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.153260 15784 tablet_service.cc:1511] Processing CreateTablet for tablet 77dd67a14e704bb1a6166b3d1ae0a0d6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=55229568255b46009c9e9366324d09a8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:49.154541 15784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77dd67a14e704bb1a6166b3d1ae0a0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.156389 15710 tablet_service.cc:1511] Processing CreateTablet for tablet 78a992e6296e49ef8b18ed476bf54f44 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=55229568255b46009c9e9366324d09a8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:49.157858 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a992e6296e49ef8b18ed476bf54f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.161298 15709 tablet_service.cc:1511] Processing CreateTablet for tablet 77dd67a14e704bb1a6166b3d1ae0a0d6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=55229568255b46009c9e9366324d09a8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:49.162695 15709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77dd67a14e704bb1a6166b3d1ae0a0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.174773 15909 tablet_bootstrap.cc:492] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca: Bootstrap starting.
I20260709 13:04:49.175418 15910 tablet_bootstrap.cc:492] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c: Bootstrap starting.
I20260709 13:04:49.183996 15909 tablet_bootstrap.cc:654] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.188892 15910 tablet_bootstrap.cc:654] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.190508 15909 tablet_bootstrap.cc:492] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca: No bootstrap required, opened a new log
I20260709 13:04:49.191083 15909 ts_tablet_manager.cc:1403] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:04:49.194013 15913 tablet_bootstrap.cc:492] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8: Bootstrap starting.
I20260709 13:04:49.194283 15909 raft_consensus.cc:359] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.195165 15909 raft_consensus.cc:385] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.195459 15909 raft_consensus.cc:740] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c6dba187af4db285616ddf29bf48ca, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.196374 15909 consensus_queue.cc:260] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.201278 15910 tablet_bootstrap.cc:492] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c: No bootstrap required, opened a new log
I20260709 13:04:49.202167 15910 ts_tablet_manager.cc:1403] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 13:04:49.204242 15913 tablet_bootstrap.cc:654] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.204841 15910 raft_consensus.cc:359] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.205488 15910 raft_consensus.cc:385] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.205729 15910 raft_consensus.cc:740] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad0f68a4cd649889706e30acfc7f02c, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.206431 15910 consensus_queue.cc:260] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.208344 15820 heartbeater.cc:499] Master 127.6.236.62:36921 was elected leader, sending a full tablet report...
I20260709 13:04:49.208777 15909 ts_tablet_manager.cc:1434] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 13:04:49.209088 15894 heartbeater.cc:499] Master 127.6.236.62:36921 was elected leader, sending a full tablet report...
I20260709 13:04:49.209882 15909 tablet_bootstrap.cc:492] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca: Bootstrap starting.
I20260709 13:04:49.215898 15910 ts_tablet_manager.cc:1434] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:04:49.217401 15910 tablet_bootstrap.cc:492] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c: Bootstrap starting.
I20260709 13:04:49.218276 15909 tablet_bootstrap.cc:654] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.224056 15910 tablet_bootstrap.cc:654] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.228813 15913 tablet_bootstrap.cc:492] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8: No bootstrap required, opened a new log
I20260709 13:04:49.229372 15913 ts_tablet_manager.cc:1403] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.011s
I20260709 13:04:49.229944 15909 tablet_bootstrap.cc:492] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca: No bootstrap required, opened a new log
I20260709 13:04:49.230551 15909 ts_tablet_manager.cc:1403] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:04:49.232622 15913 raft_consensus.cc:359] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.233490 15913 raft_consensus.cc:385] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.233486 15909 raft_consensus.cc:359] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.234114 15913 raft_consensus.cc:740] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1aa34caab9b438987f76495593b07f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.234567 15909 raft_consensus.cc:385] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.234956 15909 raft_consensus.cc:740] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c6dba187af4db285616ddf29bf48ca, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.235073 15913 consensus_queue.cc:260] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.235942 15909 consensus_queue.cc:260] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.238154 15909 ts_tablet_manager.cc:1434] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:49.240376 15745 heartbeater.cc:499] Master 127.6.236.62:36921 was elected leader, sending a full tablet report...
I20260709 13:04:49.241554 15910 tablet_bootstrap.cc:492] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c: No bootstrap required, opened a new log
I20260709 13:04:49.242173 15910 ts_tablet_manager.cc:1403] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 13:04:49.242825 15913 ts_tablet_manager.cc:1434] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:04:49.243901 15913 tablet_bootstrap.cc:492] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8: Bootstrap starting.
I20260709 13:04:49.244748 15910 raft_consensus.cc:359] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.245532 15910 raft_consensus.cc:385] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.245826 15910 raft_consensus.cc:740] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad0f68a4cd649889706e30acfc7f02c, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.246608 15910 consensus_queue.cc:260] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.249133 15910 ts_tablet_manager.cc:1434] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:49.250967 15913 tablet_bootstrap.cc:654] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.256662 15913 tablet_bootstrap.cc:492] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8: No bootstrap required, opened a new log
I20260709 13:04:49.257174 15913 ts_tablet_manager.cc:1403] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 13:04:49.260012 15913 raft_consensus.cc:359] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.260632 15913 raft_consensus.cc:385] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.260825 15913 raft_consensus.cc:740] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1aa34caab9b438987f76495593b07f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.261374 15913 consensus_queue.cc:260] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.262852 15913 ts_tablet_manager.cc:1434] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:49.293756 15919 raft_consensus.cc:493] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.294396 15919 raft_consensus.cc:515] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.296451 15919 leader_election.cc:290] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411), 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3:43891)
I20260709 13:04:49.305514 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a992e6296e49ef8b18ed476bf54f44" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca" is_pre_election: true
I20260709 13:04:49.306371 15795 raft_consensus.cc:2468] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 0.
I20260709 13:04:49.307301 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a992e6296e49ef8b18ed476bf54f44" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad0f68a4cd649889706e30acfc7f02c" is_pre_election: true
I20260709 13:04:49.307694 15686 leader_election.cc:304] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95c6dba187af4db285616ddf29bf48ca, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:49.308102 15869 raft_consensus.cc:2468] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 0.
I20260709 13:04:49.308629 15919 raft_consensus.cc:2804] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.308979 15919 raft_consensus.cc:493] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.309461 15919 raft_consensus.cc:3060] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.313514 15915 raft_consensus.cc:493] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.314108 15915 raft_consensus.cc:515] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.316242 15919 raft_consensus.cc:515] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.317068 15915 leader_election.cc:290] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1aa34caab9b438987f76495593b07f8 (127.6.236.1:44693), 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411)
I20260709 13:04:49.319108 15919 leader_election.cc:290] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 1 election: Requested vote from peers 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411), 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3:43891)
I20260709 13:04:49.319818 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a992e6296e49ef8b18ed476bf54f44" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca"
I20260709 13:04:49.320412 15795 raft_consensus.cc:3060] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.321895 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a992e6296e49ef8b18ed476bf54f44" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad0f68a4cd649889706e30acfc7f02c"
I20260709 13:04:49.322557 15869 raft_consensus.cc:3060] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.327916 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77dd67a14e704bb1a6166b3d1ae0a0d6" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1aa34caab9b438987f76495593b07f8" is_pre_election: true
I20260709 13:04:49.328755 15720 raft_consensus.cc:2468] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ad0f68a4cd649889706e30acfc7f02c in term 0.
I20260709 13:04:49.329159 15795 raft_consensus.cc:2468] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 1.
I20260709 13:04:49.329902 15869 raft_consensus.cc:2468] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 1.
I20260709 13:04:49.329939 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77dd67a14e704bb1a6166b3d1ae0a0d6" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca" is_pre_election: true
I20260709 13:04:49.330276 15834 leader_election.cc:304] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad0f68a4cd649889706e30acfc7f02c, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:49.330567 15686 leader_election.cc:304] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95c6dba187af4db285616ddf29bf48ca, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:49.330824 15794 raft_consensus.cc:2468] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ad0f68a4cd649889706e30acfc7f02c in term 0.
I20260709 13:04:49.331247 15915 raft_consensus.cc:2804] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.331414 15919 raft_consensus.cc:2804] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:49.331652 15915 raft_consensus.cc:493] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.332195 15915 raft_consensus.cc:3060] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.332845 15919 raft_consensus.cc:697] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 1 LEADER]: Becoming Leader. State: Replica: c1aa34caab9b438987f76495593b07f8, State: Running, Role: LEADER
I20260709 13:04:49.333556 15919 consensus_queue.cc:237] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } }
I20260709 13:04:49.338747 15915 raft_consensus.cc:515] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.340783 15915 leader_election.cc:290] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 election: Requested vote from peers c1aa34caab9b438987f76495593b07f8 (127.6.236.1:44693), 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411)
I20260709 13:04:49.341130 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77dd67a14e704bb1a6166b3d1ae0a0d6" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1aa34caab9b438987f76495593b07f8"
I20260709 13:04:49.341332 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77dd67a14e704bb1a6166b3d1ae0a0d6" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca"
I20260709 13:04:49.341756 15720 raft_consensus.cc:3060] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.341832 15794 raft_consensus.cc:3060] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.341976 15617 catalog_manager.cc:5697] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1aa34caab9b438987f76495593b07f8 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "c1aa34caab9b438987f76495593b07f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.347852 15720 raft_consensus.cc:2468] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ad0f68a4cd649889706e30acfc7f02c in term 1.
I20260709 13:04:49.348905 15794 raft_consensus.cc:2468] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ad0f68a4cd649889706e30acfc7f02c in term 1.
I20260709 13:04:49.348858 15834 leader_election.cc:304] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad0f68a4cd649889706e30acfc7f02c, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:49.349781 15915 raft_consensus.cc:2804] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:49.351151 15915 raft_consensus.cc:697] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 LEADER]: Becoming Leader. State: Replica: 2ad0f68a4cd649889706e30acfc7f02c, State: Running, Role: LEADER
I20260709 13:04:49.351950 15915 consensus_queue.cc:237] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.359615 15616 catalog_manager.cc:5697] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3). New cstate: current_term: 1 leader_uuid: "2ad0f68a4cd649889706e30acfc7f02c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.423481 15616 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45542:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:49.425333 15616 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:49.448122 15710 tablet_service.cc:1511] Processing CreateTablet for tablet 01baa3594eae4aa8a2604d9ad4772b45 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=178b1a0cc171428fb0ef43eb441456a7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:49.449302 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 01baa3594eae4aa8a2604d9ad4772b45 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=178b1a0cc171428fb0ef43eb441456a7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:49.449383 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01baa3594eae4aa8a2604d9ad4772b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.450621 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01baa3594eae4aa8a2604d9ad4772b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.451207 15858 tablet_service.cc:1511] Processing CreateTablet for tablet 01baa3594eae4aa8a2604d9ad4772b45 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=178b1a0cc171428fb0ef43eb441456a7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:49.452396 15858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01baa3594eae4aa8a2604d9ad4772b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.456074 15859 tablet_service.cc:1511] Processing CreateTablet for tablet d55b73c9d02742c683d1bd8570d752c4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=178b1a0cc171428fb0ef43eb441456a7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:49.457372 15859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55b73c9d02742c683d1bd8570d752c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.459434 15709 tablet_service.cc:1511] Processing CreateTablet for tablet d55b73c9d02742c683d1bd8570d752c4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=178b1a0cc171428fb0ef43eb441456a7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:49.460667 15709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55b73c9d02742c683d1bd8570d752c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.466607 15913 tablet_bootstrap.cc:492] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8: Bootstrap starting.
I20260709 13:04:49.469224 15910 tablet_bootstrap.cc:492] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c: Bootstrap starting.
I20260709 13:04:49.471630 15784 tablet_service.cc:1511] Processing CreateTablet for tablet d55b73c9d02742c683d1bd8570d752c4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=178b1a0cc171428fb0ef43eb441456a7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:49.473398 15784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55b73c9d02742c683d1bd8570d752c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.476850 15910 tablet_bootstrap.cc:654] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.481019 15913 tablet_bootstrap.cc:654] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.488240 15910 tablet_bootstrap.cc:492] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c: No bootstrap required, opened a new log
I20260709 13:04:49.488785 15909 tablet_bootstrap.cc:492] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca: Bootstrap starting.
I20260709 13:04:49.488780 15910 ts_tablet_manager.cc:1403] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:04:49.492389 15910 raft_consensus.cc:359] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.493263 15910 raft_consensus.cc:385] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.493609 15910 raft_consensus.cc:740] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad0f68a4cd649889706e30acfc7f02c, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.494583 15910 consensus_queue.cc:260] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.496137 15909 tablet_bootstrap.cc:654] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.497511 15910 ts_tablet_manager.cc:1434] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:49.498822 15910 tablet_bootstrap.cc:492] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c: Bootstrap starting.
I20260709 13:04:49.509922 15915 raft_consensus.cc:493] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.510676 15915 raft_consensus.cc:515] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.533699 15910 tablet_bootstrap.cc:654] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.533901 15915 leader_election.cc:290] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1aa34caab9b438987f76495593b07f8 (127.6.236.1:44693), 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411)
I20260709 13:04:49.535861 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca" is_pre_election: true
I20260709 13:04:49.536517 15913 tablet_bootstrap.cc:492] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8: No bootstrap required, opened a new log
I20260709 13:04:49.537086 15913 ts_tablet_manager.cc:1403] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8: Time spent bootstrapping tablet: real 0.071s	user 0.002s	sys 0.019s
W20260709 13:04:49.537493 15835 leader_election.cc:343] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.539403 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1aa34caab9b438987f76495593b07f8" is_pre_election: true
I20260709 13:04:49.540351 15913 raft_consensus.cc:359] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.541118 15913 raft_consensus.cc:385] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.541435 15913 raft_consensus.cc:740] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1aa34caab9b438987f76495593b07f8, State: Initialized, Role: FOLLOWER
W20260709 13:04:49.541592 15834 leader_election.cc:343] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1aa34caab9b438987f76495593b07f8 (127.6.236.1:44693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.542104 15834 leader_election.cc:304] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ad0f68a4cd649889706e30acfc7f02c; no voters: 95c6dba187af4db285616ddf29bf48ca, c1aa34caab9b438987f76495593b07f8
I20260709 13:04:49.542805 15910 tablet_bootstrap.cc:492] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c: No bootstrap required, opened a new log
I20260709 13:04:49.542399 15913 consensus_queue.cc:260] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.543313 15910 ts_tablet_manager.cc:1403] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.033s
I20260709 13:04:49.543500 15915 raft_consensus.cc:2749] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:49.545173 15909 tablet_bootstrap.cc:492] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca: No bootstrap required, opened a new log
I20260709 13:04:49.545753 15909 ts_tablet_manager.cc:1403] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca: Time spent bootstrapping tablet: real 0.057s	user 0.031s	sys 0.013s
I20260709 13:04:49.546296 15910 raft_consensus.cc:359] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.547041 15910 raft_consensus.cc:385] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.547091 15913 ts_tablet_manager.cc:1434] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:04:49.547461 15910 raft_consensus.cc:740] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad0f68a4cd649889706e30acfc7f02c, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.548319 15913 tablet_bootstrap.cc:492] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8: Bootstrap starting.
I20260709 13:04:49.548249 15910 consensus_queue.cc:260] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.549397 15909 raft_consensus.cc:359] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.550200 15909 raft_consensus.cc:385] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.550521 15909 raft_consensus.cc:740] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c6dba187af4db285616ddf29bf48ca, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.550951 15910 ts_tablet_manager.cc:1434] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:49.551429 15909 consensus_queue.cc:260] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.553665 15909 ts_tablet_manager.cc:1434] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:49.554672 15909 tablet_bootstrap.cc:492] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca: Bootstrap starting.
I20260709 13:04:49.557310 15913 tablet_bootstrap.cc:654] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.565531 15913 tablet_bootstrap.cc:492] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8: No bootstrap required, opened a new log
I20260709 13:04:49.565591 15909 tablet_bootstrap.cc:654] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.566309 15913 ts_tablet_manager.cc:1403] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:04:49.569324 15913 raft_consensus.cc:359] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.569980 15913 raft_consensus.cc:385] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.570287 15913 raft_consensus.cc:740] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1aa34caab9b438987f76495593b07f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.571002 15909 tablet_bootstrap.cc:492] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca: No bootstrap required, opened a new log
I20260709 13:04:49.571661 15909 ts_tablet_manager.cc:1403] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:04:49.571026 15913 consensus_queue.cc:260] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.573458 15913 ts_tablet_manager.cc:1434] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:49.574635 15909 raft_consensus.cc:359] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.575304 15909 raft_consensus.cc:385] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.575516 15909 raft_consensus.cc:740] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c6dba187af4db285616ddf29bf48ca, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.576081 15909 consensus_queue.cc:260] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.577641 15909 ts_tablet_manager.cc:1434] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:49.582484 15919 raft_consensus.cc:493] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.583060 15919 raft_consensus.cc:515] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.585112 15919 leader_election.cc:290] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411), 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3:43891)
I20260709 13:04:49.585769 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca" is_pre_election: true
I20260709 13:04:49.586288 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad0f68a4cd649889706e30acfc7f02c" is_pre_election: true
I20260709 13:04:49.586987 15869 raft_consensus.cc:2468] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 0.
I20260709 13:04:49.586457 15794 raft_consensus.cc:2468] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 0.
I20260709 13:04:49.588085 15684 leader_election.cc:304] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad0f68a4cd649889706e30acfc7f02c, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:49.588795 15919 raft_consensus.cc:2804] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.589138 15919 raft_consensus.cc:493] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.589362 15919 raft_consensus.cc:3060] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.594781 15919 raft_consensus.cc:515] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.596405 15919 leader_election.cc:290] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 1 election: Requested vote from peers 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411), 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3:43891)
I20260709 13:04:49.597267 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca"
I20260709 13:04:49.597436 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad0f68a4cd649889706e30acfc7f02c"
I20260709 13:04:49.597954 15794 raft_consensus.cc:3060] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.597970 15869 raft_consensus.cc:3060] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.605301 15794 raft_consensus.cc:2468] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 1.
I20260709 13:04:49.605305 15869 raft_consensus.cc:2468] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 1.
I20260709 13:04:49.606688 15686 leader_election.cc:304] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95c6dba187af4db285616ddf29bf48ca, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:49.607404 15919 raft_consensus.cc:2804] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:49.607949 15919 raft_consensus.cc:697] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 1 LEADER]: Becoming Leader. State: Replica: c1aa34caab9b438987f76495593b07f8, State: Running, Role: LEADER
I20260709 13:04:49.608786 15919 consensus_queue.cc:237] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.616329 15618 catalog_manager.cc:5697] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1aa34caab9b438987f76495593b07f8 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "c1aa34caab9b438987f76495593b07f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.641072 15915 raft_consensus.cc:493] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.641608 15915 raft_consensus.cc:515] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.643739 15915 leader_election.cc:290] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1aa34caab9b438987f76495593b07f8 (127.6.236.1:44693), 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411)
I20260709 13:04:49.644678 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55b73c9d02742c683d1bd8570d752c4" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1aa34caab9b438987f76495593b07f8" is_pre_election: true
I20260709 13:04:49.644961 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55b73c9d02742c683d1bd8570d752c4" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca" is_pre_election: true
I20260709 13:04:49.645309 15720 raft_consensus.cc:2468] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ad0f68a4cd649889706e30acfc7f02c in term 0.
I20260709 13:04:49.645555 15794 raft_consensus.cc:2468] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ad0f68a4cd649889706e30acfc7f02c in term 0.
I20260709 13:04:49.646355 15834 leader_election.cc:304] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad0f68a4cd649889706e30acfc7f02c, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:49.647215 15915 raft_consensus.cc:2804] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.647581 15915 raft_consensus.cc:493] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.647836 15915 raft_consensus.cc:3060] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.653353 15915 raft_consensus.cc:515] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.655000 15915 leader_election.cc:290] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 election: Requested vote from peers c1aa34caab9b438987f76495593b07f8 (127.6.236.1:44693), 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411)
I20260709 13:04:49.655956 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55b73c9d02742c683d1bd8570d752c4" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1aa34caab9b438987f76495593b07f8"
I20260709 13:04:49.656015 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55b73c9d02742c683d1bd8570d752c4" candidate_uuid: "2ad0f68a4cd649889706e30acfc7f02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c6dba187af4db285616ddf29bf48ca"
I20260709 13:04:49.656685 15720 raft_consensus.cc:3060] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.656806 15794 raft_consensus.cc:3060] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.661923 15794 raft_consensus.cc:2468] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ad0f68a4cd649889706e30acfc7f02c in term 1.
I20260709 13:04:49.661923 15720 raft_consensus.cc:2468] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ad0f68a4cd649889706e30acfc7f02c in term 1.
I20260709 13:04:49.663228 15834 leader_election.cc:304] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad0f68a4cd649889706e30acfc7f02c, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:49.663928 15915 raft_consensus.cc:2804] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:49.664381 15915 raft_consensus.cc:697] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 LEADER]: Becoming Leader. State: Replica: 2ad0f68a4cd649889706e30acfc7f02c, State: Running, Role: LEADER
I20260709 13:04:49.665091 15915 consensus_queue.cc:237] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:49.672289 15618 catalog_manager.cc:5697] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3). New cstate: current_term: 1 leader_uuid: "2ad0f68a4cd649889706e30acfc7f02c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.729811 15869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55b73c9d02742c683d1bd8570d752c4"
dest_uuid: "2ad0f68a4cd649889706e30acfc7f02c"
mode: GRACEFUL
new_leader_uuid: "c1aa34caab9b438987f76495593b07f8"
 from {username='slave'} at 127.0.0.1:58706
I20260709 13:04:49.730417 15869 raft_consensus.cc:606] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 LEADER]: Received request to transfer leadership to TS c1aa34caab9b438987f76495593b07f8
I20260709 13:04:49.783847 15919 consensus_queue.cc:1048] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:49.798987 15919 consensus_queue.cc:1048] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:49.885280 15915 consensus_queue.cc:1048] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:49.896335 15915 consensus_queue.cc:1048] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.052193 15915 consensus_queue.cc:1048] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.062345 15915 consensus_queue.cc:1048] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.070194 15950 raft_consensus.cc:993] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c: : Instructing follower c1aa34caab9b438987f76495593b07f8 to start an election
I20260709 13:04:50.070715 15950 raft_consensus.cc:1081] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 LEADER]: Signalling peer c1aa34caab9b438987f76495593b07f8 to start an election
I20260709 13:04:50.072175 15720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d55b73c9d02742c683d1bd8570d752c4"
dest_uuid: "c1aa34caab9b438987f76495593b07f8"
 from {username='slave'} at 127.0.0.1:54000
I20260709 13:04:50.072724 15720 raft_consensus.cc:493] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:50.073000 15720 raft_consensus.cc:3060] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.077836 15720 raft_consensus.cc:515] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:50.079566 15720 leader_election.cc:290] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 2 election: Requested vote from peers 95c6dba187af4db285616ddf29bf48ca (127.6.236.2:35411), 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3:43891)
I20260709 13:04:50.080734 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55b73c9d02742c683d1bd8570d752c4" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ad0f68a4cd649889706e30acfc7f02c"
I20260709 13:04:50.081137 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55b73c9d02742c683d1bd8570d752c4" candidate_uuid: "c1aa34caab9b438987f76495593b07f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95c6dba187af4db285616ddf29bf48ca"
I20260709 13:04:50.081421 15869 raft_consensus.cc:3055] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:50.081723 15794 raft_consensus.cc:3060] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.081761 15869 raft_consensus.cc:740] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ad0f68a4cd649889706e30acfc7f02c, State: Running, Role: LEADER
I20260709 13:04:50.082739 15869 consensus_queue.cc:260] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:50.084041 15869 raft_consensus.cc:3060] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.089197 15794 raft_consensus.cc:2468] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 2.
I20260709 13:04:50.090677 15686 leader_election.cc:304] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95c6dba187af4db285616ddf29bf48ca, c1aa34caab9b438987f76495593b07f8; no voters: 
I20260709 13:04:50.091204 15869 raft_consensus.cc:2468] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1aa34caab9b438987f76495593b07f8 in term 2.
I20260709 13:04:50.091508 15944 raft_consensus.cc:2804] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:50.091996 15944 raft_consensus.cc:697] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 2 LEADER]: Becoming Leader. State: Replica: c1aa34caab9b438987f76495593b07f8, State: Running, Role: LEADER
I20260709 13:04:50.092813 15944 consensus_queue.cc:237] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:50.098707 15618 catalog_manager.cc:5697] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 reported cstate change: term changed from 1 to 2, leader changed from 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3) to c1aa34caab9b438987f76495593b07f8 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "c1aa34caab9b438987f76495593b07f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.128697 15944 consensus_queue.cc:1048] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.138437 15923 consensus_queue.cc:1048] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.166749  7088 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:04:50.168306  7088 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:04:50.168704  7088 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:04:50.181200 15720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45"
dest_uuid: "c1aa34caab9b438987f76495593b07f8"
mode: GRACEFUL
new_leader_uuid: "95c6dba187af4db285616ddf29bf48ca"
 from {username='slave'} at 127.0.0.1:35064
I20260709 13:04:50.181728 15720 raft_consensus.cc:606] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 1 LEADER]: Received request to transfer leadership to TS 95c6dba187af4db285616ddf29bf48ca
I20260709 13:04:50.182933  7088 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:04:50.619827 15794 raft_consensus.cc:1275] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 2 FOLLOWER]: Refusing update from remote peer c1aa34caab9b438987f76495593b07f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.621011 15923 consensus_queue.cc:1048] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.629117 15869 raft_consensus.cc:1275] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 2 FOLLOWER]: Refusing update from remote peer c1aa34caab9b438987f76495593b07f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.631681 15923 consensus_queue.cc:1048] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.711024 15956 raft_consensus.cc:993] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8: : Instructing follower 95c6dba187af4db285616ddf29bf48ca to start an election
I20260709 13:04:50.711447 15923 raft_consensus.cc:1081] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 1 LEADER]: Signalling peer 95c6dba187af4db285616ddf29bf48ca to start an election
I20260709 13:04:50.712858 15794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45"
dest_uuid: "95c6dba187af4db285616ddf29bf48ca"
 from {username='slave'} at 127.0.0.1:38616
I20260709 13:04:50.713281 15794 raft_consensus.cc:493] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:50.713546 15794 raft_consensus.cc:3060] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.718145 15794 raft_consensus.cc:515] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:50.719915 15794 leader_election.cc:290] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [CANDIDATE]: Term 2 election: Requested vote from peers c1aa34caab9b438987f76495593b07f8 (127.6.236.1:44693), 2ad0f68a4cd649889706e30acfc7f02c (127.6.236.3:43891)
I20260709 13:04:50.732003 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45" candidate_uuid: "95c6dba187af4db285616ddf29bf48ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1aa34caab9b438987f76495593b07f8"
I20260709 13:04:50.732533 15720 raft_consensus.cc:3055] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:50.732790 15720 raft_consensus.cc:740] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1aa34caab9b438987f76495593b07f8, State: Running, Role: LEADER
I20260709 13:04:50.732996 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01baa3594eae4aa8a2604d9ad4772b45" candidate_uuid: "95c6dba187af4db285616ddf29bf48ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ad0f68a4cd649889706e30acfc7f02c"
I20260709 13:04:50.733552 15869 raft_consensus.cc:3060] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.733419 15720 consensus_queue.cc:260] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:50.734440 15720 raft_consensus.cc:3060] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.738300 15869 raft_consensus.cc:2468] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95c6dba187af4db285616ddf29bf48ca in term 2.
I20260709 13:04:50.738862 15720 raft_consensus.cc:2468] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95c6dba187af4db285616ddf29bf48ca in term 2.
I20260709 13:04:50.739409 15759 leader_election.cc:304] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad0f68a4cd649889706e30acfc7f02c, 95c6dba187af4db285616ddf29bf48ca; no voters: 
I20260709 13:04:50.740245 15914 raft_consensus.cc:2804] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:50.741250 15914 raft_consensus.cc:697] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 2 LEADER]: Becoming Leader. State: Replica: 95c6dba187af4db285616ddf29bf48ca, State: Running, Role: LEADER
I20260709 13:04:50.741858 15914 consensus_queue.cc:237] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } }
I20260709 13:04:50.747553 15618 catalog_manager.cc:5697] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca reported cstate change: term changed from 1 to 2, leader changed from c1aa34caab9b438987f76495593b07f8 (127.6.236.1) to 95c6dba187af4db285616ddf29bf48ca (127.6.236.2). New cstate: current_term: 2 leader_uuid: "95c6dba187af4db285616ddf29bf48ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1aa34caab9b438987f76495593b07f8" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 44693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c6dba187af4db285616ddf29bf48ca" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 35411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ad0f68a4cd649889706e30acfc7f02c" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.793458  7088 tablet_server.cc:179] TabletServer@127.6.236.1:0 shutting down...
I20260709 13:04:50.811697  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:50.812305  7088 tablet_replica.cc:333] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8: stopping tablet replica
I20260709 13:04:50.812860  7088 raft_consensus.cc:2243] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.813627  7088 raft_consensus.cc:2272] T d55b73c9d02742c683d1bd8570d752c4 P c1aa34caab9b438987f76495593b07f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.815732  7088 tablet_replica.cc:333] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8: stopping tablet replica
I20260709 13:04:50.816200  7088 raft_consensus.cc:2243] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.816547  7088 raft_consensus.cc:2272] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.818711  7088 tablet_replica.cc:333] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8: stopping tablet replica
I20260709 13:04:50.819164  7088 raft_consensus.cc:2243] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.819481  7088 raft_consensus.cc:2272] T 01baa3594eae4aa8a2604d9ad4772b45 P c1aa34caab9b438987f76495593b07f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.821445  7088 tablet_replica.cc:333] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8: stopping tablet replica
I20260709 13:04:50.821883  7088 raft_consensus.cc:2243] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.822604  7088 raft_consensus.cc:2272] T 78a992e6296e49ef8b18ed476bf54f44 P c1aa34caab9b438987f76495593b07f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.844710  7088 tablet_server.cc:196] TabletServer@127.6.236.1:0 shutdown complete.
I20260709 13:04:50.856936  7088 tablet_server.cc:179] TabletServer@127.6.236.2:0 shutting down...
I20260709 13:04:50.873852  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:50.874504  7088 tablet_replica.cc:333] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca: stopping tablet replica
I20260709 13:04:50.875026  7088 raft_consensus.cc:2243] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.875480  7088 raft_consensus.cc:2272] T d55b73c9d02742c683d1bd8570d752c4 P 95c6dba187af4db285616ddf29bf48ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.877853  7088 tablet_replica.cc:333] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca: stopping tablet replica
I20260709 13:04:50.878382  7088 raft_consensus.cc:2243] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.878767  7088 raft_consensus.cc:2272] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.880786  7088 tablet_replica.cc:333] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca: stopping tablet replica
I20260709 13:04:50.881269  7088 raft_consensus.cc:2243] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.881840  7088 pending_rounds.cc:70] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca: Trying to abort 1 pending ops.
I20260709 13:04:50.882015  7088 pending_rounds.cc:77] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634982885502976 op_type: NO_OP noop_request { }
I20260709 13:04:50.882334  7088 raft_consensus.cc:2889] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:50.882583  7088 raft_consensus.cc:2272] T 01baa3594eae4aa8a2604d9ad4772b45 P 95c6dba187af4db285616ddf29bf48ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.884758  7088 tablet_replica.cc:333] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca: stopping tablet replica
I20260709 13:04:50.885203  7088 raft_consensus.cc:2243] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.885571  7088 raft_consensus.cc:2272] T 78a992e6296e49ef8b18ed476bf54f44 P 95c6dba187af4db285616ddf29bf48ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.907086  7088 tablet_server.cc:196] TabletServer@127.6.236.2:0 shutdown complete.
I20260709 13:04:50.918541  7088 tablet_server.cc:179] TabletServer@127.6.236.3:0 shutting down...
I20260709 13:04:50.934151  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:50.934794  7088 tablet_replica.cc:333] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c: stopping tablet replica
I20260709 13:04:50.935320  7088 raft_consensus.cc:2243] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.935750  7088 raft_consensus.cc:2272] T d55b73c9d02742c683d1bd8570d752c4 P 2ad0f68a4cd649889706e30acfc7f02c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.937966  7088 tablet_replica.cc:333] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c: stopping tablet replica
I20260709 13:04:50.938483  7088 raft_consensus.cc:2243] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.939199  7088 raft_consensus.cc:2272] T 77dd67a14e704bb1a6166b3d1ae0a0d6 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.941057  7088 tablet_replica.cc:333] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c: stopping tablet replica
I20260709 13:04:50.941546  7088 raft_consensus.cc:2243] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.941918  7088 raft_consensus.cc:2272] T 01baa3594eae4aa8a2604d9ad4772b45 P 2ad0f68a4cd649889706e30acfc7f02c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.944257  7088 tablet_replica.cc:333] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c: stopping tablet replica
I20260709 13:04:50.944708  7088 raft_consensus.cc:2243] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.945077  7088 raft_consensus.cc:2272] T 78a992e6296e49ef8b18ed476bf54f44 P 2ad0f68a4cd649889706e30acfc7f02c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.956193  7088 tablet_server.cc:196] TabletServer@127.6.236.3:0 shutdown complete.
I20260709 13:04:50.999782  7088 master.cc:562] Master@127.6.236.62:36921 shutting down...
I20260709 13:04:51.021626  7088 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.022542  7088 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.022910  7088 tablet_replica.cc:333] T 00000000000000000000000000000000 P 57f55bf945cc4661b930141950410909: stopping tablet replica
I20260709 13:04:51.043475  7088 master.cc:584] Master@127.6.236.62:36921 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2509 ms)
[----------] 6 tests from LeaderRebalancerTest (257628 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:04:51.087690  7088 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.236.62:35365
I20260709 13:04:51.088832  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.094422 15967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.094432 15966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.095888 15969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.096710  7088 server_base.cc:1061] running on GCE node
I20260709 13:04:51.097481  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.097649  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.097759  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602291097749 us; error 0 us; skew 500 ppm
I20260709 13:04:51.098402  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.100669  7088 webserver.cc:533] Webserver started at http://127.6.236.62:41213/ using document root <none> and password file <none>
I20260709 13:04:51.101116  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.101266  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.101480  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.102674  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/master-0-root/instance:
uuid: "5f1e579e004c4781b11bd240713a3179"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-j4mc"
I20260709 13:04:51.106910  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:04:51.110114 15974 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.110841  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:51.111114  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/master-0-root
uuid: "5f1e579e004c4781b11bd240713a3179"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-j4mc"
I20260709 13:04:51.111356  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.126060  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.127328  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.164501  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.62:35365
I20260709 13:04:51.164606 16025 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.62:35365 every 8 connection(s)
I20260709 13:04:51.168700 16026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.181351 16026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179: Bootstrap starting.
I20260709 13:04:51.186371 16026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.190563 16026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179: No bootstrap required, opened a new log
I20260709 13:04:51.192705 16026 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1e579e004c4781b11bd240713a3179" member_type: VOTER }
I20260709 13:04:51.193105 16026 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.193284 16026 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f1e579e004c4781b11bd240713a3179, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.193827 16026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1e579e004c4781b11bd240713a3179" member_type: VOTER }
I20260709 13:04:51.194265 16026 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:51.194460 16026 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:51.194680 16026 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.199798 16026 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1e579e004c4781b11bd240713a3179" member_type: VOTER }
I20260709 13:04:51.200309 16026 leader_election.cc:304] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f1e579e004c4781b11bd240713a3179; no voters: 
I20260709 13:04:51.201509 16026 leader_election.cc:290] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:51.201924 16029 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.203188 16029 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 1 LEADER]: Becoming Leader. State: Replica: 5f1e579e004c4781b11bd240713a3179, State: Running, Role: LEADER
I20260709 13:04:51.203886 16029 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1e579e004c4781b11bd240713a3179" member_type: VOTER }
I20260709 13:04:51.204401 16026 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:51.206784 16031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f1e579e004c4781b11bd240713a3179. Latest consensus state: current_term: 1 leader_uuid: "5f1e579e004c4781b11bd240713a3179" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1e579e004c4781b11bd240713a3179" member_type: VOTER } }
I20260709 13:04:51.206867 16030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f1e579e004c4781b11bd240713a3179" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1e579e004c4781b11bd240713a3179" member_type: VOTER } }
I20260709 13:04:51.207710 16031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:51.207752 16030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:51.211721 16035 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:51.218963 16035 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:51.219980  7088 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:51.228180 16035 catalog_manager.cc:1383] Generated new cluster ID: fafa434db64c49ba86cb28822f59fed6
I20260709 13:04:51.228503 16035 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:51.249979 16035 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:51.251350 16035 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:51.270226 16035 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179: Generated new TSK 0
I20260709 13:04:51.270844 16035 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:51.286476  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.292577 16047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.293692 16048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.294917 16050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.295738  7088 server_base.cc:1061] running on GCE node
I20260709 13:04:51.296597  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.296779  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.296911  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602291296899 us; error 0 us; skew 500 ppm
I20260709 13:04:51.297423  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.299809  7088 webserver.cc:533] Webserver started at http://127.6.236.1:44351/ using document root <none> and password file <none>
I20260709 13:04:51.300282  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.300480  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.300696  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.301911  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-0-root/instance:
uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-j4mc"
I20260709 13:04:51.306718  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:51.310525 16055 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.311267  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:04:51.311533  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-j4mc"
I20260709 13:04:51.311767  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.327078  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.328251  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.329645  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.331878  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.332053  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.332289  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.332454  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.373232  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:38187
I20260709 13:04:51.373333 16117 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:38187 every 8 connection(s)
I20260709 13:04:51.378334  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.385667 16122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.386472 16123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.389940  7088 server_base.cc:1061] running on GCE node
W20260709 13:04:51.390935 16126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.390946 16118 heartbeater.cc:344] Connected to a master server at 127.6.236.62:35365
I20260709 13:04:51.391652 16118 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.392062  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.392299  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.392414 16118 heartbeater.cc:507] Master 127.6.236.62:35365 requested a full tablet report, sending...
I20260709 13:04:51.392474  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602291392448 us; error 0 us; skew 500 ppm
I20260709 13:04:51.393316  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.394769 15991 ts_manager.cc:194] Registered new tserver with Master: 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187)
I20260709 13:04:51.395886  7088 webserver.cc:533] Webserver started at http://127.6.236.2:38059/ using document root <none> and password file <none>
I20260709 13:04:51.396385  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.396564  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.396804  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.396843 15991 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46132
I20260709 13:04:51.398190  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-1-root/instance:
uuid: "6780b428c1b04db2ac811ff464ad8302"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-j4mc"
I20260709 13:04:51.402662  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:51.405915 16130 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.406737  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:51.407045  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-1-root
uuid: "6780b428c1b04db2ac811ff464ad8302"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-j4mc"
I20260709 13:04:51.407310  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.429652  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.431020  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.432447  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.434657  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.434834  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.435075  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.435214  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.475667  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.2:41323
I20260709 13:04:51.475786 16192 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.2:41323 every 8 connection(s)
I20260709 13:04:51.480419  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.488046 16196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.490410 16197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.490892  7088 server_base.cc:1061] running on GCE node
W20260709 13:04:51.491473 16199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.492553  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.492779  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.492962  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602291492946 us; error 0 us; skew 500 ppm
I20260709 13:04:51.493645 16193 heartbeater.cc:344] Connected to a master server at 127.6.236.62:35365
I20260709 13:04:51.493752  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.494060 16193 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.494957 16193 heartbeater.cc:507] Master 127.6.236.62:35365 requested a full tablet report, sending...
I20260709 13:04:51.496691  7088 webserver.cc:533] Webserver started at http://127.6.236.3:35331/ using document root <none> and password file <none>
I20260709 13:04:51.497241  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.497246 15991 ts_manager.cc:194] Registered new tserver with Master: 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:51.497704  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.498024  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.499112 15991 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46142
I20260709 13:04:51.499293  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-2-root/instance:
uuid: "b1d3dfeee46a4431a76ef056b489c161"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-j4mc"
I20260709 13:04:51.504033  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:51.507519 16204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.508414  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:51.508745  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-2-root
uuid: "b1d3dfeee46a4431a76ef056b489c161"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-j4mc"
I20260709 13:04:51.509038  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602033297011-7088-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.545711  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.547115  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.548631  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.551199  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.551419  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.551651  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.551801  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.598558  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.3:43115
I20260709 13:04:51.598605 16266 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.3:43115 every 8 connection(s)
I20260709 13:04:51.612471 16267 heartbeater.cc:344] Connected to a master server at 127.6.236.62:35365
I20260709 13:04:51.612875 16267 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.613755 16267 heartbeater.cc:507] Master 127.6.236.62:35365 requested a full tablet report, sending...
I20260709 13:04:51.615708 15991 ts_manager.cc:194] Registered new tserver with Master: b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:51.616415  7088 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014612333s
I20260709 13:04:51.617143 15991 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46156
I20260709 13:04:51.641564 15991 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46160:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:51.644341 15991 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:51.708797 16083 tablet_service.cc:1511] Processing CreateTablet for tablet 62be6c70c94d46139232047a8097c46e (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:51.710516 16083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62be6c70c94d46139232047a8097c46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.710839 16082 tablet_service.cc:1511] Processing CreateTablet for tablet d099bc4e9b5b48149e8900f06a7f96e6 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:51.712224 16082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d099bc4e9b5b48149e8900f06a7f96e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.718216 16081 tablet_service.cc:1511] Processing CreateTablet for tablet 08d081f5f9584ec39c5513b0f37417d4 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:51.719684 16081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d081f5f9584ec39c5513b0f37417d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.723452 16080 tablet_service.cc:1511] Processing CreateTablet for tablet 947d22b3590b4c279fe9904c79fcaeaf (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:51.725239 16080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947d22b3590b4c279fe9904c79fcaeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.736677 16079 tablet_service.cc:1511] Processing CreateTablet for tablet 945df9191d574f789f87d7c54a6233b8 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:51.738531 16079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945df9191d574f789f87d7c54a6233b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.740669 16078 tablet_service.cc:1511] Processing CreateTablet for tablet 418653df9e4c47dc8e92414fc4e8ba13 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:51.742434 16078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418653df9e4c47dc8e92414fc4e8ba13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.750316 16077 tablet_service.cc:1511] Processing CreateTablet for tablet ec83275982274fc8a11575ec25c1f3f1 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:51.752018 16077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec83275982274fc8a11575ec25c1f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.782287 16282 tablet_bootstrap.cc:492] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:51.774260 16081 tablet_service.cc:1511] Processing CreateTablet for tablet 93ef8eecde5a4d518c4ad0630903a3bc (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:51.785195 16081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ef8eecde5a4d518c4ad0630903a3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.789192 16282 tablet_bootstrap.cc:654] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.789342 16083 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9d00f9f6424622835c58e0cf65adf7 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:51.791635 16083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9d00f9f6424622835c58e0cf65adf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.792893 16151 tablet_service.cc:1511] Processing CreateTablet for tablet 93ef8eecde5a4d518c4ad0630903a3bc (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:51.795207 16158 tablet_service.cc:1511] Processing CreateTablet for tablet 62be6c70c94d46139232047a8097c46e (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:51.797458 16157 tablet_service.cc:1511] Processing CreateTablet for tablet d099bc4e9b5b48149e8900f06a7f96e6 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:51.799847 16156 tablet_service.cc:1511] Processing CreateTablet for tablet 08d081f5f9584ec39c5513b0f37417d4 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:51.803190 16154 tablet_service.cc:1511] Processing CreateTablet for tablet 945df9191d574f789f87d7c54a6233b8 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:51.805459 16153 tablet_service.cc:1511] Processing CreateTablet for tablet 418653df9e4c47dc8e92414fc4e8ba13 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:51.807976 16229 tablet_service.cc:1511] Processing CreateTablet for tablet 947d22b3590b4c279fe9904c79fcaeaf (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:51.809253 16226 tablet_service.cc:1511] Processing CreateTablet for tablet ec83275982274fc8a11575ec25c1f3f1 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:51.809633 16229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947d22b3590b4c279fe9904c79fcaeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.812472 16225 tablet_service.cc:1511] Processing CreateTablet for tablet 93ef8eecde5a4d518c4ad0630903a3bc (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:51.813794 16225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ef8eecde5a4d518c4ad0630903a3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.815253 16224 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9d00f9f6424622835c58e0cf65adf7 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:51.818373 16155 tablet_service.cc:1511] Processing CreateTablet for tablet 947d22b3590b4c279fe9904c79fcaeaf (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:51.819183 16231 tablet_service.cc:1511] Processing CreateTablet for tablet d099bc4e9b5b48149e8900f06a7f96e6 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:51.821367 16151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ef8eecde5a4d518c4ad0630903a3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.821532 16227 tablet_service.cc:1511] Processing CreateTablet for tablet 418653df9e4c47dc8e92414fc4e8ba13 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:51.823763 16228 tablet_service.cc:1511] Processing CreateTablet for tablet 945df9191d574f789f87d7c54a6233b8 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:51.826020 16232 tablet_service.cc:1511] Processing CreateTablet for tablet 62be6c70c94d46139232047a8097c46e (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:51.809605 16152 tablet_service.cc:1511] Processing CreateTablet for tablet ec83275982274fc8a11575ec25c1f3f1 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:51.817539 16230 tablet_service.cc:1511] Processing CreateTablet for tablet 08d081f5f9584ec39c5513b0f37417d4 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:51.829460 16232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62be6c70c94d46139232047a8097c46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.831851 16224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9d00f9f6424622835c58e0cf65adf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.832988 16231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d099bc4e9b5b48149e8900f06a7f96e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.834514 16230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d081f5f9584ec39c5513b0f37417d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.836550 16228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945df9191d574f789f87d7c54a6233b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.837787 16150 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9d00f9f6424622835c58e0cf65adf7 (DEFAULT_TABLE table=test-workload [id=791d7fba1bfb42f0b766215b841078d5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:51.839535 16227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418653df9e4c47dc8e92414fc4e8ba13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.845181 16156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d081f5f9584ec39c5513b0f37417d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.845866 16152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec83275982274fc8a11575ec25c1f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.850539 16153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418653df9e4c47dc8e92414fc4e8ba13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.854416 16150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9d00f9f6424622835c58e0cf65adf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.846609 16226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec83275982274fc8a11575ec25c1f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.857355 16154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945df9191d574f789f87d7c54a6233b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.858049 16158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62be6c70c94d46139232047a8097c46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.862564 16155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947d22b3590b4c279fe9904c79fcaeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.863854 16157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d099bc4e9b5b48149e8900f06a7f96e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.895592 16282 tablet_bootstrap.cc:492] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:51.896277 16282 ts_tablet_manager.cc:1403] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.114s	user 0.060s	sys 0.037s
I20260709 13:04:51.935040 16284 tablet_bootstrap.cc:492] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:51.957365 16284 tablet_bootstrap.cc:654] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.967029 16282 raft_consensus.cc:359] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:51.967954 16282 raft_consensus.cc:385] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.968307 16282 raft_consensus.cc:740] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.969131 16282 consensus_queue.cc:260] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:51.974625 16282 ts_tablet_manager.cc:1434] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.002s
I20260709 13:04:51.975114 16284 tablet_bootstrap.cc:492] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:51.975422 16118 heartbeater.cc:499] Master 127.6.236.62:35365 was elected leader, sending a full tablet report...
I20260709 13:04:51.975656 16284 ts_tablet_manager.cc:1403] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.041s	user 0.005s	sys 0.008s
I20260709 13:04:51.975221 16285 tablet_bootstrap.cc:492] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:51.978725 16284 raft_consensus.cc:359] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:51.980466 16284 raft_consensus.cc:385] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.980813 16284 raft_consensus.cc:740] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.981739 16284 consensus_queue.cc:260] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:51.987838 16282 tablet_bootstrap.cc:492] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:51.988471 16285 tablet_bootstrap.cc:654] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.988946 16284 ts_tablet_manager.cc:1434] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:04:51.989879 16267 heartbeater.cc:499] Master 127.6.236.62:35365 was elected leader, sending a full tablet report...
I20260709 13:04:51.990407 16284 tablet_bootstrap.cc:492] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:51.997285 16284 tablet_bootstrap.cc:654] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.998571 16287 raft_consensus.cc:493] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.999107 16287 raft_consensus.cc:515] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.009485 16287 leader_election.cc:290] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.016764 16282 tablet_bootstrap.cc:654] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.024436 16285 tablet_bootstrap.cc:492] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.024967 16285 ts_tablet_manager.cc:1403] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.013s
I20260709 13:04:52.028123 16285 raft_consensus.cc:359] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.028824 16284 tablet_bootstrap.cc:492] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:52.029250 16282 tablet_bootstrap.cc:492] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:52.028853 16285 raft_consensus.cc:385] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.029835 16282 ts_tablet_manager.cc:1403] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.008s
I20260709 13:04:52.029398 16284 ts_tablet_manager.cc:1403] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.006s
I20260709 13:04:52.029927 16285 raft_consensus.cc:740] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.031131 16285 consensus_queue.cc:260] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.033061 16284 raft_consensus.cc:359] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.034121 16284 raft_consensus.cc:385] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.034409 16284 raft_consensus.cc:740] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.035178 16284 consensus_queue.cc:260] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.036254 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:52.037274 16284 ts_tablet_manager.cc:1434] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 13:04:52.038132 16056 leader_election.cc:343] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.038340 16284 tablet_bootstrap.cc:492] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:52.038738 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
W20260709 13:04:52.040465 16058 leader_election.cc:343] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.040911 16058 leader_election.cc:304] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:04:52.041702 16287 raft_consensus.cc:2749] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.041427 16282 raft_consensus.cc:359] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.042240 16282 raft_consensus.cc:385] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.042564 16282 raft_consensus.cc:740] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.043340 16282 consensus_queue.cc:260] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.045465 16282 ts_tablet_manager.cc:1434] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:04:52.046433 16282 tablet_bootstrap.cc:492] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:52.046563 16284 tablet_bootstrap.cc:654] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.053424 16193 heartbeater.cc:499] Master 127.6.236.62:35365 was elected leader, sending a full tablet report...
I20260709 13:04:52.054533 16285 ts_tablet_manager.cc:1434] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.009s
I20260709 13:04:52.055694 16285 tablet_bootstrap.cc:492] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:52.058765 16282 tablet_bootstrap.cc:654] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.062947 16285 tablet_bootstrap.cc:654] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.063522 16282 tablet_bootstrap.cc:492] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:52.064036 16282 ts_tablet_manager.cc:1403] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:04:52.064971 16284 tablet_bootstrap.cc:492] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:52.065476 16284 ts_tablet_manager.cc:1403] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.016s
I20260709 13:04:52.068048 16282 raft_consensus.cc:359] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.068817 16282 raft_consensus.cc:385] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.069120 16282 raft_consensus.cc:740] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.069897 16282 consensus_queue.cc:260] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.072101 16282 ts_tablet_manager.cc:1434] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:52.073113 16282 tablet_bootstrap.cc:492] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:52.074364 16284 raft_consensus.cc:359] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.075225 16284 raft_consensus.cc:385] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.075614 16284 raft_consensus.cc:740] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.076464 16284 consensus_queue.cc:260] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.079092 16284 ts_tablet_manager.cc:1434] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:52.080763 16282 tablet_bootstrap.cc:654] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.082993 16284 tablet_bootstrap.cc:492] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:52.094003 16284 tablet_bootstrap.cc:654] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.100370 16285 tablet_bootstrap.cc:492] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.100927 16285 ts_tablet_manager.cc:1403] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.009s
I20260709 13:04:52.104013 16285 raft_consensus.cc:359] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.104504 16284 tablet_bootstrap.cc:492] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:52.105082 16284 ts_tablet_manager.cc:1403] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:04:52.105396 16285 raft_consensus.cc:385] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.105727 16285 raft_consensus.cc:740] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.106527 16285 consensus_queue.cc:260] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.108879 16285 ts_tablet_manager.cc:1434] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:52.108508 16284 raft_consensus.cc:359] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.109368 16284 raft_consensus.cc:385] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.109649 16284 raft_consensus.cc:740] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.110388 16284 consensus_queue.cc:260] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.112123 16282 tablet_bootstrap.cc:492] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:52.109889 16285 tablet_bootstrap.cc:492] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:52.112612 16284 ts_tablet_manager.cc:1434] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:52.114033 16284 tablet_bootstrap.cc:492] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:52.120079 16285 tablet_bootstrap.cc:654] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.120507 16284 tablet_bootstrap.cc:654] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.112640 16282 ts_tablet_manager.cc:1403] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.015s
I20260709 13:04:52.126547 16285 tablet_bootstrap.cc:492] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.126791 16282 raft_consensus.cc:359] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.127784 16284 tablet_bootstrap.cc:492] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:52.127826 16282 raft_consensus.cc:385] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.128695 16282 raft_consensus.cc:740] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.128855 16284 ts_tablet_manager.cc:1403] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:04:52.129454 16285 ts_tablet_manager.cc:1403] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 13:04:52.129518 16282 consensus_queue.cc:260] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.131937 16282 ts_tablet_manager.cc:1434] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:52.132944 16282 tablet_bootstrap.cc:492] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:52.132826 16285 raft_consensus.cc:359] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.133111 16284 raft_consensus.cc:359] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.134413 16285 raft_consensus.cc:385] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.134853 16284 raft_consensus.cc:385] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.134899 16285 raft_consensus.cc:740] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.135354 16284 raft_consensus.cc:740] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.135857 16285 consensus_queue.cc:260] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.136328 16284 consensus_queue.cc:260] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.139046 16284 ts_tablet_manager.cc:1434] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:04:52.140165 16284 tablet_bootstrap.cc:492] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:52.140820 16282 tablet_bootstrap.cc:654] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.147017 16284 tablet_bootstrap.cc:654] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.148155 16285 ts_tablet_manager.cc:1434] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:04:52.150717 16285 tablet_bootstrap.cc:492] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:52.157205 16285 tablet_bootstrap.cc:654] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.160465 16282 tablet_bootstrap.cc:492] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:52.160964 16282 ts_tablet_manager.cc:1403] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 13:04:52.161510 16284 tablet_bootstrap.cc:492] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:52.161988 16284 ts_tablet_manager.cc:1403] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:04:52.163429 16282 raft_consensus.cc:359] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.164017 16282 raft_consensus.cc:385] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.164258 16282 raft_consensus.cc:740] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.164985 16284 raft_consensus.cc:359] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.165604 16284 raft_consensus.cc:385] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.165094 16282 consensus_queue.cc:260] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.165848 16284 raft_consensus.cc:740] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.166787 16284 consensus_queue.cc:260] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.167173 16285 tablet_bootstrap.cc:492] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.168216 16285 ts_tablet_manager.cc:1403] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.009s
I20260709 13:04:52.169108 16287 raft_consensus.cc:493] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.169415 16284 ts_tablet_manager.cc:1434] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:04:52.169593 16287 raft_consensus.cc:515] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.170571 16284 tablet_bootstrap.cc:492] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:52.171499 16285 raft_consensus.cc:359] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.172099 16287 leader_election.cc:290] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.172266 16285 raft_consensus.cc:385] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.172583 16285 raft_consensus.cc:740] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.173424 16285 consensus_queue.cc:260] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.173758 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:52.174415 16242 raft_consensus.cc:2468] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 0.
I20260709 13:04:52.175715 16056 leader_election.cc:304] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.176653 16287 raft_consensus.cc:2804] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.177021 16287 raft_consensus.cc:493] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.177343 16287 raft_consensus.cc:3060] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.177812 16284 tablet_bootstrap.cc:654] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.178064 16285 ts_tablet_manager.cc:1434] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:52.179211 16285 tablet_bootstrap.cc:492] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:52.185339 16287 raft_consensus.cc:515] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.185827 16285 tablet_bootstrap.cc:654] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.188836 16284 tablet_bootstrap.cc:492] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:52.189392 16284 ts_tablet_manager.cc:1403] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:04:52.189904 16294 raft_consensus.cc:493] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.187502 16282 ts_tablet_manager.cc:1434] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:04:52.190466 16294 raft_consensus.cc:515] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.191854 16282 tablet_bootstrap.cc:492] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:52.192714 16284 raft_consensus.cc:359] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.193450 16284 raft_consensus.cc:385] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.193738 16284 raft_consensus.cc:740] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.175757 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:52.193148 16294 leader_election.cc:290] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.198539 16287 leader_election.cc:290] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.199939 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:52.200680 16242 raft_consensus.cc:3060] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.201038 16288 raft_consensus.cc:493] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.201532 16288 raft_consensus.cc:515] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.204267 16288 leader_election.cc:290] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.208137 16282 tablet_bootstrap.cc:654] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.212387 16242 raft_consensus.cc:2468] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
W20260709 13:04:52.214483 16039 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:52.217480 16284 consensus_queue.cc:260] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.222734 16285 tablet_bootstrap.cc:492] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.223423 16285 ts_tablet_manager.cc:1403] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.009s
I20260709 13:04:52.226670 16285 raft_consensus.cc:359] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.226991 16056 leader_election.cc:304] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.227475 16285 raft_consensus.cc:385] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.227845 16285 raft_consensus.cc:740] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.227991 16287 raft_consensus.cc:2804] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.228652 16285 consensus_queue.cc:260] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.233650 16285 ts_tablet_manager.cc:1434] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:04:52.235134 16285 tablet_bootstrap.cc:492] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:52.238179 16284 ts_tablet_manager.cc:1434] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 13:04:52.239243 16284 tablet_bootstrap.cc:492] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:52.245597 16282 tablet_bootstrap.cc:492] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:52.246435 16282 ts_tablet_manager.cc:1403] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.004s
I20260709 13:04:52.250203 16282 raft_consensus.cc:359] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.250982 16282 raft_consensus.cc:385] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.251259 16282 raft_consensus.cc:740] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.251992 16282 consensus_queue.cc:260] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.253898 16287 raft_consensus.cc:697] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:52.255105 16287 consensus_queue.cc:237] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
W20260709 13:04:52.263958 16058 leader_election.cc:343] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.264024 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:52.266033 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
W20260709 13:04:52.267578 16058 leader_election.cc:343] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.264890 16242 raft_consensus.cc:2468] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:52.269913 16284 tablet_bootstrap.cc:654] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.270725 16131 leader_election.cc:304] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.271027 16285 tablet_bootstrap.cc:654] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.272068 16294 raft_consensus.cc:2804] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.272421 16294 raft_consensus.cc:493] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.272693 16294 raft_consensus.cc:3060] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.274982 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
W20260709 13:04:52.277838 16134 leader_election.cc:343] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.279757 16284 tablet_bootstrap.cc:492] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:52.280354 16284 ts_tablet_manager.cc:1403] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 13:04:52.281139 16294 raft_consensus.cc:515] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.279791 16282 ts_tablet_manager.cc:1434] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:04:52.286090 16282 tablet_bootstrap.cc:492] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:52.286533 16285 tablet_bootstrap.cc:492] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.286966 16288 raft_consensus.cc:493] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.287106 16285 ts_tablet_manager.cc:1403] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.003s
I20260709 13:04:52.287472 16288 raft_consensus.cc:515] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.289664 16288 leader_election.cc:290] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.290498 16285 raft_consensus.cc:359] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.283193 16284 raft_consensus.cc:359] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.291493 16285 raft_consensus.cc:385] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.291978 16285 raft_consensus.cc:740] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.286684 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.291661 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:52.291990 16284 raft_consensus.cc:385] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.292937 16285 consensus_queue.cc:260] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.291404 16294 leader_election.cc:290] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.292958 16284 raft_consensus.cc:740] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.294360 16242 raft_consensus.cc:3060] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.292644 16282 tablet_bootstrap.cc:654] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.302934 16285 ts_tablet_manager.cc:1434] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.000s
W20260709 13:04:52.293994 16134 leader_election.cc:343] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.302848 16242 raft_consensus.cc:2468] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:52.305078 16131 leader_election.cc:304] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:52.306777 16282 tablet_bootstrap.cc:492] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:52.306924 16294 raft_consensus.cc:2804] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.307528 16282 ts_tablet_manager.cc:1403] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:04:52.307531 16294 raft_consensus.cc:697] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:52.308455 16285 tablet_bootstrap.cc:492] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:52.308566 16294 consensus_queue.cc:237] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.310799 16282 raft_consensus.cc:359] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.311587 16282 raft_consensus.cc:385] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.311918 16282 raft_consensus.cc:740] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.311311 15991 catalog_manager.cc:5697] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.312690 16282 consensus_queue.cc:260] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.315500 16282 ts_tablet_manager.cc:1434] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:52.316268 16285 tablet_bootstrap.cc:654] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.316656 16282 tablet_bootstrap.cc:492] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:52.322214 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:52.324231 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:52.325484 16282 tablet_bootstrap.cc:654] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:52.326807 16207 leader_election.cc:343] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.328344 16285 tablet_bootstrap.cc:492] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.328890 16285 ts_tablet_manager.cc:1403] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:04:52.328828 16284 consensus_queue.cc:260] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.332681 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:52.332093 16285 raft_consensus.cc:359] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.339315 16285 raft_consensus.cc:385] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.339619 16285 raft_consensus.cc:740] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.332762 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
W20260709 13:04:52.340482 16208 leader_election.cc:343] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.340669 16092 raft_consensus.cc:2468] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:52.340994 16208 leader_election.cc:304] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:52.342052 16285 consensus_queue.cc:260] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.344658 16285 ts_tablet_manager.cc:1434] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:52.345613 16285 tablet_bootstrap.cc:492] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:52.350165 16208 leader_election.cc:304] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:52.351555 16288 raft_consensus.cc:2749] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.351979 16285 tablet_bootstrap.cc:654] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.352200 16288 raft_consensus.cc:2804] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.352716 16288 raft_consensus.cc:493] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.353051 16288 raft_consensus.cc:3060] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.356968 16282 tablet_bootstrap.cc:492] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:52.357576 16282 ts_tablet_manager.cc:1403] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.041s	user 0.027s	sys 0.011s
I20260709 13:04:52.360674 16282 raft_consensus.cc:359] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.361389 16282 raft_consensus.cc:385] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.361652 16282 raft_consensus.cc:740] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.361850 16318 raft_consensus.cc:493] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.362454 16318 raft_consensus.cc:515] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.362526 16282 consensus_queue.cc:260] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.364753 16318 leader_election.cc:290] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.365043 16282 ts_tablet_manager.cc:1434] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:52.365585 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:52.366032 16282 tablet_bootstrap.cc:492] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:52.366240 16093 raft_consensus.cc:2468] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:52.366406 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:52.367237 16242 raft_consensus.cc:2468] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:52.367473 16134 leader_election.cc:304] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:52.368368 16318 raft_consensus.cc:2804] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.368718 16318 raft_consensus.cc:493] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.369033 16318 raft_consensus.cc:3060] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.369403 16285 tablet_bootstrap.cc:492] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.369989 16285 ts_tablet_manager.cc:1403] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.007s
I20260709 13:04:52.372412 16282 tablet_bootstrap.cc:654] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.373049 16285 raft_consensus.cc:359] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.373709 16285 raft_consensus.cc:385] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.373983 16285 raft_consensus.cc:740] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.371955 16288 raft_consensus.cc:515] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.374948 16285 consensus_queue.cc:260] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.376818 16288 leader_election.cc:290] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.376489 16318 raft_consensus.cc:515] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.379439 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:52.379829 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.380051 16167 raft_consensus.cc:3060] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.380390 16093 raft_consensus.cc:3060] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.382052 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:52.382694 16242 raft_consensus.cc:3060] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.382992 16282 tablet_bootstrap.cc:492] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:52.383476 16282 ts_tablet_manager.cc:1403] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 13:04:52.379372 16318 leader_election.cc:290] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.388012 16285 ts_tablet_manager.cc:1434] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:04:52.389173 16285 tablet_bootstrap.cc:492] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:52.391188 16093 raft_consensus.cc:2468] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:52.393015 16134 leader_election.cc:304] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:52.394167 16327 raft_consensus.cc:2804] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.394572 16318 raft_consensus.cc:493] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.395153 16318 raft_consensus.cc:515] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.396466 16285 tablet_bootstrap.cc:654] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.398093 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:52.398411 16282 raft_consensus.cc:359] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.398856 16093 raft_consensus.cc:2468] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:52.399120 16282 raft_consensus.cc:385] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.399513 16282 raft_consensus.cc:740] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.399384 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:52.400130 16134 leader_election.cc:304] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:52.400278 16282 consensus_queue.cc:260] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
W20260709 13:04:52.401026 16131 leader_election.cc:343] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.398464 16318 leader_election.cc:290] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.402385 16329 raft_consensus.cc:2804] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.402897 16329 raft_consensus.cc:493] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.403237 16329 raft_consensus.cc:3060] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.402484 16282 ts_tablet_manager.cc:1434] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:04:52.406219 16327 raft_consensus.cc:697] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:52.407296 16327 consensus_queue.cc:237] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.410529 16242 raft_consensus.cc:2468] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:52.411516 16284 ts_tablet_manager.cc:1434] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.000s
I20260709 13:04:52.417867 16284 tablet_bootstrap.cc:492] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:52.412636 16167 raft_consensus.cc:2468] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
W20260709 13:04:52.415169 16208 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.236.1:38187, user_credentials={real_user=slave}} blocked reactor thread for 65137.9us
I20260709 13:04:52.421430 16207 leader_election.cc:304] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.422511 16324 raft_consensus.cc:2804] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.423010 16324 raft_consensus.cc:697] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:52.422868 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.423718 16093 raft_consensus.cc:3060] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.423993 16324 consensus_queue.cc:237] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.423086 16329 raft_consensus.cc:515] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.426940 16287 raft_consensus.cc:493] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.427454 16287 raft_consensus.cc:515] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.429253 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.429456 16287 leader_election.cc:290] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.429934 16092 raft_consensus.cc:3060] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.414601 16285 tablet_bootstrap.cc:492] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:52.430807 16285 ts_tablet_manager.cc:1403] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.003s
I20260709 13:04:52.431555 16093 raft_consensus.cc:2468] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:52.433352 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:52.433727 16285 raft_consensus.cc:359] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.434767 16285 raft_consensus.cc:385] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.435026 16285 raft_consensus.cc:740] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.435693 16285 consensus_queue.cc:260] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.437924 16285 ts_tablet_manager.cc:1434] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:52.438537 16092 raft_consensus.cc:2468] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:52.439457 16329 leader_election.cc:290] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.439725 16134 leader_election.cc:304] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:52.438836 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:52.441258 16294 raft_consensus.cc:493] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.440716 16329 raft_consensus.cc:2804] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.442046 16329 raft_consensus.cc:697] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:52.441751 16294 raft_consensus.cc:515] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.440670 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:52.443140 16242 raft_consensus.cc:2393] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in current term 1: Already voted for candidate 6780b428c1b04db2ac811ff464ad8302 in this term.
W20260709 13:04:52.443686 16131 leader_election.cc:343] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.443929 16329 consensus_queue.cc:237] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.444806 16294 leader_election.cc:290] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.445344 16056 leader_election.cc:304] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:04:52.445573 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:52.446259 16287 raft_consensus.cc:3060] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.446591 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:52.447175 16242 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:52.446245 16092 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:52.448186 16131 leader_election.cc:304] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.449882 16329 raft_consensus.cc:2804] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.450274 16329 raft_consensus.cc:493] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.431838 16284 tablet_bootstrap.cc:654] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.450587 16329 raft_consensus.cc:3060] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.455345 16294 raft_consensus.cc:493] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.455886 16294 raft_consensus.cc:515] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.457692 16329 raft_consensus.cc:515] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.458842 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ef8eecde5a4d518c4ad0630903a3bc" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:52.459517 16092 raft_consensus.cc:2468] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:52.459908 16329 leader_election.cc:290] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.460803 16134 leader_election.cc:304] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:52.461076 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:52.461767 16242 raft_consensus.cc:3060] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.461920 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.462556 16092 raft_consensus.cc:3060] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.463294 16287 raft_consensus.cc:2749] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.465849 16294 leader_election.cc:290] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.461273 15988 catalog_manager.cc:5697] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.465067 15989 catalog_manager.cc:5697] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.470182 16092 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:52.466454 16294 raft_consensus.cc:2804] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.471675 16134 leader_election.cc:304] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:52.471870 16294 raft_consensus.cc:493] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.472414 16294 raft_consensus.cc:3060] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.472697 16327 raft_consensus.cc:2804] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.473294 16327 raft_consensus.cc:697] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:52.467039 16324 raft_consensus.cc:493] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.474159 16327 consensus_queue.cc:237] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.467203 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ef8eecde5a4d518c4ad0630903a3bc" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:52.475257 16241 raft_consensus.cc:2468] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:52.474335 16324 raft_consensus.cc:515] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.478570 16324 leader_election.cc:290] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.480561 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:52.481142 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:52.482213 16167 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:52.481918 16093 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:52.483027 16242 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:52.484484 16207 leader_election.cc:304] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.481087 16294 raft_consensus.cc:515] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.486378 16324 raft_consensus.cc:2804] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.487069 16324 raft_consensus.cc:493] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.487402 16294 leader_election.cc:290] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.487505 16324 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.489940 16284 tablet_bootstrap.cc:492] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:52.490481 16284 ts_tablet_manager.cc:1403] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.012s
I20260709 13:04:52.490970 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ef8eecde5a4d518c4ad0630903a3bc" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.491577 16093 raft_consensus.cc:3060] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.494344 16288 raft_consensus.cc:493] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.494565 16324 raft_consensus.cc:515] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.494876 16288 raft_consensus.cc:515] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.495417 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ef8eecde5a4d518c4ad0630903a3bc" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:52.496054 16242 raft_consensus.cc:3060] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.496935 16288 leader_election.cc:290] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.497982 16093 raft_consensus.cc:2468] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:52.498335 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.498548 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:52.499042 16092 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.499167 16091 raft_consensus.cc:2468] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:52.500185 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:52.500835 16167 raft_consensus.cc:2468] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:52.502270 16207 leader_election.cc:304] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.502818 16134 leader_election.cc:304] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:52.503151 16288 raft_consensus.cc:2804] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.503297 16242 raft_consensus.cc:2468] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:52.503654 16288 raft_consensus.cc:493] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.504127 16288 raft_consensus.cc:3060] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.504582 16294 raft_consensus.cc:2804] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.505096 16294 raft_consensus.cc:697] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:52.506210 16294 consensus_queue.cc:237] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.507602 16324 leader_election.cc:290] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.508800 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:52.512761 16167 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.515573 16284 raft_consensus.cc:359] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.518229 16284 raft_consensus.cc:385] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.518504 16284 raft_consensus.cc:740] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.518606 16288 raft_consensus.cc:515] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.519300 16284 consensus_queue.cc:260] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.511942 16092 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:52.521561 16284 ts_tablet_manager.cc:1434] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.001s
I20260709 13:04:52.522223 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.522708 16208 leader_election.cc:304] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.523666 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:52.524358 16168 raft_consensus.cc:3060] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.522889 16091 raft_consensus.cc:3060] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.534335 16168 raft_consensus.cc:2468] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:52.535287 16091 raft_consensus.cc:2468] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:52.535635 16207 leader_election.cc:304] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.535948 16324 raft_consensus.cc:2804] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.521325 16167 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:52.521595 16288 leader_election.cc:290] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.548503 16288 raft_consensus.cc:2804] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.549006 16288 raft_consensus.cc:697] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:52.549957 16288 consensus_queue.cc:237] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.556274 16324 raft_consensus.cc:697] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:52.557448 16324 consensus_queue.cc:237] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.566336 15989 catalog_manager.cc:5697] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.568282 15989 catalog_manager.cc:5697] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.570152 15989 catalog_manager.cc:5697] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.571473 15989 catalog_manager.cc:5697] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.574122 15991 catalog_manager.cc:5697] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.575665 15991 catalog_manager.cc:5697] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.597187 16324 raft_consensus.cc:493] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.597726 16324 raft_consensus.cc:515] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.599609 16324 leader_election.cc:290] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.600435 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:52.600630 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:52.601161 16091 raft_consensus.cc:2393] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 in current term 1: Already voted for candidate 6780b428c1b04db2ac811ff464ad8302 in this term.
I20260709 13:04:52.602056 16208 leader_election.cc:304] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:52.602766 16324 raft_consensus.cc:3060] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.608284 16324 raft_consensus.cc:2749] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.634159 16167 raft_consensus.cc:3060] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.640522 16287 consensus_queue.cc:1048] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.652324 16287 consensus_queue.cc:1048] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.714643 16167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62be6c70c94d46139232047a8097c46e"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
mode: GRACEFUL
new_leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:04:52.715217 16167 raft_consensus.cc:606] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Received request to transfer leadership to TS 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:52.727797 16242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
mode: GRACEFUL
new_leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:04:52.728284 16242 raft_consensus.cc:606] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Received request to transfer leadership to TS 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:52.735863 16242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
mode: GRACEFUL
new_leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:04:52.736362 16242 raft_consensus.cc:606] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Received request to transfer leadership to TS 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:52.746573 16242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
mode: GRACEFUL
new_leader_uuid: "6780b428c1b04db2ac811ff464ad8302"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:04:52.747054 16242 raft_consensus.cc:606] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Received request to transfer leadership to TS 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:52.754318 16167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
mode: GRACEFUL
new_leader_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:04:52.754880 16167 raft_consensus.cc:606] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Received request to transfer leadership to TS b1d3dfeee46a4431a76ef056b489c161
I20260709 13:04:52.781090 16294 consensus_queue.cc:1048] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.785712 16294 consensus_queue.cc:1048] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.865345 16324 consensus_queue.cc:1048] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.871490 16288 raft_consensus.cc:993] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161: : Instructing follower 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:52.872165 16341 raft_consensus.cc:1081] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Signalling peer 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:52.873919 16092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:04:52.874636 16092 raft_consensus.cc:493] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.875016 16092 raft_consensus.cc:3060] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.877156 16324 consensus_queue.cc:1048] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.881683 16092 raft_consensus.cc:515] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.882860 16091 raft_consensus.cc:1240] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Rejecting Update request from peer b1d3dfeee46a4431a76ef056b489c161 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:52.884298 16294 consensus_queue.cc:1048] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.887905 16324 consensus_queue.cc:1059] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.888695 16324 raft_consensus.cc:3055] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:52.888886 16092 leader_election.cc:290] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:52.889753 16324 raft_consensus.cc:740] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:52.890573 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:52.891429 16168 raft_consensus.cc:3060] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.890869 16324 consensus_queue.cc:260] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.892416 16324 raft_consensus.cc:3060] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.893085 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:52.898604 16328 consensus_queue.cc:1048] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.905216 16168 raft_consensus.cc:2468] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:52.906373 16058 leader_election.cc:304] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:52.907301 16316 raft_consensus.cc:2804] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:52.907775 16316 raft_consensus.cc:697] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:52.908578 16316 consensus_queue.cc:237] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.910537 16328 consensus_queue.cc:1048] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.921042 15990 catalog_manager.cc:5697] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 1 to 2, leader changed from b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3) to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.922566 16242 raft_consensus.cc:2468] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:52.924873 16327 raft_consensus.cc:993] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302: : Instructing follower b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:04:52.925431 16327 raft_consensus.cc:1081] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Signalling peer b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:04:52.927366 16241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:47010
I20260709 13:04:52.927930 16241 raft_consensus.cc:493] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.928272 16241 raft_consensus.cc:3060] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.932767 16329 consensus_queue.cc:1048] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.935495 16241 raft_consensus.cc:515] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.938652 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:52.938694 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:52.939318 16168 raft_consensus.cc:3055] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:52.939488 16092 raft_consensus.cc:3060] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.939684 16168 raft_consensus.cc:740] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:52.940632 16168 consensus_queue.cc:260] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.941848 16168 raft_consensus.cc:3060] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.943259 16241 leader_election.cc:290] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:52.952126 16168 raft_consensus.cc:2468] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 2.
I20260709 13:04:52.952126 16092 raft_consensus.cc:2468] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 2.
I20260709 13:04:52.954172 16208 leader_election.cc:304] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:52.955096 16288 raft_consensus.cc:2804] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:52.955585 16288 raft_consensus.cc:697] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 2 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:52.955915 16328 consensus_queue.cc:1048] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.956450 16288 consensus_queue.cc:237] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:52.958354 16324 consensus_queue.cc:1048] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.969077 16329 raft_consensus.cc:993] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302: : Instructing follower 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:52.969519 16318 raft_consensus.cc:1081] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Signalling peer 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:52.973624 16092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62be6c70c94d46139232047a8097c46e"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:38524
I20260709 13:04:52.974234 16092 raft_consensus.cc:493] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.974591 16092 raft_consensus.cc:3060] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.978397 16340 consensus_queue.cc:1048] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.977744 15988 catalog_manager.cc:5697] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 1 to 2, leader changed from 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2) to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.980275 16328 consensus_queue.cc:1048] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.981544 16294 consensus_queue.cc:1048] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.998481 16092 raft_consensus.cc:515] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.003556 16340 raft_consensus.cc:993] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161: : Instructing follower 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:53.004148 16324 raft_consensus.cc:1081] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Signalling peer 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:53.007507 16091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:04:53.008116 16091 raft_consensus.cc:493] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.008603 16091 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.010049 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:53.010731 16168 raft_consensus.cc:3055] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.010895 16092 leader_election.cc:290] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:53.011780 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:53.012396 16241 raft_consensus.cc:3060] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.013334 16168 raft_consensus.cc:740] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:53.013620 16294 consensus_queue.cc:1048] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.014420 16168 consensus_queue.cc:260] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.015695 16168 raft_consensus.cc:3060] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.016320 16091 raft_consensus.cc:515] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.023739 16091 leader_election.cc:290] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:53.024117 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:53.024761 16167 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.028906 16168 raft_consensus.cc:2468] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:53.030735 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:53.031415 16242 raft_consensus.cc:3055] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.031702 16242 raft_consensus.cc:740] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:53.032300 16167 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:53.032541 16242 consensus_queue.cc:260] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.033629 16058 leader_election.cc:304] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:53.034125 16242 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.034730 16316 raft_consensus.cc:2804] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.035218 16316 raft_consensus.cc:697] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:53.036044 16316 consensus_queue.cc:237] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.039490 16058 leader_election.cc:304] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:53.040465 16287 raft_consensus.cc:2804] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.040920 16287 raft_consensus.cc:697] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:53.028764 16241 raft_consensus.cc:2468] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:53.042053 16242 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:53.042057 16287 consensus_queue.cc:237] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.053895 16324 consensus_queue.cc:1048] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.054251 15988 catalog_manager.cc:5697] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 1 to 2, leader changed from 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2) to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.064411 16341 raft_consensus.cc:993] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161: : Instructing follower 6780b428c1b04db2ac811ff464ad8302 to start an election
I20260709 13:04:53.064924 16341 raft_consensus.cc:1081] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Signalling peer 6780b428c1b04db2ac811ff464ad8302 to start an election
I20260709 13:04:53.068018 16168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
 from {username='slave'} at 127.0.0.1:47414
I20260709 13:04:53.068571 16168 raft_consensus.cc:493] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.068897 16168 raft_consensus.cc:3060] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.070118 16324 consensus_queue.cc:1048] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.071851 15991 catalog_manager.cc:5697] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 1 to 2, leader changed from b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3) to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.074677 16168 raft_consensus.cc:515] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.079500 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:53.081585 16168 leader_election.cc:290] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:53.082748 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:53.083441 16240 raft_consensus.cc:3055] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.083748 16240 raft_consensus.cc:740] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:53.084560 16240 consensus_queue.cc:260] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.085618 16240 raft_consensus.cc:3060] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.092162 16240 raft_consensus.cc:2468] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:04:53.093115 16131 leader_election.cc:304] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:53.093943 16294 raft_consensus.cc:2804] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.094398 16294 raft_consensus.cc:697] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:53.095191 16294 consensus_queue.cc:237] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:53.101795 15988 catalog_manager.cc:5697] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 1 to 2, leader changed from b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3) to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.367110 16092 raft_consensus.cc:1275] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.368433 16341 consensus_queue.cc:1048] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.375785 16168 raft_consensus.cc:1275] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.377527 16288 consensus_queue.cc:1048] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.424405 16240 raft_consensus.cc:1275] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.425556 16316 consensus_queue.cc:1048] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.433388 16168 raft_consensus.cc:1275] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.434926 16287 consensus_queue.cc:1048] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.444175 16168 raft_consensus.cc:1275] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.445279 16287 consensus_queue.cc:1048] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.453729 16240 raft_consensus.cc:1275] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.455400 16316 consensus_queue.cc:1048] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.480099 16240 raft_consensus.cc:1275] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.481487 16316 consensus_queue.cc:1048] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.489576 16168 raft_consensus.cc:1275] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.491151 16313 consensus_queue.cc:1048] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.615947 16092 raft_consensus.cc:3060] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.621917 16092 raft_consensus.cc:1275] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.623461 16294 consensus_queue.cc:1048] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.630983 16240 raft_consensus.cc:1275] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.632522 16328 consensus_queue.cc:1048] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.788506 15991 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46174:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:55.790642 15991 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:55.837622 16078 tablet_service.cc:1511] Processing CreateTablet for tablet 6d89e47f26414247a73208ab819d56f1 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:55.838380 16154 tablet_service.cc:1511] Processing CreateTablet for tablet 6d89e47f26414247a73208ab819d56f1 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:55.838953 16078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d89e47f26414247a73208ab819d56f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.839619 16154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d89e47f26414247a73208ab819d56f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.839288 16224 tablet_service.cc:1511] Processing CreateTablet for tablet 6d89e47f26414247a73208ab819d56f1 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:55.841742 16224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d89e47f26414247a73208ab819d56f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.843058 16156 tablet_service.cc:1511] Processing CreateTablet for tablet 39adaf742dcf458887e846f5c71368f2 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:55.844285 16156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39adaf742dcf458887e846f5c71368f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.844978 16232 tablet_service.cc:1511] Processing CreateTablet for tablet 39adaf742dcf458887e846f5c71368f2 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:55.846261 16232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39adaf742dcf458887e846f5c71368f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.848670 16083 tablet_service.cc:1511] Processing CreateTablet for tablet 39adaf742dcf458887e846f5c71368f2 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:55.849891 16083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39adaf742dcf458887e846f5c71368f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.852267 16155 tablet_service.cc:1511] Processing CreateTablet for tablet 3049d28b250140d0847005830512ef30 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:55.853518 16155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3049d28b250140d0847005830512ef30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.854049 16151 tablet_service.cc:1511] Processing CreateTablet for tablet a8d9f19827114f07b0fe629287178076 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:55.855314 16151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d9f19827114f07b0fe629287178076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.855793 16077 tablet_service.cc:1511] Processing CreateTablet for tablet 3049d28b250140d0847005830512ef30 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:55.857013 16077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3049d28b250140d0847005830512ef30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.859102 16079 tablet_service.cc:1511] Processing CreateTablet for tablet a8d9f19827114f07b0fe629287178076 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:55.860387 16079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d9f19827114f07b0fe629287178076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.861434 16157 tablet_service.cc:1511] Processing CreateTablet for tablet 84c9140cafa94f4999caacb5c21f9bc8 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:55.862703 16157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c9140cafa94f4999caacb5c21f9bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.864239 16081 tablet_service.cc:1511] Processing CreateTablet for tablet 84c9140cafa94f4999caacb5c21f9bc8 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:55.865491 16081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c9140cafa94f4999caacb5c21f9bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.859174 16228 tablet_service.cc:1511] Processing CreateTablet for tablet 3049d28b250140d0847005830512ef30 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:55.871755 16231 tablet_service.cc:1511] Processing CreateTablet for tablet a8d9f19827114f07b0fe629287178076 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:55.872241 16228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3049d28b250140d0847005830512ef30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.872992 16231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d9f19827114f07b0fe629287178076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.893002 16226 tablet_service.cc:1511] Processing CreateTablet for tablet 84c9140cafa94f4999caacb5c21f9bc8 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:55.894299 16080 tablet_service.cc:1511] Processing CreateTablet for tablet 76c94d950bb74ea885d1edded33e3751 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:55.895565 16080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c94d950bb74ea885d1edded33e3751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.896216 16152 tablet_service.cc:1511] Processing CreateTablet for tablet 76c94d950bb74ea885d1edded33e3751 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:55.897516 16152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c94d950bb74ea885d1edded33e3751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.904170 16380 tablet_bootstrap.cc:492] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:55.894408 16226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c9140cafa94f4999caacb5c21f9bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.918989 16381 tablet_bootstrap.cc:492] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:55.924901 16080 tablet_service.cc:1511] Processing CreateTablet for tablet c54f978fa69d4dcda769b92627248831 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:55.926532 16080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54f978fa69d4dcda769b92627248831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.918048 16380 tablet_bootstrap.cc:654] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.930408 16381 tablet_bootstrap.cc:654] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.933236 16154 tablet_service.cc:1511] Processing CreateTablet for tablet c54f978fa69d4dcda769b92627248831 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:55.934770 16154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54f978fa69d4dcda769b92627248831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.943050 16380 tablet_bootstrap.cc:492] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:55.943655 16380 ts_tablet_manager.cc:1403] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.009s
I20260709 13:04:55.947337 16380 raft_consensus.cc:359] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:55.948143 16380 raft_consensus.cc:385] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.946979 16224 tablet_service.cc:1511] Processing CreateTablet for tablet c54f978fa69d4dcda769b92627248831 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:55.948441 16380 raft_consensus.cc:740] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.949525 16224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54f978fa69d4dcda769b92627248831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.949447 16380 consensus_queue.cc:260] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:55.953110 16157 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5cc4db33d24d4e8d5435ecc4644452 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:55.954578 16157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5cc4db33d24d4e8d5435ecc4644452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.954886 16231 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5cc4db33d24d4e8d5435ecc4644452 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:55.955029 16078 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5cc4db33d24d4e8d5435ecc4644452 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:55.956194 16231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5cc4db33d24d4e8d5435ecc4644452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.956385 16078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5cc4db33d24d4e8d5435ecc4644452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.960783 16380 ts_tablet_manager.cc:1434] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:55.961537 16081 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1515cd569421db7ccea792196ac23 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:55.962483 16152 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1515cd569421db7ccea792196ac23 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:55.962965 16081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1515cd569421db7ccea792196ac23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.923600 16232 tablet_service.cc:1511] Processing CreateTablet for tablet 76c94d950bb74ea885d1edded33e3751 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:55.970786 16232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c94d950bb74ea885d1edded33e3751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.923205 16382 tablet_bootstrap.cc:492] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:55.974560 16227 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1515cd569421db7ccea792196ac23 (DEFAULT_TABLE table=soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:55.979358 16227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1515cd569421db7ccea792196ac23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.963950 16152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1515cd569421db7ccea792196ac23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.964865 16380 tablet_bootstrap.cc:492] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:55.982940 16382 tablet_bootstrap.cc:654] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.013846 16381 tablet_bootstrap.cc:492] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.019443 16381 ts_tablet_manager.cc:1403] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.101s	user 0.000s	sys 0.014s
I20260709 13:04:56.022369 16381 raft_consensus.cc:359] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.023105 16381 raft_consensus.cc:385] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.023388 16381 raft_consensus.cc:740] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.024076 16381 consensus_queue.cc:260] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.030210 16382 tablet_bootstrap.cc:492] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.035220 16381 ts_tablet_manager.cc:1434] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.007s
I20260709 13:04:56.036244 16382 ts_tablet_manager.cc:1403] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.011s
I20260709 13:04:56.039054 16380 tablet_bootstrap.cc:654] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.039381 16382 raft_consensus.cc:359] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.040185 16382 raft_consensus.cc:385] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.040473 16382 raft_consensus.cc:740] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.041160 16382 consensus_queue.cc:260] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.042243 16381 tablet_bootstrap.cc:492] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:56.043416 16382 ts_tablet_manager.cc:1434] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:56.045042 16382 tablet_bootstrap.cc:492] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:56.045795 16380 tablet_bootstrap.cc:492] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:56.046414 16380 ts_tablet_manager.cc:1403] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.082s	user 0.005s	sys 0.007s
I20260709 13:04:56.048931 16381 tablet_bootstrap.cc:654] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.049791 16380 raft_consensus.cc:359] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.050571 16380 raft_consensus.cc:385] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.050849 16380 raft_consensus.cc:740] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.051433 16382 tablet_bootstrap.cc:654] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.051555 16380 consensus_queue.cc:260] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.060855 16380 ts_tablet_manager.cc:1434] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:56.061435 16381 tablet_bootstrap.cc:492] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.062107 16380 tablet_bootstrap.cc:492] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:56.062065 16381 ts_tablet_manager.cc:1403] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:04:56.064857 16382 tablet_bootstrap.cc:492] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.065470 16382 ts_tablet_manager.cc:1403] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:04:56.066224 16381 raft_consensus.cc:359] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.067003 16381 raft_consensus.cc:385] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.067287 16381 raft_consensus.cc:740] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.067996 16381 consensus_queue.cc:260] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.068789 16382 raft_consensus.cc:359] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.069860 16382 raft_consensus.cc:385] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.070223 16382 raft_consensus.cc:740] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.070254 16381 ts_tablet_manager.cc:1434] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:56.070963 16380 tablet_bootstrap.cc:654] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.071161 16382 consensus_queue.cc:260] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.071749 16381 tablet_bootstrap.cc:492] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:56.073948 16382 ts_tablet_manager.cc:1434] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:04:56.074961 16382 tablet_bootstrap.cc:492] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:56.079934 16381 tablet_bootstrap.cc:654] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.081619 16382 tablet_bootstrap.cc:654] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.093957 16382 tablet_bootstrap.cc:492] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.094637 16382 ts_tablet_manager.cc:1403] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:04:56.099097 16382 raft_consensus.cc:359] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.099567 16380 tablet_bootstrap.cc:492] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:56.099841 16382 raft_consensus.cc:385] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.100069 16381 tablet_bootstrap.cc:492] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.100153 16380 ts_tablet_manager.cc:1403] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.011s
I20260709 13:04:56.100176 16382 raft_consensus.cc:740] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.100601 16381 ts_tablet_manager.cc:1403] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.009s
I20260709 13:04:56.101241 16382 consensus_queue.cc:260] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.103700 16382 ts_tablet_manager.cc:1434] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:04:56.103523 16381 raft_consensus.cc:359] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.104349 16381 raft_consensus.cc:385] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.103992 16380 raft_consensus.cc:359] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.104655 16381 raft_consensus.cc:740] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.104761 16380 raft_consensus.cc:385] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.104885 16382 tablet_bootstrap.cc:492] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:56.105206 16380 raft_consensus.cc:740] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.105737 16381 consensus_queue.cc:260] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.106345 16380 consensus_queue.cc:260] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.108237 16381 ts_tablet_manager.cc:1434] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:04:56.110327 16380 ts_tablet_manager.cc:1434] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:56.113215 16381 tablet_bootstrap.cc:492] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:56.112311 16380 tablet_bootstrap.cc:492] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:56.114758 16328 raft_consensus.cc:493] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.115674 16382 tablet_bootstrap.cc:654] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.115345 16328 raft_consensus.cc:515] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.117527 16328 leader_election.cc:290] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.121357 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d9f19827114f07b0fe629287178076" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.122999 16380 tablet_bootstrap.cc:654] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.123796 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d9f19827114f07b0fe629287178076" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:56.124470 16240 raft_consensus.cc:2468] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:56.125821 16131 leader_election.cc:304] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
W20260709 13:04:56.128656 16134 leader_election.cc:343] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.130823 16382 tablet_bootstrap.cc:492] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.131508 16382 ts_tablet_manager.cc:1403] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 13:04:56.131873 16328 raft_consensus.cc:2804] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.133641 16328 raft_consensus.cc:493] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.134022 16328 raft_consensus.cc:3060] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.134586 16382 raft_consensus.cc:359] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.135370 16382 raft_consensus.cc:385] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.135665 16382 raft_consensus.cc:740] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.136397 16382 consensus_queue.cc:260] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.154831 16328 raft_consensus.cc:515] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.161497 16328 leader_election.cc:290] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.157385 16381 tablet_bootstrap.cc:654] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.163807 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d9f19827114f07b0fe629287178076" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:56.164418 16392 raft_consensus.cc:493] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.164565 16382 ts_tablet_manager.cc:1434] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.009s
I20260709 13:04:56.165716 16240 raft_consensus.cc:3060] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.165163 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d9f19827114f07b0fe629287178076" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:56.165824 16392 raft_consensus.cc:515] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.170383 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:56.171056 16241 raft_consensus.cc:2468] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:56.172363 16131 leader_election.cc:304] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:56.173095 16240 raft_consensus.cc:2468] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:56.174014 16382 tablet_bootstrap.cc:492] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:56.174333 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.174891 16380 tablet_bootstrap.cc:492] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:56.174991 16091 raft_consensus.cc:2468] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:56.175674 16380 ts_tablet_manager.cc:1403] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.016s
I20260709 13:04:56.176806 16131 leader_election.cc:304] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:56.177659 16397 raft_consensus.cc:2804] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.177785 16328 raft_consensus.cc:2804] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.178107 16397 raft_consensus.cc:493] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.178568 16397 raft_consensus.cc:3060] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.179085 16328 raft_consensus.cc:697] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:56.179276 16380 raft_consensus.cc:359] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.180043 16380 raft_consensus.cc:385] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.180487 16380 raft_consensus.cc:740] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.180140 16328 consensus_queue.cc:237] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.181320 16380 consensus_queue.cc:260] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
W20260709 13:04:56.182571 16134 leader_election.cc:343] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.182928 16382 tablet_bootstrap.cc:654] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.173187 16392 leader_election.cc:290] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.194123 16367 raft_consensus.cc:493] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.195812 15991 catalog_manager.cc:5697] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.194756 16367 raft_consensus.cc:515] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.198585 16397 raft_consensus.cc:515] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.199973 16367 leader_election.cc:290] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:56.201352 16397 leader_election.cc:290] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.202570 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:56.203464 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.202028 16396 raft_consensus.cc:493] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.204746 16381 tablet_bootstrap.cc:492] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.205721 16381 ts_tablet_manager.cc:1403] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.093s	user 0.021s	sys 0.004s
I20260709 13:04:56.205333 16396 raft_consensus.cc:515] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
W20260709 13:04:56.207742 16207 leader_election.cc:343] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.208734 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:56.208935 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:56.209437 16240 raft_consensus.cc:3060] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.209139 16381 raft_consensus.cc:359] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.210188 16381 raft_consensus.cc:385] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.210549 16381 raft_consensus.cc:740] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.211031 16241 raft_consensus.cc:2468] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 0.
I20260709 13:04:56.211530 16381 consensus_queue.cc:260] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.212407 16056 leader_election.cc:304] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:56.204201 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:56.210584 16396 leader_election.cc:290] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.210649 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:56.210423 16091 raft_consensus.cc:2468] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:56.215880 16313 raft_consensus.cc:2804] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.216115 16092 raft_consensus.cc:3060] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.213958 16381 ts_tablet_manager.cc:1434] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:04:56.217692 16313 raft_consensus.cc:493] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.218008 16381 tablet_bootstrap.cc:492] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:56.218058 16313 raft_consensus.cc:3060] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:56.215754 16058 leader_election.cc:343] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.225231 16381 tablet_bootstrap.cc:654] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.225272 16208 leader_election.cc:304] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:56.226673 16367 raft_consensus.cc:2804] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.227039 16367 raft_consensus.cc:493] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.227355 16367 raft_consensus.cc:3060] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.230567 16399 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.231146 16399 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.215678 16380 ts_tablet_manager.cc:1434] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.012s
I20260709 13:04:56.237699 16367 raft_consensus.cc:515] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.239073 16380 tablet_bootstrap.cc:492] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:56.240608 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:56.241796 16367 leader_election.cc:290] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:56.242775 16092 raft_consensus.cc:2468] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:56.243988 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:56.237679 16240 raft_consensus.cc:2468] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:56.235361 16313 raft_consensus.cc:515] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.248461 16091 raft_consensus.cc:2393] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 in current term 1: Already voted for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in this term.
I20260709 13:04:56.248970 16313 leader_election.cc:290] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.235201 16382 tablet_bootstrap.cc:492] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.246825 16134 leader_election.cc:304] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:56.250629 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:56.251510 16397 raft_consensus.cc:2804] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.252049 16397 raft_consensus.cc:697] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:56.251547 16241 raft_consensus.cc:2393] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in current term 1: Already voted for candidate b1d3dfeee46a4431a76ef056b489c161 in this term.
W20260709 13:04:56.246886 16207 leader_election.cc:343] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.253064 16381 tablet_bootstrap.cc:492] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.252856 16397 consensus_queue.cc:237] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.253296 16208 leader_election.cc:304] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:56.250670 16380 tablet_bootstrap.cc:654] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.254796 16367 raft_consensus.cc:2749] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.253577 16381 ts_tablet_manager.cc:1403] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.026s
I20260709 13:04:56.257763 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:56.258040 16399 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.258589 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
W20260709 13:04:56.259874 16131 leader_election.cc:343] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.260038 16381 raft_consensus.cc:359] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.260862 16381 raft_consensus.cc:385] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:56.260133 16039 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:56.260911 16380 tablet_bootstrap.cc:492] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:56.261422 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.261912 16380 ts_tablet_manager.cc:1403] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.005s
W20260709 13:04:56.262261 16058 leader_election.cc:343] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.262748 16058 leader_election.cc:304] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:04:56.263525 16313 raft_consensus.cc:2749] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.263758 16382 ts_tablet_manager.cc:1403] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.009s
I20260709 13:04:56.264317 16091 raft_consensus.cc:2468] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:56.264982 16380 raft_consensus.cc:359] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.261291 16381 raft_consensus.cc:740] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.265552 16134 leader_election.cc:304] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: b1d3dfeee46a4431a76ef056b489c161
I20260709 13:04:56.265710 16380 raft_consensus.cc:385] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.266887 16380 raft_consensus.cc:740] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.266788 16382 raft_consensus.cc:359] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.266850 16381 consensus_queue.cc:260] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.267761 16328 raft_consensus.cc:2804] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.268375 16328 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.268678 16328 raft_consensus.cc:3060] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.269685 16381 ts_tablet_manager.cc:1434] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:56.267958 16382 raft_consensus.cc:385] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.271736 16382 raft_consensus.cc:740] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.272049 16381 tablet_bootstrap.cc:492] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:56.272513 16382 consensus_queue.cc:260] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.268689 16380 consensus_queue.cc:260] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.293071 16328 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.300212 16380 ts_tablet_manager.cc:1434] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.005s
I20260709 13:04:56.299321 16381 tablet_bootstrap.cc:654] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.302680 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:56.302845 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:56.303514 16092 raft_consensus.cc:3060] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.299487 16382 ts_tablet_manager.cc:1434] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.005s
W20260709 13:04:56.304183 16131 leader_election.cc:343] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.304764 16328 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.301322 16380 tablet_bootstrap.cc:492] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:56.304949 16382 tablet_bootstrap.cc:492] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:56.301393 15990 catalog_manager.cc:5697] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.312615 16380 tablet_bootstrap.cc:654] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.313035 16382 tablet_bootstrap.cc:654] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.314754 16381 tablet_bootstrap.cc:492] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.315286 16381 ts_tablet_manager.cc:1403] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.006s
I20260709 13:04:56.318527 16381 raft_consensus.cc:359] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.319240 16381 raft_consensus.cc:385] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.319519 16381 raft_consensus.cc:740] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.321806 16381 consensus_queue.cc:260] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.324299 16381 ts_tablet_manager.cc:1434] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:04:56.325212 16381 tablet_bootstrap.cc:492] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:56.331599 16381 tablet_bootstrap.cc:654] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.342641 16092 raft_consensus.cc:2468] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:56.344765 16381 tablet_bootstrap.cc:492] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.345439 16381 ts_tablet_manager.cc:1403] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:04:56.345739 16134 leader_election.cc:304] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: b1d3dfeee46a4431a76ef056b489c161
I20260709 13:04:56.346722 16399 raft_consensus.cc:2804] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.347226 16399 raft_consensus.cc:697] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:56.348464 16399 consensus_queue.cc:237] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.348682 16381 raft_consensus.cc:359] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.349572 16381 raft_consensus.cc:385] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.349953 16381 raft_consensus.cc:740] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.353966 16381 consensus_queue.cc:260] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.356607 16381 ts_tablet_manager.cc:1434] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:56.357815 16381 tablet_bootstrap.cc:492] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:56.359138 15991 catalog_manager.cc:5697] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.360677 16380 tablet_bootstrap.cc:492] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:56.361053 16382 tablet_bootstrap.cc:492] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.361348 16380 ts_tablet_manager.cc:1403] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.022s
I20260709 13:04:56.361855 16382 ts_tablet_manager.cc:1403] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.041s
I20260709 13:04:56.364902 16381 tablet_bootstrap.cc:654] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.364723 16380 raft_consensus.cc:359] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.365506 16380 raft_consensus.cc:385] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.365001 16382 raft_consensus.cc:359] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.365837 16380 raft_consensus.cc:740] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.366108 16382 raft_consensus.cc:385] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.366537 16382 raft_consensus.cc:740] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.366791 16380 consensus_queue.cc:260] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.367518 16382 consensus_queue.cc:260] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.369717 16380 ts_tablet_manager.cc:1434] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:56.369808 16396 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.370253 16382 ts_tablet_manager.cc:1434] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:56.370715 16380 tablet_bootstrap.cc:492] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:56.370306 16396 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.371552 16382 tablet_bootstrap.cc:492] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:56.372576 16396 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.374189 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:56.377673 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:56.378046 16382 tablet_bootstrap.cc:654] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:56.378373 16058 leader_election.cc:343] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.379195 16380 tablet_bootstrap.cc:654] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:56.379805 16056 leader_election.cc:343] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.380281 16056 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:04:56.381383 16396 raft_consensus.cc:2749] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.386718 16399 raft_consensus.cc:493] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.387369 16399 raft_consensus.cc:515] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.392560 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54f978fa69d4dcda769b92627248831" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.393286 16399 leader_election.cc:290] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.393805 16382 tablet_bootstrap.cc:492] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.394374 16382 ts_tablet_manager.cc:1403] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
W20260709 13:04:56.394316 16134 leader_election.cc:343] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.394721 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54f978fa69d4dcda769b92627248831" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:56.395351 16240 raft_consensus.cc:2468] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 0.
I20260709 13:04:56.396580 16131 leader_election.cc:304] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:56.397117 16381 tablet_bootstrap.cc:492] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.397771 16380 tablet_bootstrap.cc:492] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:56.397598 16382 raft_consensus.cc:359] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.397825 16399 raft_consensus.cc:2804] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.398558 16382 raft_consensus.cc:385] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.398659 16380 ts_tablet_manager.cc:1403] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 13:04:56.398602 16399 raft_consensus.cc:493] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.399061 16382 raft_consensus.cc:740] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.399338 16399 raft_consensus.cc:3060] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.399865 16382 consensus_queue.cc:260] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.402272 16382 ts_tablet_manager.cc:1434] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:56.402865 16380 raft_consensus.cc:359] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.403331 16382 tablet_bootstrap.cc:492] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:56.403759 16380 raft_consensus.cc:385] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.404134 16380 raft_consensus.cc:740] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.404915 16380 consensus_queue.cc:260] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.407794 16399 raft_consensus.cc:515] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.397632 16381 ts_tablet_manager.cc:1403] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.002s
I20260709 13:04:56.411887 16381 raft_consensus.cc:359] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.412541 16381 raft_consensus.cc:385] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.412820 16381 raft_consensus.cc:740] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.413552 16381 consensus_queue.cc:260] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.413947 16380 ts_tablet_manager.cc:1434] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:04:56.415299 16396 raft_consensus.cc:493] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.415827 16396 raft_consensus.cc:515] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.417405 16380 tablet_bootstrap.cc:492] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:56.419204 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:56.419737 16381 ts_tablet_manager.cc:1434] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:04:56.419986 16168 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 0.
I20260709 13:04:56.420702 16381 tablet_bootstrap.cc:492] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161: Bootstrap starting.
I20260709 13:04:56.422224 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:56.422921 16240 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 0.
I20260709 13:04:56.424192 16058 leader_election.cc:304] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:56.424994 16313 raft_consensus.cc:2804] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.418246 16396 leader_election.cc:290] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.425266 16380 tablet_bootstrap.cc:654] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.425379 16313 raft_consensus.cc:493] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.425963 16313 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.427024 16381 tablet_bootstrap.cc:654] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.427788 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54f978fa69d4dcda769b92627248831" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
W20260709 13:04:56.429445 16134 leader_election.cc:343] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.429989 16382 tablet_bootstrap.cc:654] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.434322 16399 leader_election.cc:290] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.436993 16313 raft_consensus.cc:515] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.445370 16381 tablet_bootstrap.cc:492] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161: No bootstrap required, opened a new log
I20260709 13:04:56.445917 16381 ts_tablet_manager.cc:1403] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:04:56.447120 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:56.447832 16168 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.448784 16381 raft_consensus.cc:359] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.449524 16381 raft_consensus.cc:385] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.449805 16381 raft_consensus.cc:740] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.450471 16381 consensus_queue.cc:260] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.451503 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54f978fa69d4dcda769b92627248831" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:56.452144 16241 raft_consensus.cc:3060] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.452404 16381 ts_tablet_manager.cc:1434] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:56.454190 16396 raft_consensus.cc:493] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.454650 16396 raft_consensus.cc:515] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.449589 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:56.455853 16240 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.457015 16396 leader_election.cc:290] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.459432 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:56.458308 16313 leader_election.cc:290] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
W20260709 13:04:56.460954 16058 leader_election.cc:343] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.461200 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:56.461964 16242 raft_consensus.cc:2468] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 0.
I20260709 13:04:56.463436 16056 leader_election.cc:304] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:56.464250 16313 raft_consensus.cc:2804] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.464721 16313 raft_consensus.cc:493] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.465137 16313 raft_consensus.cc:3060] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.465837 16380 tablet_bootstrap.cc:492] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:56.466395 16380 ts_tablet_manager.cc:1403] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.016s
I20260709 13:04:56.469146 16380 raft_consensus.cc:359] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.469810 16380 raft_consensus.cc:385] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.470091 16380 raft_consensus.cc:740] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.470870 16380 consensus_queue.cc:260] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.475359 16380 ts_tablet_manager.cc:1434] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:04:56.475260 16313 raft_consensus.cc:515] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.476586 16380 tablet_bootstrap.cc:492] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302: Bootstrap starting.
I20260709 13:04:56.478965 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:56.479707 16167 raft_consensus.cc:3060] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.477903 16168 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:04:56.486948 16058 leader_election.cc:304] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:56.487814 16396 raft_consensus.cc:2804] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.489336 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:56.490118 16396 raft_consensus.cc:697] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:56.490187 16242 raft_consensus.cc:3060] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.489470 16380 tablet_bootstrap.cc:654] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.491125 16396 consensus_queue.cc:237] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.496184 16240 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:04:56.460517 16241 raft_consensus.cc:2468] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:04:56.498050 16131 leader_election.cc:304] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:56.496865 16313 leader_election.cc:290] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.498992 16167 raft_consensus.cc:2468] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:04:56.501116 16399 raft_consensus.cc:2804] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.501606 16399 raft_consensus.cc:697] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:56.502424 16399 consensus_queue.cc:237] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.503065 16382 tablet_bootstrap.cc:492] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.503598 16382 ts_tablet_manager.cc:1403] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.101s	user 0.030s	sys 0.024s
I20260709 13:04:56.504235 15989 catalog_manager.cc:5697] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.506196 16382 raft_consensus.cc:359] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.507205 16382 raft_consensus.cc:385] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.507481 16382 raft_consensus.cc:740] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.508255 16382 consensus_queue.cc:260] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.510568 16382 ts_tablet_manager.cc:1434] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:56.511488 16382 tablet_bootstrap.cc:492] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3: Bootstrap starting.
I20260709 13:04:56.501619 16242 raft_consensus.cc:2468] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:04:56.515729 16056 leader_election.cc:304] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:56.516518 16313 raft_consensus.cc:2804] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.517004 16313 raft_consensus.cc:697] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:56.517961 16313 consensus_queue.cc:237] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.520952 16380 tablet_bootstrap.cc:492] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302: No bootstrap required, opened a new log
I20260709 13:04:56.522501 16382 tablet_bootstrap.cc:654] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.525276 16380 ts_tablet_manager.cc:1403] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.007s
I20260709 13:04:56.528115 16380 raft_consensus.cc:359] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.528829 16380 raft_consensus.cc:385] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.529076 16380 raft_consensus.cc:740] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.529225 15989 catalog_manager.cc:5697] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.529923 16380 consensus_queue.cc:260] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.532248 16380 ts_tablet_manager.cc:1434] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:56.534618 16382 tablet_bootstrap.cc:492] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3: No bootstrap required, opened a new log
I20260709 13:04:56.535077 16382 ts_tablet_manager.cc:1403] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.003s
I20260709 13:04:56.537323 16382 raft_consensus.cc:359] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.537933 16382 raft_consensus.cc:385] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.538208 16382 raft_consensus.cc:740] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.538820 16382 consensus_queue.cc:260] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.541179 16382 ts_tablet_manager.cc:1434] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:04:56.541357 15991 catalog_manager.cc:5697] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.544974 16367 raft_consensus.cc:493] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.545522 16367 raft_consensus.cc:515] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.547571 16367 leader_election.cc:290] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:56.548142 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.548660 16092 raft_consensus.cc:2468] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:56.549710 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:56.550024 16208 leader_election.cc:304] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:56.550489 16167 raft_consensus.cc:2468] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:56.552062 16367 raft_consensus.cc:2804] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.552345 16367 raft_consensus.cc:493] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.552655 16367 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.559506 16367 raft_consensus.cc:515] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.561594 16367 leader_election.cc:290] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:56.562018 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:56.562372 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:56.562649 16092 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.562916 16167 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.567749 16167 raft_consensus.cc:2468] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:56.567749 16092 raft_consensus.cc:2468] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:56.568825 16207 leader_election.cc:304] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:56.569502 16367 raft_consensus.cc:2804] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.570349 16367 raft_consensus.cc:697] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:56.571044 16367 consensus_queue.cc:237] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.578878 15991 catalog_manager.cc:5697] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.613269 16092 raft_consensus.cc:3060] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.619907 16399 consensus_queue.cc:1048] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.630550 16397 consensus_queue.cc:1048] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.710623 16399 consensus_queue.cc:1048] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.722572 16397 consensus_queue.cc:1048] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.770112 16397 raft_consensus.cc:493] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.770612 16397 raft_consensus.cc:515] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.772300 16397 leader_election.cc:290] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:56.773154 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.773345 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:56.773788 16092 raft_consensus.cc:2393] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6780b428c1b04db2ac811ff464ad8302 in current term 1: Already voted for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in this term.
I20260709 13:04:56.774055 16242 raft_consensus.cc:2393] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6780b428c1b04db2ac811ff464ad8302 in current term 1: Already voted for candidate b1d3dfeee46a4431a76ef056b489c161 in this term.
I20260709 13:04:56.775089 16131 leader_election.cc:304] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:04:56.775784 16397 raft_consensus.cc:3060] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.779436 16367 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.779912 16367 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.780768 16397 raft_consensus.cc:2749] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.781946 16367 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:56.782672 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.782928 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:56.783248 16092 raft_consensus.cc:2393] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 in current term 1: Already voted for candidate 6780b428c1b04db2ac811ff464ad8302 in this term.
I20260709 13:04:56.784184 16208 leader_election.cc:304] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:56.784790 16367 raft_consensus.cc:3060] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.789779 16367 raft_consensus.cc:2749] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.816196 16397 consensus_queue.cc:1048] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.827966 16397 consensus_queue.cc:1048] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.832091 16367 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.832568 16367 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.834513 16367 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:56.835421 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:04:56.835421 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:56.836114 16092 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:56.836179 16167 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 0.
I20260709 13:04:56.837080 16208 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:56.837831 16367 raft_consensus.cc:2804] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.838128 16367 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.838385 16367 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.844074 16367 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.845664 16367 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:04:56.846217 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:56.846829 16092 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.846728 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:56.847401 16167 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.853657 16092 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:56.853931 16167 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 1.
I20260709 13:04:56.854894 16208 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:56.855577 16367 raft_consensus.cc:2804] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.855994 16367 raft_consensus.cc:697] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:56.856714 16367 consensus_queue.cc:237] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:56.863691 15991 catalog_manager.cc:5697] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.888526 16396 consensus_queue.cc:1048] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.897001 16092 raft_consensus.cc:3060] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.898337 16313 consensus_queue.cc:1048] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.907976 16397 consensus_queue.cc:1048] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.919507 16432 consensus_queue.cc:1048] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.969309 16367 consensus_queue.cc:1048] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.981102 16422 consensus_queue.cc:1048] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.050109 16416 consensus_queue.cc:1048] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.061228 16396 consensus_queue.cc:1048] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:57.263617 16039 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:57.290970 16422 consensus_queue.cc:1048] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.301678 16367 consensus_queue.cc:1048] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.838454 16396 raft_consensus.cc:493] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.838902 16396 raft_consensus.cc:515] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:57.840606 16396 leader_election.cc:290] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:57.841358 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:04:57.842001 16168 raft_consensus.cc:2468] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:04:57.843128 16058 leader_election.cc:304] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:57.843307 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:04:57.844041 16396 raft_consensus.cc:2804] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:57.844357 16396 raft_consensus.cc:493] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.844422 16242 raft_consensus.cc:2468] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:04:57.844648 16396 raft_consensus.cc:3060] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.850116 16396 raft_consensus.cc:515] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:57.852141 16396 leader_election.cc:290] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:57.852406 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:57.852972 16167 raft_consensus.cc:3060] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.853132 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:57.853717 16242 raft_consensus.cc:3060] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.859918 16167 raft_consensus.cc:2468] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:57.860302 16242 raft_consensus.cc:2468] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:57.861202 16058 leader_election.cc:304] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:57.862125 16396 raft_consensus.cc:2804] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.862648 16396 raft_consensus.cc:697] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:57.863999 16396 consensus_queue.cc:237] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:57.871351 15989 catalog_manager.cc:5697] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.125380 16168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
mode: GRACEFUL
new_leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:04:58.126016 16168 raft_consensus.cc:606] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Received request to transfer leadership to TS 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:58.134044 16242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3049d28b250140d0847005830512ef30"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
mode: GRACEFUL
new_leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:04:58.134629 16242 raft_consensus.cc:606] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Received request to transfer leadership to TS 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:58.140033 16168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8d9f19827114f07b0fe629287178076"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
mode: GRACEFUL
new_leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:04:58.140631 16168 raft_consensus.cc:606] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Received request to transfer leadership to TS 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:04:58.156067 16092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
mode: GRACEFUL
new_leader_uuid: "6780b428c1b04db2ac811ff464ad8302"
 from {username='slave'} at 127.0.0.1:38552
I20260709 13:04:58.156761 16092 raft_consensus.cc:606] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Received request to transfer leadership to TS 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:58.167598 16092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
mode: GRACEFUL
new_leader_uuid: "6780b428c1b04db2ac811ff464ad8302"
 from {username='slave'} at 127.0.0.1:38552
I20260709 13:04:58.168080 16092 raft_consensus.cc:606] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Received request to transfer leadership to TS 6780b428c1b04db2ac811ff464ad8302
I20260709 13:04:58.268368 16242 raft_consensus.cc:1275] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:58.269677 16313 consensus_queue.cc:1048] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.279915 16168 raft_consensus.cc:1275] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:58.283207 16396 consensus_queue.cc:1048] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.299883 16458 raft_consensus.cc:993] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302: : Instructing follower 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:58.302305 16432 raft_consensus.cc:1081] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Signalling peer 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:58.310268 16092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8d9f19827114f07b0fe629287178076"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:38524
I20260709 13:04:58.310853 16092 raft_consensus.cc:493] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:58.311211 16092 raft_consensus.cc:3060] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.317728 16092 raft_consensus.cc:515] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.319135 16092 leader_election.cc:290] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:58.320091 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d9f19827114f07b0fe629287178076" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:58.320115 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d9f19827114f07b0fe629287178076" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:58.320685 16168 raft_consensus.cc:3055] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.320762 16242 raft_consensus.cc:3060] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.320991 16168 raft_consensus.cc:740] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:58.321748 16168 consensus_queue.cc:260] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.322721 16168 raft_consensus.cc:3060] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.325342 16242 raft_consensus.cc:2468] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:58.326424 16056 leader_election.cc:304] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:58.327137 16313 raft_consensus.cc:2804] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.327648 16313 raft_consensus.cc:697] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:58.327869 16168 raft_consensus.cc:2468] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:58.328467 16313 consensus_queue.cc:237] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.335546 15989 catalog_manager.cc:5697] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 1 to 2, leader changed from 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2) to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.397764 16396 raft_consensus.cc:993] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3: : Instructing follower 6780b428c1b04db2ac811ff464ad8302 to start an election
I20260709 13:04:58.398324 16313 raft_consensus.cc:1081] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Signalling peer 6780b428c1b04db2ac811ff464ad8302 to start an election
I20260709 13:04:58.399787 16168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
 from {username='slave'} at 127.0.0.1:47398
I20260709 13:04:58.400211 16168 raft_consensus.cc:493] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:58.400471 16168 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.405100 16168 raft_consensus.cc:515] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.406734 16168 leader_election.cc:290] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:58.407310 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:58.407905 16092 raft_consensus.cc:3055] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.408114 16092 raft_consensus.cc:740] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:58.408270 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:58.408991 16242 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.408670 16092 consensus_queue.cc:260] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.409615 16456 raft_consensus.cc:993] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302: : Instructing follower 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:58.410107 16462 raft_consensus.cc:1081] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Signalling peer 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:58.410182 16092 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.411899 16091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:38524
I20260709 13:04:58.412438 16091 raft_consensus.cc:493] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:58.412798 16091 raft_consensus.cc:3060] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.415424 16092 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:04:58.415468 16242 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:04:58.416687 16134 leader_election.cc:304] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:58.417477 16462 raft_consensus.cc:2804] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.417883 16462 raft_consensus.cc:697] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:58.418623 16462 consensus_queue.cc:237] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.422549 16091 raft_consensus.cc:515] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.424464 16091 leader_election.cc:290] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:58.425706 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:58.425575 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:58.426362 16242 raft_consensus.cc:3060] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.426370 16168 raft_consensus.cc:3055] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.426954 16168 raft_consensus.cc:740] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:58.427665 16168 consensus_queue.cc:260] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.428874 16168 raft_consensus.cc:3060] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.428970 15989 catalog_manager.cc:5697] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 1 to 2, leader changed from 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1) to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.431233 16242 raft_consensus.cc:2468] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:58.432312 16056 leader_election.cc:304] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:58.433988 16313 raft_consensus.cc:2804] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.434795 16168 raft_consensus.cc:2468] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:58.435065 16313 raft_consensus.cc:697] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:58.435925 16313 consensus_queue.cc:237] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.443131 15989 catalog_manager.cc:5697] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 1 to 2, leader changed from 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2) to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.620445 16367 raft_consensus.cc:993] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161: : Instructing follower 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:58.620865 16466 raft_consensus.cc:1081] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Signalling peer 38ca1a1c8e1f4d2696338fe5931bfab3 to start an election
I20260709 13:04:58.622450 16091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3049d28b250140d0847005830512ef30"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:04:58.622932 16091 raft_consensus.cc:493] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:58.623234 16091 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.628481 16091 raft_consensus.cc:515] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.630924 16091 leader_election.cc:290] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:58.631597 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:58.632248 16241 raft_consensus.cc:3055] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.632426 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:04:58.632597 16241 raft_consensus.cc:740] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:04:58.633051 16168 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.633649 16313 raft_consensus.cc:993] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: : Instructing follower 6780b428c1b04db2ac811ff464ad8302 to start an election
I20260709 13:04:58.633503 16241 consensus_queue.cc:260] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.634151 16467 raft_consensus.cc:1081] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Signalling peer 6780b428c1b04db2ac811ff464ad8302 to start an election
I20260709 13:04:58.634871 16241 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.635673 16167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
 from {username='slave'} at 127.0.0.1:47398
I20260709 13:04:58.636188 16167 raft_consensus.cc:493] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:58.636468 16167 raft_consensus.cc:3060] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.639780 16168 raft_consensus.cc:2468] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:58.641613 16058 leader_election.cc:304] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:04:58.641944 16241 raft_consensus.cc:2468] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:04:58.642773 16467 raft_consensus.cc:2804] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.642616 16167 raft_consensus.cc:515] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.643657 16467 raft_consensus.cc:697] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:58.644662 16467 consensus_queue.cc:237] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.645737 16167 leader_election.cc:290] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:04:58.645985 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:04:58.646512 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:04:58.646870 16091 raft_consensus.cc:3055] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.647150 16241 raft_consensus.cc:3060] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.647337 16091 raft_consensus.cc:740] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:04:58.648339 16091 consensus_queue.cc:260] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.649523 16091 raft_consensus.cc:3060] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.652954 15989 catalog_manager.cc:5697] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 1 to 2, leader changed from b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3) to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.655293 16241 raft_consensus.cc:2468] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:04:58.656898 16091 raft_consensus.cc:2468] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:04:58.658269 16131 leader_election.cc:304] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:04:58.659101 16456 raft_consensus.cc:2804] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.659569 16456 raft_consensus.cc:697] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 2 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:04:58.660353 16456 consensus_queue.cc:237] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:04:58.668752 15989 catalog_manager.cc:5697] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 1 to 2, leader changed from 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1) to 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.825378 16241 raft_consensus.cc:1275] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.827044 16396 consensus_queue.cc:1048] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.838371 16167 raft_consensus.cc:1275] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.841213 16467 consensus_queue.cc:1048] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.889890 16242 raft_consensus.cc:1275] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.891108 16456 consensus_queue.cc:1048] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.899143 16091 raft_consensus.cc:1275] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.900779 16462 consensus_queue.cc:1048] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.971382 16242 raft_consensus.cc:1275] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.972666 16467 consensus_queue.cc:1048] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.980919 16167 raft_consensus.cc:1275] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.982411 16396 consensus_queue.cc:1048] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.074191 16092 raft_consensus.cc:1275] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.075403 16462 consensus_queue.cc:1048] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.083772 16242 raft_consensus.cc:1275] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.086100 16457 consensus_queue.cc:1048] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.093871 16242 raft_consensus.cc:1275] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.095266 16396 consensus_queue.cc:1048] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.104869 16167 raft_consensus.cc:1275] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.106694 16396 consensus_queue.cc:1048] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:02.124261 15991 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46174:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:02.139611 16490 raft_consensus.cc:493] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.431978 16490 raft_consensus.cc:515] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.148069 16489 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1d3dfeee46a4431a76ef056b489c161)
I20260709 13:05:02.263679 16491 raft_consensus.cc:493] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.434765 16489 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.434900 16491 raft_consensus.cc:515] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.437522 16489 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.438000 16491 leader_election.cc:290] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.439093 16491 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.439448 16490 leader_election.cc:290] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.441304 16491 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.443853 16491 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.460557 16490 raft_consensus.cc:493] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.461653 16490 raft_consensus.cc:515] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.464005 16490 leader_election.cc:290] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.464545 16490 raft_consensus.cc:493] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.465366 16490 raft_consensus.cc:515] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.541764 16491 raft_consensus.cc:493] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.542867 16491 raft_consensus.cc:515] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.545274 16491 leader_election.cc:290] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.551523 16493 raft_consensus.cc:493] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.551892 16490 leader_election.cc:290] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.552570 16489 raft_consensus.cc:493] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.553963 16493 raft_consensus.cc:515] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.554193 16489 raft_consensus.cc:515] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.555121 16490 raft_consensus.cc:493] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.555752 16490 raft_consensus.cc:515] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.556643 16489 leader_election.cc:290] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.558523 16494 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1d3dfeee46a4431a76ef056b489c161)
I20260709 13:05:02.559146 16490 leader_election.cc:290] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.559316 16493 leader_election.cc:290] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.560549 16494 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.563567 16494 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.566195 16489 raft_consensus.cc:493] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.566995 16490 raft_consensus.cc:493] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.567240 16489 raft_consensus.cc:515] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.567975 16490 raft_consensus.cc:515] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.570358 16490 leader_election.cc:290] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.570812 16489 leader_election.cc:290] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.581605 16164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.584153 16162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.585662 16494 raft_consensus.cc:493] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1d3dfeee46a4431a76ef056b489c161)
I20260709 13:05:02.586514 16494 raft_consensus.cc:515] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.589414 16494 leader_election.cc:290] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.589679 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.590117 16494 raft_consensus.cc:493] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.590502 16093 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:05:02.590922 16494 raft_consensus.cc:515] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.592857 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
W20260709 13:05:02.593603 16059 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.004s	sys 0.004s
W20260709 13:05:02.594125 16059 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.005s	sys 0.004s
I20260709 13:05:02.596433 16164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.598498 16164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.594043 16494 leader_election.cc:290] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.599282 16164 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:05:02.599521 16494 raft_consensus.cc:493] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.600515 16494 raft_consensus.cc:515] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.602815 16494 leader_election.cc:290] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.604310 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.604477 16093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.605407 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.609285 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.609701 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.615324 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.615881 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.618270 16168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.618858 16134 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:05:02.620632 16489 raft_consensus.cc:2804] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.621058 16489 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1d3dfeee46a4431a76ef056b489c161)
I20260709 13:05:02.621426 16489 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.622908 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.625667 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.654937 16489 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.669606 16058 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:05:02.672608 16491 raft_consensus.cc:2804] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.673064 16491 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1d3dfeee46a4431a76ef056b489c161)
I20260709 13:05:02.673398 16491 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.685652 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:02.686182 16489 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.692657 16496 raft_consensus.cc:493] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.693495 16496 raft_consensus.cc:515] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.695976 16496 leader_election.cc:290] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.696089 16491 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.696580 16496 raft_consensus.cc:493] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.697403 16091 raft_consensus.cc:2393] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6780b428c1b04db2ac811ff464ad8302 in current term 2: Already voted for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in this term.
I20260709 13:05:02.698189 16498 raft_consensus.cc:493] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.698966 16498 raft_consensus.cc:515] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.701123 16498 leader_election.cc:290] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.710407 16498 raft_consensus.cc:493] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.692603 16497 raft_consensus.cc:493] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.713156 16166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:02.713387 16497 raft_consensus.cc:515] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.702195 16499 raft_consensus.cc:493] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.702459 16502 raft_consensus.cc:493] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.708835 16501 raft_consensus.cc:493] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.712602 16491 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.701584 16496 raft_consensus.cc:515] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.715916 16501 raft_consensus.cc:515] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.716984 16496 leader_election.cc:290] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.717569 16496 raft_consensus.cc:493] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.718191 16496 raft_consensus.cc:515] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.719324 16501 leader_election.cc:290] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.719887 16501 raft_consensus.cc:493] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.720505 16496 leader_election.cc:290] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.720476 16501 raft_consensus.cc:515] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.722162 16506 raft_consensus.cc:493] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.722823 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.725378 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.725876 16164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.723708 16498 raft_consensus.cc:515] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.723961 16499 raft_consensus.cc:515] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.724159 16497 leader_election.cc:290] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.728871 16499 leader_election.cc:290] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.722864 16500 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.724835 16166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.729947 16500 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.728696 16498 leader_election.cc:290] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.731976 16500 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.732499 16502 raft_consensus.cc:515] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.725705 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.734767 16502 leader_election.cc:290] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.723464 16506 raft_consensus.cc:515] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.722667 16501 leader_election.cc:290] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.739473 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.739590 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.728703 16496 raft_consensus.cc:493] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.740904 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.741556 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ef8eecde5a4d518c4ad0630903a3bc" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.741500 16496 raft_consensus.cc:515] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.743551 16496 leader_election.cc:290] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.746826 16239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.747605 16239 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:05:02.748301 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.738485 16506 leader_election.cc:290] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:02.749017 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.749713 16241 raft_consensus.cc:2468] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:05:02.750680 16238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.751163 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ef8eecde5a4d518c4ad0630903a3bc" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.752501 16236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.753309 16235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.753800 16234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39adaf742dcf458887e846f5c71368f2" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.754685 16238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.755242 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.753311 16236 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:05:02.749027 16240 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 1.
I20260709 13:05:02.756744 16235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9d00f9f6424622835c58e0cf65adf7" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.757683 16234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.762373 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d9f19827114f07b0fe629287178076" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.762830 16235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d89e47f26414247a73208ab819d56f1" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.758498 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.759685 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.760821 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.763209 16239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83275982274fc8a11575ec25c1f3f1" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.766251 16238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5cc4db33d24d4e8d5435ecc4644452" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.767369 16056 leader_election.cc:304] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.767572 16234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:02.761112 16091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.761868 16236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:02.772423 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.772809 16493 raft_consensus.cc:2804] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:02.773216 16493 raft_consensus.cc:493] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.773381 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.764408 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:02.775797 16493 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.779017 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54f978fa69d4dcda769b92627248831" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.780330 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:02.783226 16056 leader_election.cc:304] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.784641 16491 raft_consensus.cc:2804] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.785061 16491 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.785413 16491 raft_consensus.cc:3060] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.789151 16207 leader_election.cc:304] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.790099 16502 raft_consensus.cc:2749] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.791872 16207 leader_election.cc:304] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.792645 16502 raft_consensus.cc:2749] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.793910 16207 leader_election.cc:304] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.795295 16207 leader_election.cc:304] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.795490 16502 raft_consensus.cc:2749] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.796697 16502 raft_consensus.cc:2749] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.797813 16207 leader_election.cc:304] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.794965 16056 leader_election.cc:304] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.799403 16056 leader_election.cc:304] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.800139 16502 raft_consensus.cc:2749] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.801373 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.798437 16491 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.802445 16166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62be6c70c94d46139232047a8097c46e" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.803720 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.804229 16491 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.804909 16166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:02.805154 16131 leader_election.cc:304] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.805990 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.806288 16489 raft_consensus.cc:2749] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.806382 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d9f19827114f07b0fe629287178076" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.806768 16164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.807431 16131 leader_election.cc:304] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.807948 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947d22b3590b4c279fe9904c79fcaeaf" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.808341 16164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54f978fa69d4dcda769b92627248831" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:02.808470 16489 raft_consensus.cc:2749] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.804858 16492 raft_consensus.cc:2804] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.809829 16492 raft_consensus.cc:493] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:02.810210 16492 raft_consensus.cc:3060] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.810631 16131 leader_election.cc:304] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.811348 16490 raft_consensus.cc:2749] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.812461 16207 leader_election.cc:304] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.813359 16502 raft_consensus.cc:2749] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.813496 16131 leader_election.cc:304] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:05:02.814407 16490 raft_consensus.cc:2804] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:02.814757 16490 raft_consensus.cc:493] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:02.815275 16490 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.817958 16131 leader_election.cc:304] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.818780 16489 raft_consensus.cc:2749] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.814738 16207 leader_election.cc:304] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.819669 16131 leader_election.cc:304] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.819783 16502 raft_consensus.cc:2749] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.820686 16207 leader_election.cc:304] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.820992 16489 raft_consensus.cc:2749] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.821450 16502 raft_consensus.cc:2749] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.822350 16491 raft_consensus.cc:2749] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.822784 16207 leader_election.cc:304] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.823551 16502 raft_consensus.cc:2749] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.823484 16131 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.824569 16489 raft_consensus.cc:2749] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.818783 16492 raft_consensus.cc:515] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.825242 16207 leader_election.cc:304] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.825973 16502 raft_consensus.cc:2749] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.826829 16492 leader_election.cc:290] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.827167 16207 leader_election.cc:304] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.819392 16493 raft_consensus.cc:515] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.823554 16056 leader_election.cc:304] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.827692 16164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:02.829094 16493 leader_election.cc:290] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.829314 16502 raft_consensus.cc:2749] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.829857 16164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:02.830281 16207 leader_election.cc:304] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.831063 16502 raft_consensus.cc:2749] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.831350 16207 leader_election.cc:304] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302
I20260709 13:05:02.830641 16493 raft_consensus.cc:2749] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.832185 16502 raft_consensus.cc:2749] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.829155 16056 leader_election.cc:304] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.833688 16056 leader_election.cc:304] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.834156 16490 raft_consensus.cc:515] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.832373 16131 leader_election.cc:304] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.834537 16493 raft_consensus.cc:2749] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.835414 16056 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.834394 16492 raft_consensus.cc:2749] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.835788 16489 raft_consensus.cc:2749] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.836580 16490 leader_election.cc:290] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:02.837514 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:02.838919 16234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:02.839017 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:02.837512 16492 raft_consensus.cc:2749] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.840698 16131 leader_election.cc:304] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.841423 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:02.841777 16234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:02.841339 16056 leader_election.cc:304] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.843991 16056 leader_election.cc:304] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.842739 16490 raft_consensus.cc:2749] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.845378 16492 raft_consensus.cc:2749] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.847610 16492 raft_consensus.cc:2749] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.845083 16056 leader_election.cc:304] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3; no voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:02.848657 16492 raft_consensus.cc:2749] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.850616 15991 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46174:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:02.874994 16088 raft_consensus.cc:1240] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Rejecting Update request from peer 6780b428c1b04db2ac811ff464ad8302 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:02.885727 16489 consensus_queue.cc:1059] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:02.886919 16489 raft_consensus.cc:3055] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:02.896009 16489 raft_consensus.cc:740] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:05:02.905083 16489 consensus_queue.cc:260] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.911864 15991 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46174 (request call id 40) took 1633 ms. Trace:
W20260709 13:05:02.959731 16189 debug-util.cc:398] Leaking SignalData structure 0x7b0800237620 after lost signal to thread 7091
W20260709 13:05:02.961268 16189 debug-util.cc:398] Leaking SignalData structure 0x7b080030cb60 after lost signal to thread 16025
I20260709 13:05:02.964388 16088 raft_consensus.cc:1240] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Rejecting Update request from peer 6780b428c1b04db2ac811ff464ad8302 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:02.965906 16489 raft_consensus.cc:3060] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.925621 15991 rpcz_store.cc:276] 0709 13:05:01.270086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.123485 (+853399us) service_pool.cc:224] Handling call
0709 13:05:02.440398 (+316913us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 13:05:02.658106 (+217708us) catalog_manager.cc:2608] Modifying in-memory table state
0709 13:05:02.658561 (+   455us) catalog_manager.cc:2619] Locking tablets
0709 13:05:02.703490 (+ 44929us) catalog_manager.cc:2632] Updating table and tablets from system table
0709 13:05:02.846263 (+142773us) catalog_manager.cc:2648] Moving table from normal map to soft_deleted map
0709 13:05:02.846320 (+    57us) catalog_manager.cc:7250] Moving table from normalized table map to soft_deleted table map.
0709 13:05:02.847431 (+  1111us) catalog_manager.cc:2657] Committing in-memory state
0709 13:05:02.850369 (+  2938us) catalog_manager.cc:2661] Disable compaction for soft-deleted table
0709 13:05:02.852841 (+  2472us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 13:05:02.857590 (+  4749us) catalog_manager.cc:3751] Apply alter schema
0709 13:05:02.858578 (+   988us) catalog_manager.cc:3870] Apply alter extra-config
0709 13:05:02.859185 (+   607us) catalog_manager.cc:3941] Updating metadata on disk
0709 13:05:02.865249 (+  6064us) catalog_manager.cc:3972] Committing alterations to in-memory state
0709 13:05:02.903509 (+ 38260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:02.710911 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:02.711564 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:02.711611 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:05:02.711644 (+    33us) tablet.cc:662] Decoding operations
0709 13:05:02.726499 (+ 14855us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:02.735317 (+  8818us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:02.735352 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:05:02.736290 (+   938us) tablet.cc:701] Row locks acquired
0709 13:05:02.736334 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:05:02.736512 (+   178us) write_op.cc:270] Start()
0709 13:05:02.736668 (+   156us) write_op.cc:276] Timestamp: P: 1783602302736455 usec, L: 0
0709 13:05:02.736698 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:05:02.737442 (+   744us) log.cc:844] Serialized 3913 byte log entry
0709 13:05:02.823863 (+ 86421us) op_driver.cc:464] REPLICATION: finished
0709 13:05:02.833252 (+  9389us) write_op.cc:301] APPLY: starting
0709 13:05:02.833353 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:02.833602 (+   249us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:02.833739 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:02.843594 (+  9855us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:02.843922 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:05:02.843980 (+    58us) write_op.cc:312] APPLY: finished
0709 13:05:02.844312 (+   332us) log.cc:844] Serialized 76 byte log entry
0709 13:05:02.845663 (+  1351us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:02.845787 (+   124us) write_op.cc:454] Released schema lock
0709 13:05:02.845849 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:02.846355 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:02.846383 (+    28us) write_op.cc:454] Released schema lock
Related trace 'op':
0709 13:05:02.860496 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:02.860967 (+   471us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:02.860999 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:05:02.861017 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:02.861270 (+   253us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:02.861312 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:02.861340 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:02.861506 (+   166us) tablet.cc:701] Row locks acquired
0709 13:05:02.861522 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:05:02.861628 (+   106us) write_op.cc:270] Start()
0709 13:05:02.861704 (+    76us) write_op.cc:276] Timestamp: P: 1783602302861594 usec, L: 0
0709 13:05:02.861716 (+    12us) op_driver.cc:348] REPLICATION: starting
0709 13:05:02.862185 (+   469us) log.cc:844] Serialized 503 byte log entry
0709 13:05:02.863888 (+  1703us) op_driver.cc:464] REPLICATION: finished
0709 13:05:02.864183 (+   295us) write_op.cc:301] APPLY: starting
0709 13:05:02.864239 (+    56us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:02.864309 (+    70us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:02.864369 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:02.864497 (+   128us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:02.864599 (+   102us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:02.864651 (+    52us) write_op.cc:312] APPLY: finished
0709 13:05:02.864776 (+   125us) log.cc:844] Serialized 22 byte log entry
0709 13:05:02.864886 (+   110us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:02.864943 (+    57us) write_op.cc:454] Released schema lock
0709 13:05:02.864968 (+    25us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:02.865290 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:02.865315 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":7040,"child_traces":[["op",{"apply.queue_time_us":9095,"apply.run_cpu_time_us":3158,"apply.run_wall_time_us":13074,"num_ops":10,"prepare.queue_time_us":1634,"prepare.run_cpu_time_us":11640,"prepare.run_wall_time_us":59864,"raft.queue_time_us":42646,"raft.run_cpu_time_us":1715,"raft.run_wall_time_us":11171,"replication_time_us":86999,"spinlock_wait_cycles":73600,"thread_start_us":92810,"threads_started":4,"wal-append.queue_time_us":33104}],["op",{"apply.queue_time_us":114,"apply.run_cpu_time_us":1056,"apply.run_wall_time_us":1055,"num_ops":1,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":1916,"prepare.run_wall_time_us":1917,"replication_time_us":2063}]]}
I20260709 13:05:02.977137 16518 consensus_queue.cc:1059] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:02.977738  7088 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:02.978333 16518 raft_consensus.cc:3055] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:02.983685 16518 raft_consensus.cc:740] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:05:02.984773 16518 consensus_queue.cc:260] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.987138 16088 raft_consensus.cc:1240] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Rejecting Update request from peer 6780b428c1b04db2ac811ff464ad8302 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
W20260709 13:05:02.975423 16189 debug-util.cc:398] Leaking SignalData structure 0x7b080022f960 after lost signal to thread 16117
I20260709 13:05:02.991930 16490 consensus_queue.cc:1059] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:02.993011 16525 raft_consensus.cc:3055] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:02.993361 16525 raft_consensus.cc:740] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:05:02.994351 16525 consensus_queue.cc:260] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:02.995651 16525 raft_consensus.cc:3060] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:03.010731 16189 debug-util.cc:398] Leaking SignalData structure 0x7b080026f800 after lost signal to thread 16192
W20260709 13:05:03.031710 16189 debug-util.cc:398] Leaking SignalData structure 0x7b0800228880 after lost signal to thread 16266
I20260709 13:05:03.043596 16167 raft_consensus.cc:1240] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Rejecting Update request from peer b1d3dfeee46a4431a76ef056b489c161 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:05:03.045497 16506 consensus_queue.cc:1059] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.046619 16506 raft_consensus.cc:3055] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.040565 16518 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.052413 16506 raft_consensus.cc:740] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:05:03.058012 16088 raft_consensus.cc:1240] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Rejecting Update request from peer b1d3dfeee46a4431a76ef056b489c161 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:05:03.057574 16506 consensus_queue.cc:260] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.061652 16506 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.168735 16088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3049d28b250140d0847005830512ef30"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
mode: GRACEFUL
new_leader_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:05:03.169597 16088 raft_consensus.cc:606] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Received request to transfer leadership to TS b1d3dfeee46a4431a76ef056b489c161
W20260709 13:05:03.172461 16513 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47384: Illegal state: Replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } } }
I20260709 13:05:03.182924 16166 raft_consensus.cc:1240] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Rejecting Update request from peer 38ca1a1c8e1f4d2696338fe5931bfab3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:03.185179 16492 consensus_queue.cc:1059] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.186740 16493 raft_consensus.cc:3055] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.187251 16493 raft_consensus.cc:740] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
W20260709 13:05:03.188171 16538 log.cc:927] Time spent T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 13:05:03.188319 16493 consensus_queue.cc:260] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.189914 16493 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:03.190788 16530 log.cc:927] Time spent T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:05:03.190502 16540 log.cc:927] Time spent T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.002s
W20260709 13:05:03.196184 15977 catalog_manager.cc:5107] TS 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): alter failed for tablet 84c9140cafa94f4999caacb5c21f9bc8 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]): Illegal state: Replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } } }
W20260709 13:05:03.204756 16537 log.cc:927] Time spent T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: Append to log took a long time: real 0.076s	user 0.003s	sys 0.000s
I20260709 13:05:03.217296 16552 tablet.cc:1724] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.263739 16492 raft_consensus.cc:993] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3: : Instructing follower b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:05:03.196170 16548 tablet.cc:1724] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.272320 16550 tablet.cc:1724] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.275714 16492 raft_consensus.cc:1081] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Signalling peer b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:05:03.266532 16553 tablet.cc:1724] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:03.285283 16156 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47384: Illegal state: replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config: current role FOLLOWER
I20260709 13:05:03.291395 16555 tablet.cc:1724] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.297683 16164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
mode: GRACEFUL
new_leader_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:60546
I20260709 13:05:03.313681 16238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3049d28b250140d0847005830512ef30"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:47000
I20260709 13:05:03.317790 16560 tablet.cc:1724] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.315794 16164 raft_consensus.cc:606] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Received request to transfer leadership to TS b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:03.316951 16557 tablet.cc:1724] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.326967 16164 raft_consensus.cc:614] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:03.328682  7088 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:05:03.329296  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.322675 16561 tablet.cc:1724] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.325734 16562 tablet.cc:1724] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.344919 16548 tablet.cc:1724] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.326522 16558 tablet.cc:1724] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.356444 16552 tablet.cc:1724] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.362564 16092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4"
dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
mode: GRACEFUL
new_leader_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:05:03.367309 16092 raft_consensus.cc:606] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Received request to transfer leadership to TS b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:03.366163 16238 raft_consensus.cc:493] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.370786 16238 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:03.372021 16156 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47384: Illegal state: replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config: current role FOLLOWER
I20260709 13:05:03.372561 16163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
mode: GRACEFUL
new_leader_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:60546
I20260709 13:05:03.373158 16163 raft_consensus.cc:606] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Received request to transfer leadership to TS b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:03.363868 16565 tablet.cc:1724] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.397303 16548 tablet.cc:1724] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.399400  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:03.400457  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:03.385301 16562 tablet.cc:1724] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.405108 16238 raft_consensus.cc:515] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.410000 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:03.410615 16092 raft_consensus.cc:3055] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.410900 16092 raft_consensus.cc:740] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:05:03.411670 16092 consensus_queue.cc:260] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.412775 16092 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.418409 16565 tablet.cc:1724] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.434414 16490 raft_consensus.cc:993] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302: : Instructing follower b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:05:03.423770 16561 tablet.cc:1724] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.434948 16490 raft_consensus.cc:1081] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Signalling peer b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:05:03.438882 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3049d28b250140d0847005830512ef30" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:03.439553 16167 raft_consensus.cc:3060] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.444579 16237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:47010
I20260709 13:05:03.452647 16237 raft_consensus.cc:493] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.453274 16237 raft_consensus.cc:3060] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.457278 16494 raft_consensus.cc:993] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3: : Instructing follower b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:05:03.457794 16494 raft_consensus.cc:1081] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Signalling peer b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:05:03.460459 16240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:47000
I20260709 13:05:03.461019 16240 raft_consensus.cc:493] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.461357 16240 raft_consensus.cc:3060] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.447305 16092 raft_consensus.cc:2468] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 3.
I20260709 13:05:03.447754 16238 leader_election.cc:290] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:03.357326 16550 tablet.cc:1724] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.471729 16208 leader_election.cc:304] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:05:03.472832 16504 raft_consensus.cc:2804] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:03.473311 16504 raft_consensus.cc:697] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 3 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
W20260709 13:05:03.473652 16156 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47384: Illegal state: replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config: current role FOLLOWER
I20260709 13:05:03.474195 16504 consensus_queue.cc:237] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.473536 16240 raft_consensus.cc:515] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.479264 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:03.479861 16163 raft_consensus.cc:3060] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.450897 16167 raft_consensus.cc:2468] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 3.
I20260709 13:05:03.486479 16237 raft_consensus.cc:515] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.495074 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:03.495711 16089 raft_consensus.cc:3060] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.498567 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d081f5f9584ec39c5513b0f37417d4" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:03.501189 16092 raft_consensus.cc:3055] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.501504 16092 raft_consensus.cc:740] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:05:03.502292 16092 consensus_queue.cc:260] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.503398 16092 raft_consensus.cc:3060] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.505478 16089 raft_consensus.cc:2468] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 2.
I20260709 13:05:03.507041 16208 leader_election.cc:304] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:05:03.507841 16504 raft_consensus.cc:2804] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.508289 16504 raft_consensus.cc:697] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 2 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:05:03.509109 16504 consensus_queue.cc:237] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.511044 16092 raft_consensus.cc:2468] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 2.
I20260709 13:05:03.513270 16208 leader_election.cc:304] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:05:03.513926 16240 leader_election.cc:290] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:03.514330 16506 raft_consensus.cc:2804] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.514758 16506 raft_consensus.cc:697] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 2 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:05:03.515425 16163 raft_consensus.cc:2468] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 2.
I20260709 13:05:03.515475 16506 consensus_queue.cc:237] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.517254 16237 leader_election.cc:290] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:03.519197 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418653df9e4c47dc8e92414fc4e8ba13" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:03.519759 16163 raft_consensus.cc:3055] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.520061 16163 raft_consensus.cc:740] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:05:03.520987 16163 consensus_queue.cc:260] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:03.522781 16163 raft_consensus.cc:3060] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.530957 16163 raft_consensus.cc:2468] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 2.
I20260709 13:05:03.544589 15991 catalog_manager.cc:5697] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 2 to 3, leader changed from 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1) to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.545923 15991 catalog_manager.cc:5697] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 1 to 2, leader changed from 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2) to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.547102 15991 catalog_manager.cc:5697] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 1 to 2, leader changed from 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1) to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:03.628494 16156 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47384: Illegal state: replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config: current role FOLLOWER
W20260709 13:05:03.929432 16156 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47384: Illegal state: replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config: current role FOLLOWER
I20260709 13:05:03.958354 16089 raft_consensus.cc:1275] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.959956 16506 consensus_queue.cc:1048] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.002297 16092 raft_consensus.cc:1275] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:04.009303 16163 raft_consensus.cc:1275] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.004166 16506 consensus_queue.cc:1048] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:05:04.042470 16506 consensus_queue.cc:1048] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.053265 16167 raft_consensus.cc:1275] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:04.059861 16504 consensus_queue.cc:1048] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.098948 16163 raft_consensus.cc:1275] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.100319 16579 consensus_queue.cc:1048] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.110773 16089 raft_consensus.cc:1275] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.113327 16579 consensus_queue.cc:1048] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:04.201995 16577 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.202477 16577 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.204324 16577 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.205050 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:04.205252 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:04.205761 16089 raft_consensus.cc:2468] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:05:04.206944 16134 leader_election.cc:304] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:04.207535 16577 raft_consensus.cc:2804] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:04.207955 16577 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.208303 16577 raft_consensus.cc:3060] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.215308 16577 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.217705 16577 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.217980 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:04.218317 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:04.218729 16089 raft_consensus.cc:3060] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.224022 16089 raft_consensus.cc:2468] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 3.
I20260709 13:05:04.225054 16134 leader_election.cc:304] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:04.225837 16577 raft_consensus.cc:2804] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.226333 16577 raft_consensus.cc:697] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 3 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:05:04.227054 16577 consensus_queue.cc:237] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.235040 15988 catalog_manager.cc:5697] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.236141 15988 catalog_manager.cc:5789] TS 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323) does not have the latest schema for tablet 76c94d950bb74ea885d1edded33e3751 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:04.332355 16577 raft_consensus.cc:493] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.332898 16577 raft_consensus.cc:515] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.335242 16577 leader_election.cc:290] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.335942 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:04.335757 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:04.336560 16237 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 1.
I20260709 13:05:04.336709 16089 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:05:04.337497 16131 leader_election.cc:304] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:05:04.338186 16577 raft_consensus.cc:2804] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:04.338452 16577 raft_consensus.cc:493] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.338696 16577 raft_consensus.cc:3060] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.343695 16577 raft_consensus.cc:515] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.345268 16577 leader_election.cc:290] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.346315 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:04.346189 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945df9191d574f789f87d7c54a6233b8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:04.346962 16237 raft_consensus.cc:3060] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.347105 16089 raft_consensus.cc:3060] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.352907 16237 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 3.
I20260709 13:05:04.354277 16131 leader_election.cc:304] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:05:04.355096 16524 raft_consensus.cc:2804] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.355114 16089 raft_consensus.cc:2468] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 3.
I20260709 13:05:04.355546 16524 raft_consensus.cc:697] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:05:04.356918 16524 consensus_queue.cc:237] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.365697 15988 catalog_manager.cc:5697] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.400305 16494 raft_consensus.cc:493] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.400750 16494 raft_consensus.cc:515] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.403028 16494 leader_election.cc:290] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.403787 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:04.403650 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:04.404573 16163 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 3.
I20260709 13:05:04.405901 16058 leader_election.cc:304] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:04.406610 16494 raft_consensus.cc:2804] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:04.406946 16494 raft_consensus.cc:493] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.407217 16494 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.413717 16494 raft_consensus.cc:515] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.415663 16494 leader_election.cc:290] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 4 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.416419 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:04.416834 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:04.417135 16163 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.425895 16163 raft_consensus.cc:2468] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 4.
I20260709 13:05:04.427089 16058 leader_election.cc:304] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:04.428138 16494 raft_consensus.cc:2804] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:04.429211 16494 raft_consensus.cc:697] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:05:04.430019 16494 consensus_queue.cc:237] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.438874 15991 catalog_manager.cc:5697] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.471922 16502 raft_consensus.cc:493] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6780b428c1b04db2ac811ff464ad8302)
I20260709 13:05:04.472450 16502 raft_consensus.cc:515] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.474525 16502 leader_election.cc:290] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:04.475704 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:04.476024 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c94d950bb74ea885d1edded33e3751" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:04.476528 16089 raft_consensus.cc:2368] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 for earlier term 2. Current term is 3.
I20260709 13:05:04.477847 16208 leader_election.cc:400] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187) with higher term. Message: Invalid argument: T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 for earlier term 2. Current term is 3.
I20260709 13:05:04.478226 16208 leader_election.cc:403] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:04.478775 16502 raft_consensus.cc:3060] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.480762  7088 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:05:04.480644 16156 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47384: Illegal state: replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config: current role FOLLOWER
I20260709 13:05:04.486331 16502 raft_consensus.cc:2749] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187) with higher term. Message: Invalid argument: T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 for earlier term 2. Current term is 3.
W20260709 13:05:04.486649 15977 catalog_manager.cc:5107] TS 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): alter failed for tablet 84c9140cafa94f4999caacb5c21f9bc8 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]): Illegal state: replica 6780b428c1b04db2ac811ff464ad8302 is not leader of this config: current role FOLLOWER
I20260709 13:05:04.488652 16502 raft_consensus.cc:493] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 38ca1a1c8e1f4d2696338fe5931bfab3)
I20260709 13:05:04.489220 16502 raft_consensus.cc:515] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.491194 16502 leader_election.cc:290] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:04.492949 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:04.493232 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d099bc4e9b5b48149e8900f06a7f96e6" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:04.494022 16167 raft_consensus.cc:2368] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 for earlier term 3. Current term is 4.
I20260709 13:05:04.493180 16163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c54f978fa69d4dcda769b92627248831"
dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
mode: GRACEFUL
new_leader_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:60546
I20260709 13:05:04.494601 16163 raft_consensus.cc:606] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Received request to transfer leadership to TS b1d3dfeee46a4431a76ef056b489c161
I20260709 13:05:04.495126 16207 leader_election.cc:400] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323) with higher term. Message: Invalid argument: T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 for earlier term 3. Current term is 4.
I20260709 13:05:04.495463 16207 leader_election.cc:403] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:04.495951  7088 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 13:05:04.496363 16578 raft_consensus.cc:3060] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.496518  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:04.502307  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:05:04.502705  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:04.503871 16578 raft_consensus.cc:2749] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323) with higher term. Message: Invalid argument: T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1d3dfeee46a4431a76ef056b489c161 for earlier term 3. Current term is 4.
I20260709 13:05:04.587414 16524 raft_consensus.cc:493] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.588029 16524 raft_consensus.cc:515] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.590422 16524 leader_election.cc:290] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.592118 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:04.592121 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:04.593014 16237 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 2.
I20260709 13:05:04.593068 16089 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 3.
I20260709 13:05:04.594194 16131 leader_election.cc:304] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:05:04.594925 16524 raft_consensus.cc:2804] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:04.595286 16524 raft_consensus.cc:493] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.595610 16524 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.602916 16524 raft_consensus.cc:515] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.605341 16524 leader_election.cc:290] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 4 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.605598 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:04.605914 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c9140cafa94f4999caacb5c21f9bc8" candidate_uuid: "6780b428c1b04db2ac811ff464ad8302" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:04.606348 16089 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.606508 16237 raft_consensus.cc:3060] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.614526 16237 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 4.
I20260709 13:05:04.614733 16089 raft_consensus.cc:2468] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6780b428c1b04db2ac811ff464ad8302 in term 4.
I20260709 13:05:04.616257 16134 leader_election.cc:304] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:05:04.617020 16524 raft_consensus.cc:2804] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:04.617501 16524 raft_consensus.cc:697] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 4 LEADER]: Becoming Leader. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:05:04.618316 16524 consensus_queue.cc:237] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.622385 16576 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.623026 16576 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.625900 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:04.626607 16163 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 2.
I20260709 13:05:04.627043 16576 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.628039 16058 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:05:04.627902 15991 catalog_manager.cc:5697] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6780b428c1b04db2ac811ff464ad8302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.629078 16576 raft_consensus.cc:2804] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:04.629225 15991 catalog_manager.cc:5789] TS 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323) does not have the latest schema for tablet 84c9140cafa94f4999caacb5c21f9bc8 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:04.629496 16576 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.629873 16576 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.630514 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161" is_pre_election: true
I20260709 13:05:04.631515 16237 raft_consensus.cc:2410] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 38ca1a1c8e1f4d2696338fe5931bfab3 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:04.638270 16576 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.640453 16576 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 election: Requested vote from peers 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323), b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115)
I20260709 13:05:04.641352 16163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:04.641543 16237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
I20260709 13:05:04.641911 16163 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.642261 16237 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.647418 16163 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38ca1a1c8e1f4d2696338fe5931bfab3 in term 3.
I20260709 13:05:04.648721 16058 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, 6780b428c1b04db2ac811ff464ad8302; no voters: 
I20260709 13:05:04.649520 16576 raft_consensus.cc:2804] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.649967 16576 raft_consensus.cc:697] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 LEADER]: Becoming Leader. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:05:04.650492 16237 raft_consensus.cc:2410] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 38ca1a1c8e1f4d2696338fe5931bfab3 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:04.651487 16576 consensus_queue.cc:237] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.660476 15991 catalog_manager.cc:5697] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 reported cstate change: term changed from 1 to 3, leader changed from b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3) to 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1). New cstate: current_term: 3 leader_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.661886 15991 catalog_manager.cc:5789] TS 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187) does not have the latest schema for tablet 80b1515cd569421db7ccea792196ac23 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:04.665135 16089 raft_consensus.cc:1275] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.666824 16524 consensus_queue.cc:1048] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.682381 16594 tablet.cc:1724] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:04.681779 15991 catalog_manager.cc:5789] TS 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187) does not have the latest schema for tablet 76c94d950bb74ea885d1edded33e3751 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:04.693584 16578 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.694288 16578 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.696765 16578 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:04.700197 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302" is_pre_election: true
I20260709 13:05:04.700989 16167 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 3.
I20260709 13:05:04.697454 16092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" is_pre_election: true
I20260709 13:05:04.702864 16207 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:05:04.704342 16578 raft_consensus.cc:2804] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:04.704916 16578 raft_consensus.cc:493] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.705354 16578 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.703851 16597 tablet.cc:1724] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:04.709203 16594 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47384 (request call id 19) took 1836 ms. Trace:
I20260709 13:05:04.718679 16578 raft_consensus.cc:515] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.723006 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:04.723659 16167 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.709744 16594 rpcz_store.cc:276] 0709 13:05:02.872295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.872436 (+   141us) service_pool.cc:224] Handling call
0709 13:05:04.709119 (+1836683us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:02.913887 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 13:05:02.914543 (+   656us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 13:05:02.914575 (+    32us) alter_schema_op.cc:66] Acquired schema lock
0709 13:05:02.914640 (+    65us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 13:05:02.914737 (+    97us) alter_schema_op.cc:128] START. Timestamp: 1783602302914683
0709 13:05:02.914757 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:05:02.915486 (+   729us) log.cc:844] Serialized 204 byte log entry
0709 13:05:02.964207 (+ 48721us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b54000c7a18. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b7090 00007f2efc20a242 00007f2efc1c628f 00007f2efc1a6eaa 00007f2efc1add53 00007f2efc1adcd9 00007f2efc1adc69 00007f2efc1adc31 00007f2efc1acdfd 000000000038f354 000000000038f199
0709 13:05:04.680834 (+1716627us) op_driver.cc:464] REPLICATION: finished
0709 13:05:04.682177 (+  1343us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 13:05:04.684254 (+  2077us) log.cc:844] Serialized 5 byte log entry
0709 13:05:04.704905 (+ 20651us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:04.705753 (+   848us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.708936 (+  3183us) alter_schema_op.cc:73] Released schema lock
0709 13:05:04.708973 (+    37us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":989,"prepare.queue_time_us":32853,"prepare.run_cpu_time_us":19994,"prepare.run_wall_time_us":61442,"raft.queue_time_us":12433,"raft.run_cpu_time_us":4023,"raft.run_wall_time_us":33990,"replication_time_us":1765924,"spinlock_wait_cycles":5143552,"thread_start_us":70105,"threads_started":4,"wal-append.queue_time_us":45924,"wal-append.run_cpu_time_us":1856,"wal-append.run_wall_time_us":1001980}]]}
I20260709 13:05:04.727639 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1515cd569421db7ccea792196ac23" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:04.738142 16167 raft_consensus.cc:2468] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 4.
I20260709 13:05:04.740392 16207 leader_election.cc:304] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6780b428c1b04db2ac811ff464ad8302, b1d3dfeee46a4431a76ef056b489c161; no voters: 38ca1a1c8e1f4d2696338fe5931bfab3
I20260709 13:05:04.738821 16578 leader_election.cc:290] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 4 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:04.741285 16502 raft_consensus.cc:2804] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:04.741860 16502 raft_consensus.cc:697] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 4 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:05:04.742875 16502 consensus_queue.cc:237] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.744299 16237 raft_consensus.cc:1275] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.745786 16524 consensus_queue.cc:1048] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.751080 16599 tablet.cc:1724] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:04.776576 15991 catalog_manager.cc:5697] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 3 to 4, leader changed from 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1) to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 4 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.777994 15991 catalog_manager.cc:5789] TS b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115) does not have the latest schema for tablet 80b1515cd569421db7ccea792196ac23 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:04.827948 16237 raft_consensus.cc:1275] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:04.829196 16576 consensus_queue.cc:1048] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.838277 16167 raft_consensus.cc:1275] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Refusing update from remote peer 38ca1a1c8e1f4d2696338fe5931bfab3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:04.839926 16494 consensus_queue.cc:1048] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.857095 16089 raft_consensus.cc:1275] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:04.858852 16524 consensus_queue.cc:1048] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.874143 16237 raft_consensus.cc:1275] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:04.877064 16524 consensus_queue.cc:1048] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.886350 16577 raft_consensus.cc:993] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: : Instructing follower b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:05:04.886910 16524 raft_consensus.cc:1081] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Signalling peer b1d3dfeee46a4431a76ef056b489c161 to start an election
I20260709 13:05:04.888705 16237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c54f978fa69d4dcda769b92627248831"
dest_uuid: "b1d3dfeee46a4431a76ef056b489c161"
 from {username='slave'} at 127.0.0.1:47010
I20260709 13:05:04.889381 16237 raft_consensus.cc:493] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.889773 16237 raft_consensus.cc:3060] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.897859 16237 raft_consensus.cc:515] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.900779 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54f978fa69d4dcda769b92627248831" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3"
I20260709 13:05:04.900862 16167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54f978fa69d4dcda769b92627248831" candidate_uuid: "b1d3dfeee46a4431a76ef056b489c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "6780b428c1b04db2ac811ff464ad8302"
I20260709 13:05:04.901499 16167 raft_consensus.cc:3055] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:04.901438 16089 raft_consensus.cc:3060] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.901878 16167 raft_consensus.cc:740] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6780b428c1b04db2ac811ff464ad8302, State: Running, Role: LEADER
I20260709 13:05:04.902776 16167 consensus_queue.cc:260] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.903815 16167 raft_consensus.cc:3060] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.909464 16089 raft_consensus.cc:2468] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 2.
I20260709 13:05:04.910856 16167 raft_consensus.cc:2468] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d3dfeee46a4431a76ef056b489c161 in term 2.
I20260709 13:05:04.911180 16208 leader_election.cc:304] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38ca1a1c8e1f4d2696338fe5931bfab3, b1d3dfeee46a4431a76ef056b489c161; no voters: 
I20260709 13:05:04.911336 16237 leader_election.cc:290] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [CANDIDATE]: Term 2 election: Requested vote from peers 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187), 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323)
I20260709 13:05:04.912216 16502 raft_consensus.cc:2804] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.912856 16502 raft_consensus.cc:697] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 2 LEADER]: Becoming Leader. State: Replica: b1d3dfeee46a4431a76ef056b489c161, State: Running, Role: LEADER
I20260709 13:05:04.913720 16502 consensus_queue.cc:237] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:04.926199 15988 catalog_manager.cc:5697] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 reported cstate change: term changed from 1 to 2, leader changed from 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2) to b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "b1d3dfeee46a4431a76ef056b489c161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:05.086052 16167 raft_consensus.cc:1240] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Rejecting Update request from peer 38ca1a1c8e1f4d2696338fe5931bfab3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:05.087385 16603 consensus_queue.cc:1059] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.088375 16494 raft_consensus.cc:3055] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:05.088903 16494 raft_consensus.cc:740] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 38ca1a1c8e1f4d2696338fe5931bfab3, State: Running, Role: LEADER
I20260709 13:05:05.089771 16494 consensus_queue.cc:260] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 } } peers { permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 } } peers { permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 } }
I20260709 13:05:05.090830 16494 raft_consensus.cc:3060] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.204952 16089 raft_consensus.cc:1275] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:05.205308 16237 raft_consensus.cc:1275] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Refusing update from remote peer 6780b428c1b04db2ac811ff464ad8302: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:05.206307 16524 consensus_queue.cc:1048] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.207178 16577 consensus_queue.cc:1048] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d3dfeee46a4431a76ef056b489c161" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 43115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.223676 15988 catalog_manager.cc:5789] TS b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115) does not have the latest schema for tablet 84c9140cafa94f4999caacb5c21f9bc8 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.229104 15991 catalog_manager.cc:5789] TS 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187) does not have the latest schema for tablet 84c9140cafa94f4999caacb5c21f9bc8 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.240247 15991 catalog_manager.cc:5789] TS b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115) does not have the latest schema for tablet 84c9140cafa94f4999caacb5c21f9bc8 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.248538 15991 catalog_manager.cc:5789] TS 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323) does not have the latest schema for tablet 84c9140cafa94f4999caacb5c21f9bc8 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.251811 15988 catalog_manager.cc:5789] TS 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187) does not have the latest schema for tablet 84c9140cafa94f4999caacb5c21f9bc8 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.324719 16089 raft_consensus.cc:1275] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:05.325825 16502 consensus_queue.cc:1048] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.334529 16167 raft_consensus.cc:1275] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:05.336719 16502 consensus_queue.cc:1048] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:05.361608 16089 raft_consensus.cc:1275] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:05.364722 16167 raft_consensus.cc:1275] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Refusing update from remote peer b1d3dfeee46a4431a76ef056b489c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:05.364665 16502 consensus_queue.cc:1048] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38ca1a1c8e1f4d2696338fe5931bfab3" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.365514 16502 consensus_queue.cc:1243] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Peer 38ca1a1c8e1f4d2696338fe5931bfab3 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:05:05.367096 16502 consensus_queue.cc:1048] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6780b428c1b04db2ac811ff464ad8302" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.368461 16089 pending_rounds.cc:85] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: Aborting all ops after (but not including) 1
I20260709 13:05:05.368902 16089 pending_rounds.cc:107] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:05:05.374490 16089 raft_consensus.cc:2889] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:05.378891 15991 catalog_manager.cc:5789] TS 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323) does not have the latest schema for tablet 80b1515cd569421db7ccea792196ac23 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.391294 15991 catalog_manager.cc:5789] TS 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187) does not have the latest schema for tablet 80b1515cd569421db7ccea792196ac23 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.394981 16616 tablet.cc:1724] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:05.398918 16614 tablet.cc:1724] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:05.402611 15991 catalog_manager.cc:5789] TS 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187) does not have the latest schema for tablet 80b1515cd569421db7ccea792196ac23 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.409423 15989 catalog_manager.cc:5789] TS 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323) does not have the latest schema for tablet 80b1515cd569421db7ccea792196ac23 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.411769 15988 catalog_manager.cc:5789] TS b1d3dfeee46a4431a76ef056b489c161 (127.6.236.3:43115) does not have the latest schema for tablet 80b1515cd569421db7ccea792196ac23 (table soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b]). Expected version 1 got 0
I20260709 13:05:05.403762 16615 tablet.cc:1724] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:05.431267 16614 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:46984 (request call id 18) took 2527 ms. Trace:
I20260709 13:05:05.431677 16614 rpcz_store.cc:276] 0709 13:05:02.903796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.904312 (+   516us) service_pool.cc:224] Handling call
0709 13:05:05.431156 (+2526844us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:02.967085 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 13:05:02.967710 (+   625us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 13:05:02.967741 (+    31us) alter_schema_op.cc:66] Acquired schema lock
0709 13:05:02.967801 (+    60us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 13:05:02.967923 (+   122us) alter_schema_op.cc:128] START. Timestamp: 1783602302967853
0709 13:05:02.967946 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:02.968622 (+   676us) log.cc:844] Serialized 204 byte log entry
0709 13:05:03.091353 (+122731us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5400556ca0. stack: 00007f2ef912e343 00007f2ef912e240 00007f2ef8abd1d4 00007f2f027fb304 00007f2f027fb299 00007f2efc1b6571 00007f2efc1c2dbe 00007f2efc1cd930 00007f2efc1cd8d8 00007f2efc1cd858 00007f2efc1cd813 00007f2efc1cca9c 00007f2f020b8626 00007f2f020b2dd8 00007f2efc2097cb 00007f2efc20c2c0
0709 13:05:05.376931 (+2285578us) op_driver.cc:464] REPLICATION: finished
0709 13:05:05.398759 (+ 21828us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 13:05:05.408429 (+  9670us) log.cc:844] Serialized 5 byte log entry
0709 13:05:05.423794 (+ 15365us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:05.430893 (+  7099us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.431006 (+   113us) alter_schema_op.cc:73] Released schema lock
0709 13:05:05.431040 (+    34us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":21614,"prepare.queue_time_us":61482,"prepare.run_cpu_time_us":42189,"prepare.run_wall_time_us":66536,"raft.queue_time_us":767,"raft.run_cpu_time_us":2394,"raft.run_wall_time_us":16512,"replication_time_us":2408852,"spinlock_wait_cycles":5275904,"thread_start_us":120199,"threads_started":3,"wal-append.queue_time_us":66519,"wal-append.run_cpu_time_us":4692,"wal-append.run_wall_time_us":1055424}]]}
I20260709 13:05:05.532771  7088 tablet_server.cc:179] TabletServer@127.6.236.1:0 shutting down...
W20260709 13:05:05.565896 16134 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 13:05:05.572728 16615 tablet.cc:1724] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:05.576596 16614 tablet.cc:1724] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:05.581619 16134 consensus_peers.cc:597] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.587716  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:05.591369  7088 tablet_replica.cc:333] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.592489  7088 raft_consensus.cc:2243] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.594483  7088 raft_consensus.cc:2272] T 3049d28b250140d0847005830512ef30 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.602759  7088 tablet_replica.cc:333] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
W20260709 13:05:05.603006 16134 consensus_peers.cc:597] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.603816  7088 raft_consensus.cc:2243] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.604488  7088 raft_consensus.cc:2272] T 76c94d950bb74ea885d1edded33e3751 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.607991  7088 tablet_replica.cc:333] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.609045  7088 raft_consensus.cc:2243] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.610136  7088 raft_consensus.cc:2272] T a8d9f19827114f07b0fe629287178076 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.610661 15989 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179: soft_deleted_table [id=ada1bb5771f54dd09e21c208e4fad70b] alter complete (version 1)
I20260709 13:05:05.615813  7088 tablet_replica.cc:333] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.616521  7088 raft_consensus.cc:2243] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.617166  7088 raft_consensus.cc:2272] T 80b1515cd569421db7ccea792196ac23 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.619540  7088 tablet_replica.cc:333] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.620180  7088 raft_consensus.cc:2243] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.620636  7088 raft_consensus.cc:2272] T 84c9140cafa94f4999caacb5c21f9bc8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.623301  7088 tablet_replica.cc:333] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.623898  7088 raft_consensus.cc:2243] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.624670  7088 raft_consensus.cc:2272] T 6d89e47f26414247a73208ab819d56f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.626854  7088 tablet_replica.cc:333] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.627492  7088 raft_consensus.cc:2243] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.627960  7088 raft_consensus.cc:2272] T c54f978fa69d4dcda769b92627248831 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.630546  7088 tablet_replica.cc:333] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.631129  7088 raft_consensus.cc:2243] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.631593  7088 raft_consensus.cc:2272] T 6d9d00f9f6424622835c58e0cf65adf7 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.633875  7088 tablet_replica.cc:333] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.634457  7088 raft_consensus.cc:2243] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.634900  7088 raft_consensus.cc:2272] T ec83275982274fc8a11575ec25c1f3f1 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.637631  7088 tablet_replica.cc:333] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.638342  7088 raft_consensus.cc:2243] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.638792  7088 raft_consensus.cc:2272] T 945df9191d574f789f87d7c54a6233b8 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.641321  7088 tablet_replica.cc:333] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.642038  7088 raft_consensus.cc:2243] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.642596  7088 raft_consensus.cc:2272] T 4d5cc4db33d24d4e8d5435ecc4644452 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.644774  7088 tablet_replica.cc:333] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.645313  7088 raft_consensus.cc:2243] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.645730  7088 raft_consensus.cc:2272] T 418653df9e4c47dc8e92414fc4e8ba13 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.647889  7088 tablet_replica.cc:333] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.648409  7088 raft_consensus.cc:2243] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.648813  7088 raft_consensus.cc:2272] T 08d081f5f9584ec39c5513b0f37417d4 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.650978  7088 tablet_replica.cc:333] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.651475  7088 raft_consensus.cc:2243] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.651886  7088 raft_consensus.cc:2272] T 93ef8eecde5a4d518c4ad0630903a3bc P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.654186  7088 tablet_replica.cc:333] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.654731  7088 raft_consensus.cc:2243] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.655476  7088 raft_consensus.cc:2272] T d099bc4e9b5b48149e8900f06a7f96e6 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.658174  7088 tablet_replica.cc:333] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.658774  7088 raft_consensus.cc:2243] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.659682  7088 raft_consensus.cc:2272] T 39adaf742dcf458887e846f5c71368f2 P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.662011  7088 tablet_replica.cc:333] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.662667  7088 raft_consensus.cc:2243] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.663589  7088 raft_consensus.cc:2272] T 947d22b3590b4c279fe9904c79fcaeaf P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.665834  7088 tablet_replica.cc:333] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3: stopping tablet replica
I20260709 13:05:05.666566  7088 raft_consensus.cc:2243] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.667346  7088 raft_consensus.cc:2272] T 62be6c70c94d46139232047a8097c46e P 38ca1a1c8e1f4d2696338fe5931bfab3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.680578 16208 consensus_peers.cc:597] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.712754  7088 tablet_server.cc:196] TabletServer@127.6.236.1:0 shutdown complete.
W20260709 13:05:05.734653 16134 consensus_peers.cc:597] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.754256  7088 tablet_server.cc:179] TabletServer@127.6.236.2:0 shutting down...
W20260709 13:05:05.764472 16207 consensus_peers.cc:597] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Couldn't send request to peer 6780b428c1b04db2ac811ff464ad8302. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.780085 16134 consensus_peers.cc:597] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.801573 16134 consensus_peers.cc:597] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.805022  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:05.806172  7088 tablet_replica.cc:333] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.807238  7088 raft_consensus.cc:2243] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.807813  7088 raft_consensus.cc:2272] T 3049d28b250140d0847005830512ef30 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.810571  7088 tablet_replica.cc:333] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
W20260709 13:05:05.810968 16208 consensus_peers.cc:597] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.811264 16207 consensus_peers.cc:597] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Couldn't send request to peer 6780b428c1b04db2ac811ff464ad8302. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.811583  7088 raft_consensus.cc:2243] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.812672  7088 raft_consensus.cc:2272] T 76c94d950bb74ea885d1edded33e3751 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.815646  7088 tablet_replica.cc:333] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.816459  7088 raft_consensus.cc:2243] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.817057  7088 raft_consensus.cc:2272] T 80b1515cd569421db7ccea792196ac23 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.819589 16208 consensus_peers.cc:597] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.820485  7088 tablet_replica.cc:333] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.821300  7088 raft_consensus.cc:2243] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.822376  7088 raft_consensus.cc:2272] T 84c9140cafa94f4999caacb5c21f9bc8 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.825460  7088 tablet_replica.cc:333] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.826261  7088 raft_consensus.cc:2243] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.826866  7088 raft_consensus.cc:2272] T a8d9f19827114f07b0fe629287178076 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.829622  7088 tablet_replica.cc:333] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
W20260709 13:05:05.830098 16208 consensus_peers.cc:597] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.830421  7088 raft_consensus.cc:2243] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.831725  7088 raft_consensus.cc:2272] T 93ef8eecde5a4d518c4ad0630903a3bc P 6780b428c1b04db2ac811ff464ad8302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.834810  7088 tablet_replica.cc:333] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.835601  7088 raft_consensus.cc:2243] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.836180  7088 raft_consensus.cc:2272] T d099bc4e9b5b48149e8900f06a7f96e6 P 6780b428c1b04db2ac811ff464ad8302 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.839530  7088 tablet_replica.cc:333] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.840408  7088 raft_consensus.cc:2243] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.840957  7088 raft_consensus.cc:2272] T c54f978fa69d4dcda769b92627248831 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.843811 16207 consensus_peers.cc:597] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Couldn't send request to peer 6780b428c1b04db2ac811ff464ad8302. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.845227  7088 tablet_replica.cc:333] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.845938  7088 raft_consensus.cc:2243] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.846479  7088 raft_consensus.cc:2272] T 6d9d00f9f6424622835c58e0cf65adf7 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.849041  7088 tablet_replica.cc:333] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.849598  7088 raft_consensus.cc:2243] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.850418  7088 raft_consensus.cc:2272] T ec83275982274fc8a11575ec25c1f3f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.852689  7088 tablet_replica.cc:333] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.853190  7088 raft_consensus.cc:2243] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.853617  7088 raft_consensus.cc:2272] T 39adaf742dcf458887e846f5c71368f2 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.855739  7088 tablet_replica.cc:333] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.856267  7088 raft_consensus.cc:2243] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.856725  7088 raft_consensus.cc:2272] T 947d22b3590b4c279fe9904c79fcaeaf P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.859221  7088 tablet_replica.cc:333] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.860025  7088 raft_consensus.cc:2243] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.860708  7088 raft_consensus.cc:2272] T 62be6c70c94d46139232047a8097c46e P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.863643  7088 tablet_replica.cc:333] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.864425  7088 raft_consensus.cc:2243] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.864966  7088 raft_consensus.cc:2272] T 6d89e47f26414247a73208ab819d56f1 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.867722  7088 tablet_replica.cc:333] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.868350  7088 raft_consensus.cc:2243] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.868762  7088 raft_consensus.cc:2272] T 08d081f5f9584ec39c5513b0f37417d4 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.871111  7088 tablet_replica.cc:333] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.871613  7088 raft_consensus.cc:2243] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.872332  7088 raft_consensus.cc:2272] T 4d5cc4db33d24d4e8d5435ecc4644452 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.874297  7088 tablet_replica.cc:333] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.874759  7088 raft_consensus.cc:2243] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.875134  7088 raft_consensus.cc:2272] T 418653df9e4c47dc8e92414fc4e8ba13 P 6780b428c1b04db2ac811ff464ad8302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.877115  7088 tablet_replica.cc:333] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302: stopping tablet replica
I20260709 13:05:05.877556  7088 raft_consensus.cc:2243] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.878312  7088 raft_consensus.cc:2272] T 945df9191d574f789f87d7c54a6233b8 P 6780b428c1b04db2ac811ff464ad8302 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.910324 16208 consensus_peers.cc:597] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.933594 16208 consensus_peers.cc:597] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 38ca1a1c8e1f4d2696338fe5931bfab3 (127.6.236.1:38187): Couldn't send request to peer 38ca1a1c8e1f4d2696338fe5931bfab3. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.944824 16207 consensus_peers.cc:597] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Couldn't send request to peer 6780b428c1b04db2ac811ff464ad8302. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.195484 16207 consensus_peers.cc:597] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Couldn't send request to peer 6780b428c1b04db2ac811ff464ad8302. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.253918 16207 consensus_peers.cc:597] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 -> Peer 6780b428c1b04db2ac811ff464ad8302 (127.6.236.2:41323): Couldn't send request to peer 6780b428c1b04db2ac811ff464ad8302. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.491359  7088 tablet_server.cc:196] TabletServer@127.6.236.2:0 shutdown complete.
I20260709 13:05:06.530182  7088 tablet_server.cc:179] TabletServer@127.6.236.3:0 shutting down...
I20260709 13:05:06.552609  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:06.553285  7088 tablet_replica.cc:333] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.553871  7088 raft_consensus.cc:2243] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.554422  7088 raft_consensus.cc:2272] T 76c94d950bb74ea885d1edded33e3751 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.556754  7088 tablet_replica.cc:333] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.557327  7088 raft_consensus.cc:2243] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.558142  7088 raft_consensus.cc:2272] T 3049d28b250140d0847005830512ef30 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.560132  7088 tablet_replica.cc:333] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.560698  7088 raft_consensus.cc:2243] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.561517  7088 raft_consensus.cc:2272] T 80b1515cd569421db7ccea792196ac23 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.563539  7088 tablet_replica.cc:333] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.564060  7088 raft_consensus.cc:2243] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.564448  7088 raft_consensus.cc:2272] T 84c9140cafa94f4999caacb5c21f9bc8 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.567013  7088 tablet_replica.cc:333] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.567571  7088 raft_consensus.cc:2243] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.568019  7088 raft_consensus.cc:2272] T a8d9f19827114f07b0fe629287178076 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.570056  7088 tablet_replica.cc:333] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.570591  7088 raft_consensus.cc:2243] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.571002  7088 raft_consensus.cc:2272] T 6d89e47f26414247a73208ab819d56f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.572784  7088 tablet_replica.cc:333] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.573312  7088 raft_consensus.cc:2243] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.574054  7088 raft_consensus.cc:2272] T c54f978fa69d4dcda769b92627248831 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.575910  7088 tablet_replica.cc:333] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.576390  7088 raft_consensus.cc:2243] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.576812  7088 raft_consensus.cc:2272] T ec83275982274fc8a11575ec25c1f3f1 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.578758  7088 tablet_replica.cc:333] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.579229  7088 raft_consensus.cc:2243] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.579963  7088 raft_consensus.cc:2272] T 6d9d00f9f6424622835c58e0cf65adf7 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.581863  7088 tablet_replica.cc:333] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.582393  7088 raft_consensus.cc:2243] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.582791  7088 raft_consensus.cc:2272] T 945df9191d574f789f87d7c54a6233b8 P b1d3dfeee46a4431a76ef056b489c161 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.584659  7088 tablet_replica.cc:333] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.585146  7088 raft_consensus.cc:2243] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.585573  7088 raft_consensus.cc:2272] T d099bc4e9b5b48149e8900f06a7f96e6 P b1d3dfeee46a4431a76ef056b489c161 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.587404  7088 tablet_replica.cc:333] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.587900  7088 raft_consensus.cc:2243] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.588622  7088 raft_consensus.cc:2272] T 08d081f5f9584ec39c5513b0f37417d4 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.590569  7088 tablet_replica.cc:333] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.591094  7088 raft_consensus.cc:2243] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.594395  7088 raft_consensus.cc:2272] T 4d5cc4db33d24d4e8d5435ecc4644452 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.596370  7088 tablet_replica.cc:333] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.596859  7088 raft_consensus.cc:2243] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.597594  7088 raft_consensus.cc:2272] T 418653df9e4c47dc8e92414fc4e8ba13 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.599478  7088 tablet_replica.cc:333] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.599946  7088 raft_consensus.cc:2243] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.600356  7088 raft_consensus.cc:2272] T 947d22b3590b4c279fe9904c79fcaeaf P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.602246  7088 tablet_replica.cc:333] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.602727  7088 raft_consensus.cc:2243] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.603143  7088 raft_consensus.cc:2272] T 39adaf742dcf458887e846f5c71368f2 P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.605001  7088 tablet_replica.cc:333] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.605451  7088 raft_consensus.cc:2243] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.605863  7088 raft_consensus.cc:2272] T 62be6c70c94d46139232047a8097c46e P b1d3dfeee46a4431a76ef056b489c161 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.607849  7088 tablet_replica.cc:333] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161: stopping tablet replica
I20260709 13:05:06.608299  7088 raft_consensus.cc:2243] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.608682  7088 raft_consensus.cc:2272] T 93ef8eecde5a4d518c4ad0630903a3bc P b1d3dfeee46a4431a76ef056b489c161 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.646106  7088 tablet_server.cc:196] TabletServer@127.6.236.3:0 shutdown complete.
I20260709 13:05:06.678126  7088 master.cc:562] Master@127.6.236.62:35365 shutting down...
I20260709 13:05:06.698192  7088 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.698709  7088 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.699016  7088 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5f1e579e004c4781b11bd240713a3179: stopping tablet replica
I20260709 13:05:06.718858  7088 master.cc:584] Master@127.6.236.62:35365 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (15678 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:05:06.765635  7088 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.236.62:43531
I20260709 13:05:06.766759  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.771938 16624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.772162 16625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.773432 16627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.774052  7088 server_base.cc:1061] running on GCE node
I20260709 13:05:06.774991  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:06.775169  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.775318  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602306775300 us; error 0 us; skew 500 ppm
I20260709 13:05:06.775827  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.777978  7088 webserver.cc:533] Webserver started at http://127.6.236.62:43039/ using document root <none> and password file <none>
I20260709 13:05:06.778874  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.779035  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:06.779281  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:06.780311  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/master-0-root/instance:
uuid: "eb1bee315c244c5487f90e4c6b48b705"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-j4mc"
I20260709 13:05:06.784482  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:06.787935 16632 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.788663  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:06.788935  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/master-0-root
uuid: "eb1bee315c244c5487f90e4c6b48b705"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-j4mc"
I20260709 13:05:06.789192  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:06.807075  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:06.808272  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:06.847998  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.62:43531
I20260709 13:05:06.848133 16683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.62:43531 every 8 connection(s)
I20260709 13:05:06.852682 16684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.863893 16684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705: Bootstrap starting.
I20260709 13:05:06.869050 16684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.873319 16684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705: No bootstrap required, opened a new log
I20260709 13:05:06.875434 16684 raft_consensus.cc:359] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1bee315c244c5487f90e4c6b48b705" member_type: VOTER }
I20260709 13:05:06.875847 16684 raft_consensus.cc:385] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.876055 16684 raft_consensus.cc:740] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb1bee315c244c5487f90e4c6b48b705, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.876616 16684 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1bee315c244c5487f90e4c6b48b705" member_type: VOTER }
I20260709 13:05:06.877070 16684 raft_consensus.cc:399] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:06.877285 16684 raft_consensus.cc:493] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:06.877525 16684 raft_consensus.cc:3060] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.882165 16684 raft_consensus.cc:515] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1bee315c244c5487f90e4c6b48b705" member_type: VOTER }
I20260709 13:05:06.882671 16684 leader_election.cc:304] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb1bee315c244c5487f90e4c6b48b705; no voters: 
I20260709 13:05:06.883718 16684 leader_election.cc:290] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:06.884099 16687 raft_consensus.cc:2804] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.885421 16687 raft_consensus.cc:697] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 1 LEADER]: Becoming Leader. State: Replica: eb1bee315c244c5487f90e4c6b48b705, State: Running, Role: LEADER
I20260709 13:05:06.886065 16687 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1bee315c244c5487f90e4c6b48b705" member_type: VOTER }
I20260709 13:05:06.886514 16684 sys_catalog.cc:565] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:06.890216 16689 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb1bee315c244c5487f90e4c6b48b705. Latest consensus state: current_term: 1 leader_uuid: "eb1bee315c244c5487f90e4c6b48b705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1bee315c244c5487f90e4c6b48b705" member_type: VOTER } }
I20260709 13:05:06.890311 16688 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb1bee315c244c5487f90e4c6b48b705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1bee315c244c5487f90e4c6b48b705" member_type: VOTER } }
I20260709 13:05:06.891108 16689 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:06.891150 16688 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:06.894001 16693 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:06.898804 16693 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:06.904014  7088 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:06.907657 16693 catalog_manager.cc:1383] Generated new cluster ID: eb77c80afe7c49468729614bc6a7a2fc
I20260709 13:05:06.907934 16693 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:06.948642 16693 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:06.949923 16693 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:06.963977 16693 catalog_manager.cc:6070] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705: Generated new TSK 0
I20260709 13:05:06.964522 16693 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:06.971036  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.976763 16705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.977603 16706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.979579 16708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.979795  7088 server_base.cc:1061] running on GCE node
I20260709 13:05:06.980722  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:06.980923  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.981047  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602306981036 us; error 0 us; skew 500 ppm
I20260709 13:05:06.981482  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.983650  7088 webserver.cc:533] Webserver started at http://127.6.236.1:41705/ using document root <none> and password file <none>
I20260709 13:05:06.984040  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.984207  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:06.984407  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:06.985364  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-0-root/instance:
uuid: "293ddb5b6a0648bfa50cab64b88019d5"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-j4mc"
I20260709 13:05:06.989447  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:06.992651 16713 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.993366  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:06.993623  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-0-root
uuid: "293ddb5b6a0648bfa50cab64b88019d5"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-j4mc"
I20260709 13:05:06.993873  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.019430  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.020587  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.022024  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.024281  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.024453  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.024700  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.024857  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.064983  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.1:38269
I20260709 13:05:07.065091 16775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.1:38269 every 8 connection(s)
I20260709 13:05:07.069689  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.076727 16781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.077831 16780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.079906 16783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.081375 16776 heartbeater.cc:344] Connected to a master server at 127.6.236.62:43531
I20260709 13:05:07.081763 16776 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.082603 16776 heartbeater.cc:507] Master 127.6.236.62:43531 requested a full tablet report, sending...
I20260709 13:05:07.084781 16649 ts_manager.cc:194] Registered new tserver with Master: 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269)
I20260709 13:05:07.084893  7088 server_base.cc:1061] running on GCE node
I20260709 13:05:07.085865  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:07.086062  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.086256  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602307086236 us; error 0 us; skew 500 ppm
I20260709 13:05:07.086747 16649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48566
I20260709 13:05:07.086799  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.091863  7088 webserver.cc:533] Webserver started at http://127.6.236.2:36069/ using document root <none> and password file <none>
I20260709 13:05:07.092355  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.092532  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.092777  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.093876  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-1-root/instance:
uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-j4mc"
I20260709 13:05:07.098224  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:07.101416 16788 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.102116  7088 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:07.102387  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-1-root
uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-j4mc"
I20260709 13:05:07.102672  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.117074  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.118434  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.119861  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.122010  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.122254  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.122486  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.122635  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.163698  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.2:37053
I20260709 13:05:07.163798 16850 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.2:37053 every 8 connection(s)
I20260709 13:05:07.168569  7088 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.176082 16854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.176440 16855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.179049  7088 server_base.cc:1061] running on GCE node
W20260709 13:05:07.179083 16857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.180446  7088 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:07.180716  7088 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.180922  7088 hybrid_clock.cc:648] HybridClock initialized: now 1783602307180907 us; error 0 us; skew 500 ppm
I20260709 13:05:07.181584  7088 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.182694 16851 heartbeater.cc:344] Connected to a master server at 127.6.236.62:43531
I20260709 13:05:07.183050 16851 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.183777 16851 heartbeater.cc:507] Master 127.6.236.62:43531 requested a full tablet report, sending...
I20260709 13:05:07.184227  7088 webserver.cc:533] Webserver started at http://127.6.236.3:32795/ using document root <none> and password file <none>
I20260709 13:05:07.184779  7088 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.185002  7088 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.185350  7088 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.185849 16649 ts_manager.cc:194] Registered new tserver with Master: 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:07.186582  7088 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-2-root/instance:
uuid: "7c03699471964faf80df9d86840a7132"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-j4mc"
I20260709 13:05:07.187347 16649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48582
I20260709 13:05:07.192667  7088 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:07.197216 16862 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.198191  7088 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:07.198482  7088 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-2-root
uuid: "7c03699471964faf80df9d86840a7132"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-j4mc"
I20260709 13:05:07.198738  7088 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskm8PZga/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602033297011-7088-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.210355  7088 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.211536  7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.213191  7088 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.215571  7088 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.215782  7088 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.216002  7088 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.216151  7088 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.256275  7088 rpc_server.cc:307] RPC server started. Bound to: 127.6.236.3:33367
I20260709 13:05:07.256376 16924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.236.3:33367 every 8 connection(s)
I20260709 13:05:07.269794 16925 heartbeater.cc:344] Connected to a master server at 127.6.236.62:43531
I20260709 13:05:07.270278 16925 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.270982 16925 heartbeater.cc:507] Master 127.6.236.62:43531 requested a full tablet report, sending...
I20260709 13:05:07.272809 16649 ts_manager.cc:194] Registered new tserver with Master: 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:07.273062  7088 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013606014s
I20260709 13:05:07.274654 16649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48586
I20260709 13:05:07.298997 16649 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48602:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:07.301803 16649 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:07.369611 16890 tablet_service.cc:1511] Processing CreateTablet for tablet 242da6e6a5ea456e8e2790815657fc58 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.371037 16890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242da6e6a5ea456e8e2790815657fc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.374123 16886 tablet_service.cc:1511] Processing CreateTablet for tablet 141813c83c074f688219ba864c9c0439 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.375671 16886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141813c83c074f688219ba864c9c0439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.376410 16741 tablet_service.cc:1511] Processing CreateTablet for tablet 242da6e6a5ea456e8e2790815657fc58 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.377767 16741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242da6e6a5ea456e8e2790815657fc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.378435 16889 tablet_service.cc:1511] Processing CreateTablet for tablet ceb4ecce4d294cd5902214e71710c5a0 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.379081 16739 tablet_service.cc:1511] Processing CreateTablet for tablet 28fe1cafc89044f1ab57ed9abb53e490 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.379761 16889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb4ecce4d294cd5902214e71710c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.380056 16887 tablet_service.cc:1511] Processing CreateTablet for tablet 1725bcd67ff544409a19572a6640a334 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.381286 16887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1725bcd67ff544409a19572a6640a334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.381594 16738 tablet_service.cc:1511] Processing CreateTablet for tablet 1725bcd67ff544409a19572a6640a334 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.383098 16888 tablet_service.cc:1511] Processing CreateTablet for tablet 28fe1cafc89044f1ab57ed9abb53e490 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.383733 16737 tablet_service.cc:1511] Processing CreateTablet for tablet 141813c83c074f688219ba864c9c0439 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.384353 16888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28fe1cafc89044f1ab57ed9abb53e490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.377653 16740 tablet_service.cc:1511] Processing CreateTablet for tablet ceb4ecce4d294cd5902214e71710c5a0 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.387673 16885 tablet_service.cc:1511] Processing CreateTablet for tablet 117c7f089e1842799cd6b94b41f91e3c (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.388979 16885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117c7f089e1842799cd6b94b41f91e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.393664 16735 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8e616be17347a99d684ae602eac78f (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.380475 16739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28fe1cafc89044f1ab57ed9abb53e490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.396781 16738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1725bcd67ff544409a19572a6640a334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.391898 16736 tablet_service.cc:1511] Processing CreateTablet for tablet 117c7f089e1842799cd6b94b41f91e3c (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.397854 16736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117c7f089e1842799cd6b94b41f91e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.399893 16884 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8e616be17347a99d684ae602eac78f (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.401284 16884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8e616be17347a99d684ae602eac78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.402415 16735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8e616be17347a99d684ae602eac78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.406785 16733 tablet_service.cc:1511] Processing CreateTablet for tablet 2eeca49bddce495faa60a662116ca5df (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.408095 16733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eeca49bddce495faa60a662116ca5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.410252 16883 tablet_service.cc:1511] Processing CreateTablet for tablet f95d1e3b4f45486bbf236c5cf7ae8c0e (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.411652 16883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95d1e3b4f45486bbf236c5cf7ae8c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.411358 16734 tablet_service.cc:1511] Processing CreateTablet for tablet f95d1e3b4f45486bbf236c5cf7ae8c0e (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.412797 16734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95d1e3b4f45486bbf236c5cf7ae8c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.414531 16740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb4ecce4d294cd5902214e71710c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.415781 16737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141813c83c074f688219ba864c9c0439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.443120 16882 tablet_service.cc:1511] Processing CreateTablet for tablet 2eeca49bddce495faa60a662116ca5df (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.444511 16882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eeca49bddce495faa60a662116ca5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.480849 16940 tablet_bootstrap.cc:492] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:07.480964 16941 tablet_bootstrap.cc:492] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:07.494724 16940 tablet_bootstrap.cc:654] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.495951 16816 tablet_service.cc:1511] Processing CreateTablet for tablet 242da6e6a5ea456e8e2790815657fc58 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.497311 16816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242da6e6a5ea456e8e2790815657fc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.499459 16941 tablet_bootstrap.cc:654] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.500381 16815 tablet_service.cc:1511] Processing CreateTablet for tablet ceb4ecce4d294cd5902214e71710c5a0 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.501754 16815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb4ecce4d294cd5902214e71710c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.510833 16814 tablet_service.cc:1511] Processing CreateTablet for tablet 28fe1cafc89044f1ab57ed9abb53e490 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.512353 16814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28fe1cafc89044f1ab57ed9abb53e490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.523581 16813 tablet_service.cc:1511] Processing CreateTablet for tablet 1725bcd67ff544409a19572a6640a334 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.525053 16813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1725bcd67ff544409a19572a6640a334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.531819 16812 tablet_service.cc:1511] Processing CreateTablet for tablet 141813c83c074f688219ba864c9c0439 (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.532294 16810 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8e616be17347a99d684ae602eac78f (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.533298 16812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141813c83c074f688219ba864c9c0439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.534337 16809 tablet_service.cc:1511] Processing CreateTablet for tablet f95d1e3b4f45486bbf236c5cf7ae8c0e (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.535064 16808 tablet_service.cc:1511] Processing CreateTablet for tablet 2eeca49bddce495faa60a662116ca5df (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.535604 16809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95d1e3b4f45486bbf236c5cf7ae8c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.537804 16811 tablet_service.cc:1511] Processing CreateTablet for tablet 117c7f089e1842799cd6b94b41f91e3c (DEFAULT_TABLE table=test-workload [id=5ed7d723ac35439182f83a14bf2efd39]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.541999 16808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eeca49bddce495faa60a662116ca5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.546494 16811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117c7f089e1842799cd6b94b41f91e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.547178 16810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8e616be17347a99d684ae602eac78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.552729 16944 tablet_bootstrap.cc:492] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:07.556264 16941 tablet_bootstrap.cc:492] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:07.556900 16941 ts_tablet_manager.cc:1403] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.076s	user 0.020s	sys 0.003s
I20260709 13:05:07.559386 16944 tablet_bootstrap.cc:654] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.560052 16941 raft_consensus.cc:359] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.560866 16941 raft_consensus.cc:385] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.561162 16941 raft_consensus.cc:740] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.561928 16941 consensus_queue.cc:260] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.567149 16940 tablet_bootstrap.cc:492] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:07.567713 16940 ts_tablet_manager.cc:1403] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.087s	user 0.023s	sys 0.014s
I20260709 13:05:07.573320 16940 raft_consensus.cc:359] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.574100 16940 raft_consensus.cc:385] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.574347 16940 raft_consensus.cc:740] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.575001 16940 consensus_queue.cc:260] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.603228 16944 tablet_bootstrap.cc:492] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:07.603957 16944 ts_tablet_manager.cc:1403] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.009s
I20260709 13:05:07.607156 16944 raft_consensus.cc:359] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:07.607933 16944 raft_consensus.cc:385] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.608222 16944 raft_consensus.cc:740] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.609503 16944 consensus_queue.cc:260] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:07.609855 16776 heartbeater.cc:499] Master 127.6.236.62:43531 was elected leader, sending a full tablet report...
I20260709 13:05:07.612515 16940 ts_tablet_manager.cc:1434] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.045s	user 0.027s	sys 0.007s
I20260709 13:05:07.612353 16941 ts_tablet_manager.cc:1434] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.007s
I20260709 13:05:07.613445 16925 heartbeater.cc:499] Master 127.6.236.62:43531 was elected leader, sending a full tablet report...
I20260709 13:05:07.613720 16940 tablet_bootstrap.cc:492] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:07.613910 16941 tablet_bootstrap.cc:492] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:07.620604 16940 tablet_bootstrap.cc:654] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.620751 16941 tablet_bootstrap.cc:654] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.629451 16946 raft_consensus.cc:493] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.630666 16946 raft_consensus.cc:515] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.632843 16944 ts_tablet_manager.cc:1434] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.007s
I20260709 13:05:07.633718 16946 leader_election.cc:290] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:07.633652 16851 heartbeater.cc:499] Master 127.6.236.62:43531 was elected leader, sending a full tablet report...
I20260709 13:05:07.636740 16944 tablet_bootstrap.cc:492] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:07.647403 16940 tablet_bootstrap.cc:492] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:07.647331 16944 tablet_bootstrap.cc:654] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.648036 16940 ts_tablet_manager.cc:1403] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.010s
I20260709 13:05:07.648842 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
W20260709 13:05:07.650590 16866 leader_election.cc:343] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.651873 16940 raft_consensus.cc:359] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.652676 16940 raft_consensus.cc:385] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.652987 16940 raft_consensus.cc:740] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.653854 16940 consensus_queue.cc:260] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.656944 16940 ts_tablet_manager.cc:1434] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:07.657935 16940 tablet_bootstrap.cc:492] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
W20260709 13:05:07.667881 16852 tablet.cc:2406] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:07.670049 16940 tablet_bootstrap.cc:654] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.677232 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
W20260709 13:05:07.679318 16864 leader_election.cc:343] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.679898 16864 leader_election.cc:304] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:07.683073 16946 raft_consensus.cc:2749] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:07.695077 16941 tablet_bootstrap.cc:492] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:07.695802 16941 ts_tablet_manager.cc:1403] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.031s
I20260709 13:05:07.695883 16946 raft_consensus.cc:493] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.696548 16944 tablet_bootstrap.cc:492] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:07.696659 16940 tablet_bootstrap.cc:492] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:07.697232 16944 ts_tablet_manager.cc:1403] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.023s
I20260709 13:05:07.696830 16946 raft_consensus.cc:515] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.697360 16940 ts_tablet_manager.cc:1403] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.014s
I20260709 13:05:07.699213 16941 raft_consensus.cc:359] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.700189 16941 raft_consensus.cc:385] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.700026 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141813c83c074f688219ba864c9c0439" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:07.699193 16946 leader_election.cc:290] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:07.700258 16944 raft_consensus.cc:359] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.700773 16941 raft_consensus.cc:740] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.700690 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141813c83c074f688219ba864c9c0439" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:07.701184 16944 raft_consensus.cc:385] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.701515 16944 raft_consensus.cc:740] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
W20260709 13:05:07.701738 16866 leader_election.cc:343] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:07.702478 16864 leader_election.cc:343] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.702280 16944 consensus_queue.cc:260] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.702543 16941 consensus_queue.cc:260] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.703114 16864 leader_election.cc:304] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:07.703938 16946 raft_consensus.cc:2749] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:07.704023 16940 raft_consensus.cc:359] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.704831 16940 raft_consensus.cc:385] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.705153 16940 raft_consensus.cc:740] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.705281 16941 ts_tablet_manager.cc:1434] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:07.705879 16940 consensus_queue.cc:260] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.706375 16941 tablet_bootstrap.cc:492] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:07.707793 16944 ts_tablet_manager.cc:1434] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:07.708782 16944 tablet_bootstrap.cc:492] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:07.713116 16941 tablet_bootstrap.cc:654] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.715668 16940 ts_tablet_manager.cc:1434] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:05:07.716466 16944 tablet_bootstrap.cc:654] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.719242 16940 tablet_bootstrap.cc:492] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:07.724840 16941 tablet_bootstrap.cc:492] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:07.725482 16941 ts_tablet_manager.cc:1403] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 13:05:07.725893 16940 tablet_bootstrap.cc:654] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.728667 16941 raft_consensus.cc:359] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.729538 16941 raft_consensus.cc:385] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.729843 16941 raft_consensus.cc:740] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.731366 16941 consensus_queue.cc:260] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.733577 16941 ts_tablet_manager.cc:1434] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:07.734522 16941 tablet_bootstrap.cc:492] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:07.739508 16944 tablet_bootstrap.cc:492] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:07.740088 16944 ts_tablet_manager.cc:1403] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.003s
I20260709 13:05:07.740381 16940 tablet_bootstrap.cc:492] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:07.740921 16940 ts_tablet_manager.cc:1403] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:05:07.742091 16941 tablet_bootstrap.cc:654] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.743022 16944 raft_consensus.cc:359] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.743813 16944 raft_consensus.cc:385] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.743803 16940 raft_consensus.cc:359] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.744351 16944 raft_consensus.cc:740] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.744668 16940 raft_consensus.cc:385] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.745034 16940 raft_consensus.cc:740] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.745328 16944 consensus_queue.cc:260] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.745887 16940 consensus_queue.cc:260] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.748122 16940 ts_tablet_manager.cc:1434] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:07.749094 16940 tablet_bootstrap.cc:492] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:07.750700 16944 ts_tablet_manager.cc:1434] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:05:07.751816 16944 tablet_bootstrap.cc:492] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:07.753525 16941 tablet_bootstrap.cc:492] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:07.754063 16941 ts_tablet_manager.cc:1403] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.009s
I20260709 13:05:07.755203 16940 tablet_bootstrap.cc:654] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.756960 16941 raft_consensus.cc:359] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.757709 16941 raft_consensus.cc:385] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.757797 16944 tablet_bootstrap.cc:654] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.758033 16941 raft_consensus.cc:740] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.759047 16941 consensus_queue.cc:260] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.761595 16949 raft_consensus.cc:493] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.762182 16949 raft_consensus.cc:515] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.763195 16941 ts_tablet_manager.cc:1434] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:05:07.764284 16941 tablet_bootstrap.cc:492] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:07.767246 16947 raft_consensus.cc:493] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.767803 16947 raft_consensus.cc:515] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.770735 16941 tablet_bootstrap.cc:654] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.773236 16944 tablet_bootstrap.cc:492] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:07.773751 16944 ts_tablet_manager.cc:1403] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 13:05:07.774574 16947 leader_election.cc:290] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:07.778327 16940 tablet_bootstrap.cc:492] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:07.780175 16940 ts_tablet_manager.cc:1403] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260709 13:05:07.782207 16949 leader_election.cc:290] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:07.783368 16940 raft_consensus.cc:359] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.784207 16940 raft_consensus.cc:385] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.784500 16940 raft_consensus.cc:740] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.785266 16940 consensus_queue.cc:260] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.787731 16940 ts_tablet_manager.cc:1434] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:07.788884 16940 tablet_bootstrap.cc:492] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:07.776909 16944 raft_consensus.cc:359] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.791508 16944 raft_consensus.cc:385] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.791823 16944 raft_consensus.cc:740] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.792604 16944 consensus_queue.cc:260] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.794960 16944 ts_tablet_manager.cc:1434] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:05:07.795790 16949 raft_consensus.cc:493] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.796229 16949 raft_consensus.cc:515] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.801450 16940 tablet_bootstrap.cc:654] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.802620 16949 leader_election.cc:290] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:07.796144 16944 tablet_bootstrap.cc:492] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:07.811717 16944 tablet_bootstrap.cc:654] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.813410 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1725bcd67ff544409a19572a6640a334" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:07.814165 16751 raft_consensus.cc:2468] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:07.815192 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eeca49bddce495faa60a662116ca5df" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:07.815865 16750 raft_consensus.cc:2468] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:07.816998 16792 leader_election.cc:304] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:07.817792 16949 raft_consensus.cc:2804] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.818235 16792 leader_election.cc:304] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:07.818222 16949 raft_consensus.cc:493] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.821156 16949 raft_consensus.cc:3060] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.821406 16940 tablet_bootstrap.cc:492] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:07.822038 16940 ts_tablet_manager.cc:1403] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.003s
I20260709 13:05:07.825351 16940 raft_consensus.cc:359] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:07.826181 16940 raft_consensus.cc:385] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.826483 16940 raft_consensus.cc:740] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.829034 16940 consensus_queue.cc:260] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:07.832572 16968 raft_consensus.cc:2804] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.833205 16949 raft_consensus.cc:515] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.833626 16968 raft_consensus.cc:493] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.834105 16968 raft_consensus.cc:3060] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.835299 16940 ts_tablet_manager.cc:1434] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:07.836344 16940 tablet_bootstrap.cc:492] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:07.839613 16941 tablet_bootstrap.cc:492] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:07.840162 16941 ts_tablet_manager.cc:1403] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.049s
I20260709 13:05:07.842988 16944 tablet_bootstrap.cc:492] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:07.843567 16944 ts_tablet_manager.cc:1403] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.012s
I20260709 13:05:07.843312 16968 raft_consensus.cc:515] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.846611 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eeca49bddce495faa60a662116ca5df" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:07.847239 16750 raft_consensus.cc:3060] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.847715 16941 raft_consensus.cc:359] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:07.848464 16941 raft_consensus.cc:385] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.848747 16941 raft_consensus.cc:740] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.849586 16941 consensus_queue.cc:260] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:07.851173 16940 tablet_bootstrap.cc:654] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.851774 16941 ts_tablet_manager.cc:1434] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:07.851936 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1725bcd67ff544409a19572a6640a334" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:07.852555 16751 raft_consensus.cc:3060] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.852880 16941 tablet_bootstrap.cc:492] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:07.846573 16944 raft_consensus.cc:359] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.854405 16944 raft_consensus.cc:385] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.854686 16944 raft_consensus.cc:740] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.855417 16944 consensus_queue.cc:260] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.859890 16941 tablet_bootstrap.cc:654] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.860260 16751 raft_consensus.cc:2468] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:07.861595 16792 leader_election.cc:304] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:07.871049 16949 leader_election.cc:290] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:07.876377 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1725bcd67ff544409a19572a6640a334" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:07.877409 16826 raft_consensus.cc:2393] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293ddb5b6a0648bfa50cab64b88019d5 in current term 1: Already voted for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in this term.
I20260709 13:05:07.885710 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1725bcd67ff544409a19572a6640a334" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:07.889796 16970 raft_consensus.cc:493] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.890955 16944 ts_tablet_manager.cc:1434] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.047s	user 0.013s	sys 0.013s
I20260709 13:05:07.887598 16949 raft_consensus.cc:2804] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:07.893821 16949 raft_consensus.cc:697] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:07.894282 16944 tablet_bootstrap.cc:492] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:07.894794 16949 consensus_queue.cc:237] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
W20260709 13:05:07.899402 16697 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:07.902014 16944 tablet_bootstrap.cc:654] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.905961 16968 leader_election.cc:290] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:07.892515 16900 raft_consensus.cc:2468] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 0.
I20260709 13:05:07.890372 16970 raft_consensus.cc:515] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:07.909080 16714 leader_election.cc:304] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:07.910264 16947 raft_consensus.cc:2764] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:05:07.911499 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1725bcd67ff544409a19572a6640a334" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:07.912202 16900 raft_consensus.cc:2468] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:07.912406 16940 tablet_bootstrap.cc:492] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:07.913084 16940 ts_tablet_manager.cc:1403] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.032s
I20260709 13:05:07.915864 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1725bcd67ff544409a19572a6640a334" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:07.916268 16940 raft_consensus.cc:359] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.916785 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eeca49bddce495faa60a662116ca5df" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:07.917128 16940 raft_consensus.cc:385] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.917513 16940 raft_consensus.cc:740] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.917902 16899 raft_consensus.cc:3060] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.918982 16897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242da6e6a5ea456e8e2790815657fc58" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:07.919658 16897 raft_consensus.cc:2468] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:07.920890 16789 leader_election.cc:304] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:07.921733 16973 raft_consensus.cc:2804] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.922148 16973 raft_consensus.cc:493] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.922461 16973 raft_consensus.cc:3060] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.918442 16940 consensus_queue.cc:260] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.917564 16898 raft_consensus.cc:3060] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.922569 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eeca49bddce495faa60a662116ca5df" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:07.927875 16940 ts_tablet_manager.cc:1434] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:05:07.931629 16940 tablet_bootstrap.cc:492] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:07.932093 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242da6e6a5ea456e8e2790815657fc58" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:07.932760 16751 raft_consensus.cc:2468] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:07.934999 16970 leader_election.cc:290] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367), 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269)
I20260709 13:05:07.935715 16899 raft_consensus.cc:2468] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:07.937618 16940 tablet_bootstrap.cc:654] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.917268 16750 raft_consensus.cc:2468] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:07.937855 16947 raft_consensus.cc:493] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.930300 16898 raft_consensus.cc:2468] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:07.938369 16947 raft_consensus.cc:515] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.939529 16792 leader_election.cc:304] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:07.940428 16947 leader_election.cc:290] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:07.942392 16944 tablet_bootstrap.cc:492] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:07.942997 16944 ts_tablet_manager.cc:1403] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.002s
I20260709 13:05:07.942444 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:07.945050 16826 raft_consensus.cc:2468] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 0.
I20260709 13:05:07.945989 16944 raft_consensus.cc:359] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.946805 16944 raft_consensus.cc:385] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.947072 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:07.947144 16944 raft_consensus.cc:740] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.947813 16898 raft_consensus.cc:2468] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 0.
I20260709 13:05:07.948302 16944 consensus_queue.cc:260] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.949443 16949 raft_consensus.cc:2804] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:07.949903 16949 raft_consensus.cc:697] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:07.950685 16940 tablet_bootstrap.cc:492] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:07.950733 16949 consensus_queue.cc:237] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.951465 16940 ts_tablet_manager.cc:1403] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:05:07.950938 16715 leader_election.cc:304] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:07.954398 16940 raft_consensus.cc:359] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.955158 16940 raft_consensus.cc:385] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.955462 16940 raft_consensus.cc:740] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.956321 16940 consensus_queue.cc:260] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.954999 16947 raft_consensus.cc:2804] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.957715 16947 raft_consensus.cc:493] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.958125 16947 raft_consensus.cc:3060] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.958796 16944 ts_tablet_manager.cc:1434] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:05:07.960578 16944 tablet_bootstrap.cc:492] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:07.961865 16940 ts_tablet_manager.cc:1434] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:07.962936 16940 tablet_bootstrap.cc:492] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:07.929791 16973 raft_consensus.cc:515] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:07.965993 16947 raft_consensus.cc:515] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.975239 16940 tablet_bootstrap.cc:654] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.975764 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242da6e6a5ea456e8e2790815657fc58" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:07.976366 16750 raft_consensus.cc:3060] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.977324 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:07.978027 16826 raft_consensus.cc:3060] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.982577 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242da6e6a5ea456e8e2790815657fc58" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:07.983290 16898 raft_consensus.cc:3060] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.983703 16826 raft_consensus.cc:2468] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 1.
I20260709 13:05:07.984648 16750 raft_consensus.cc:2468] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:07.984977 16715 leader_election.cc:304] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:07.986245 16944 tablet_bootstrap.cc:654] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.973830 16941 tablet_bootstrap.cc:492] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:07.988413 16941 ts_tablet_manager.cc:1403] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.136s	user 0.048s	sys 0.053s
I20260709 13:05:07.974572 16973 leader_election.cc:290] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367), 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269)
I20260709 13:05:07.991918 16941 raft_consensus.cc:359] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.992843 16941 raft_consensus.cc:385] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.993206 16941 raft_consensus.cc:740] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.994055 16941 consensus_queue.cc:260] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:07.995968 16979 raft_consensus.cc:2804] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:07.997653 16792 leader_election.cc:304] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:07.971136 16648 catalog_manager.cc:5697] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.998574 16973 raft_consensus.cc:2804] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:07.998952 16944 tablet_bootstrap.cc:492] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:07.999639 16944 ts_tablet_manager.cc:1403] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.039s	user 0.002s	sys 0.016s
I20260709 13:05:08.000905 16973 raft_consensus.cc:697] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:08.003144 16944 raft_consensus.cc:359] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.004052 16944 raft_consensus.cc:385] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.004361 16944 raft_consensus.cc:740] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.005355 16947 leader_election.cc:290] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.006520 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:08.007290 16941 ts_tablet_manager.cc:1434] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:05:08.008606 16899 raft_consensus.cc:3060] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.007401 16973 consensus_queue.cc:237] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:08.007876 16898 raft_consensus.cc:2468] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:08.011487 16940 tablet_bootstrap.cc:492] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:08.012094 16940 ts_tablet_manager.cc:1403] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.016s
I20260709 13:05:08.014761 16940 raft_consensus.cc:359] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.015524 16940 raft_consensus.cc:385] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.015846 16940 raft_consensus.cc:740] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.016574 16940 consensus_queue.cc:260] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.017867 16899 raft_consensus.cc:2468] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 1.
I20260709 13:05:08.018734 16940 ts_tablet_manager.cc:1434] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:08.021311 16944 consensus_queue.cc:260] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.023067 16944 ts_tablet_manager.cc:1434] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:05:08.023845 16944 tablet_bootstrap.cc:492] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:08.026841 16979 raft_consensus.cc:697] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:08.027724 16941 tablet_bootstrap.cc:492] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:08.027894 16979 consensus_queue.cc:237] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.035826 16946 raft_consensus.cc:493] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.036458 16941 tablet_bootstrap.cc:654] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.036423 16946 raft_consensus.cc:515] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.038915 16946 leader_election.cc:290] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:08.040021 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:08.040664 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:08.040838 16750 raft_consensus.cc:2468] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:08.041425 16826 raft_consensus.cc:2468] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:08.042570 16866 leader_election.cc:304] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:08.044153 16946 raft_consensus.cc:2804] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.044541 16946 raft_consensus.cc:493] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.044876 16946 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.045909 16944 tablet_bootstrap.cc:654] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.060343 16648 catalog_manager.cc:5697] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.067677 16946 raft_consensus.cc:515] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.068849 16941 tablet_bootstrap.cc:492] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:08.068868 16944 tablet_bootstrap.cc:492] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:08.069747 16944 ts_tablet_manager.cc:1403] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.009s
I20260709 13:05:08.069756 16941 ts_tablet_manager.cc:1403] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.018s
I20260709 13:05:08.070679 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:08.071439 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:08.072058 16826 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.072489 16946 leader_election.cc:290] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:08.074470 16941 raft_consensus.cc:359] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.074648 16944 raft_consensus.cc:359] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.075232 16941 raft_consensus.cc:385] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.075476 16944 raft_consensus.cc:385] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.075582 16941 raft_consensus.cc:740] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.075858 16944 raft_consensus.cc:740] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.076583 16944 consensus_queue.cc:260] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.076814 16647 catalog_manager.cc:5697] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.077361 16941 consensus_queue.cc:260] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.079094 16944 ts_tablet_manager.cc:1434] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:08.078888 16647 catalog_manager.cc:5697] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.079668 16826 raft_consensus.cc:2468] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:08.080116 16944 tablet_bootstrap.cc:492] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:08.071318 16750 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.080896 16864 leader_election.cc:304] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:08.081826 16946 raft_consensus.cc:2804] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.083304 16946 raft_consensus.cc:697] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:08.084095 16946 consensus_queue.cc:237] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.086211 16944 tablet_bootstrap.cc:654] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.080132 16941 ts_tablet_manager.cc:1434] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:05:08.088444 16750 raft_consensus.cc:2468] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:08.089215 16941 tablet_bootstrap.cc:492] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:08.097554 16941 tablet_bootstrap.cc:654] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.101035 16944 tablet_bootstrap.cc:492] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:08.101586 16944 ts_tablet_manager.cc:1403] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.010s
I20260709 13:05:08.102087 16648 catalog_manager.cc:5697] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.104347 16944 raft_consensus.cc:359] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.105124 16944 raft_consensus.cc:385] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.105468 16944 raft_consensus.cc:740] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.106344 16944 consensus_queue.cc:260] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.108505 16944 ts_tablet_manager.cc:1434] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:05:08.105158 16973 raft_consensus.cc:493] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.109939 16973 raft_consensus.cc:515] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.112162 16973 leader_election.cc:290] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.113204 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141813c83c074f688219ba864c9c0439" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:08.113808 16899 raft_consensus.cc:2468] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:08.114801 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141813c83c074f688219ba864c9c0439" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:08.115446 16789 leader_election.cc:304] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
W20260709 13:05:08.116662 16792 leader_election.cc:343] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.116971 16941 tablet_bootstrap.cc:492] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:08.117439 16941 ts_tablet_manager.cc:1403] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.008s
I20260709 13:05:08.117513 16973 raft_consensus.cc:2804] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.117918 16973 raft_consensus.cc:493] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.118160 16946 raft_consensus.cc:493] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.118677 16946 raft_consensus.cc:515] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.118263 16973 raft_consensus.cc:3060] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.120489 16941 raft_consensus.cc:359] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.121213 16941 raft_consensus.cc:385] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.121502 16941 raft_consensus.cc:740] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.121235 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28fe1cafc89044f1ab57ed9abb53e490" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:08.121822 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28fe1cafc89044f1ab57ed9abb53e490" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:08.120582 16946 leader_election.cc:290] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:08.122349 16941 consensus_queue.cc:260] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.122295 16750 raft_consensus.cc:2468] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:08.122467 16826 raft_consensus.cc:2468] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:08.124086 16866 leader_election.cc:304] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:08.124689 16941 ts_tablet_manager.cc:1434] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:05:08.125631 16941 tablet_bootstrap.cc:492] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:08.126366 16973 raft_consensus.cc:515] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.127359 16946 raft_consensus.cc:2804] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.127768 16946 raft_consensus.cc:493] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.128100 16946 raft_consensus.cc:3060] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.128885 16973 leader_election.cc:290] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.130437 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141813c83c074f688219ba864c9c0439" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:08.130899 16941 tablet_bootstrap.cc:654] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.129088 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141813c83c074f688219ba864c9c0439" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:08.132699 16750 raft_consensus.cc:3060] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.136348 16946 raft_consensus.cc:515] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.131019 16899 raft_consensus.cc:3060] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.137616 16750 raft_consensus.cc:2468] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:08.138705 16946 leader_election.cc:290] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:08.140551 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28fe1cafc89044f1ab57ed9abb53e490" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:08.141170 16751 raft_consensus.cc:3060] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.146188 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28fe1cafc89044f1ab57ed9abb53e490" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:08.146894 16826 raft_consensus.cc:3060] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.146035 16899 raft_consensus.cc:2468] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:08.147456 16941 tablet_bootstrap.cc:492] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:08.147969 16941 ts_tablet_manager.cc:1403] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.013s
I20260709 13:05:08.148257 16789 leader_election.cc:304] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:08.149099 16973 raft_consensus.cc:2804] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.149617 16751 raft_consensus.cc:2468] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:08.149569 16973 raft_consensus.cc:697] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:08.150755 16866 leader_election.cc:304] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:08.150557 16941 raft_consensus.cc:359] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.151415 16941 raft_consensus.cc:385] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.151618 16946 raft_consensus.cc:2804] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.151749 16941 raft_consensus.cc:740] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.151180 16973 consensus_queue.cc:237] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.152323 16946 raft_consensus.cc:697] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:08.152807 16941 consensus_queue.cc:260] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.154031 16826 raft_consensus.cc:2468] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:08.153855 16946 consensus_queue.cc:237] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.155979 16941 ts_tablet_manager.cc:1434] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:08.162403 16648 catalog_manager.cc:5697] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.164412 16649 catalog_manager.cc:5697] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.179453 16973 raft_consensus.cc:493] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.179982 16973 raft_consensus.cc:515] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.181521 16973 leader_election.cc:290] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.182422 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c7f089e1842799cd6b94b41f91e3c" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:08.182507 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c7f089e1842799cd6b94b41f91e3c" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:08.183104 16751 raft_consensus.cc:2468] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:08.183202 16899 raft_consensus.cc:2468] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:08.184012 16792 leader_election.cc:304] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:08.184698 16973 raft_consensus.cc:2804] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.185067 16973 raft_consensus.cc:493] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.185353 16973 raft_consensus.cc:3060] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.190405 16973 raft_consensus.cc:515] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.191949 16973 leader_election.cc:290] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.192368 16970 raft_consensus.cc:493] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.192773 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c7f089e1842799cd6b94b41f91e3c" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:08.192951 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c7f089e1842799cd6b94b41f91e3c" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:08.192883 16970 raft_consensus.cc:515] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.193506 16751 raft_consensus.cc:3060] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.193699 16899 raft_consensus.cc:3060] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.195180 16970 leader_election.cc:290] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.195977 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e616be17347a99d684ae602eac78f" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:08.196642 16750 raft_consensus.cc:2468] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:08.196717 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e616be17347a99d684ae602eac78f" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:08.197326 16898 raft_consensus.cc:2468] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:08.197916 16792 leader_election.cc:304] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:08.198899 16970 raft_consensus.cc:2804] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.199340 16970 raft_consensus.cc:493] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.199623 16970 raft_consensus.cc:3060] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.201215 16751 raft_consensus.cc:2468] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:08.201756 16899 raft_consensus.cc:2468] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:08.202406 16792 leader_election.cc:304] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:08.203254 16973 raft_consensus.cc:2804] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.203644 16973 raft_consensus.cc:697] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:08.204404 16973 consensus_queue.cc:237] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.206141 16970 raft_consensus.cc:515] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.207834 16970 leader_election.cc:290] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.209350 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e616be17347a99d684ae602eac78f" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:08.209949 16899 raft_consensus.cc:3060] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.209909 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e616be17347a99d684ae602eac78f" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:08.210772 16751 raft_consensus.cc:3060] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.213033 16649 catalog_manager.cc:5697] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.217448 16899 raft_consensus.cc:2468] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:08.218811 16789 leader_election.cc:304] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:08.217489 16751 raft_consensus.cc:2468] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:08.219483 16973 raft_consensus.cc:2804] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.219961 16973 raft_consensus.cc:697] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:08.220858 16973 consensus_queue.cc:237] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.227615 16649 catalog_manager.cc:5697] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.269532 16826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "242da6e6a5ea456e8e2790815657fc58"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
mode: GRACEFUL
new_leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:35398
I20260709 13:05:08.270048 16826 raft_consensus.cc:606] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Received request to transfer leadership to TS 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:08.284623 16899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28fe1cafc89044f1ab57ed9abb53e490"
dest_uuid: "7c03699471964faf80df9d86840a7132"
mode: GRACEFUL
new_leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:52336
I20260709 13:05:08.285112 16899 raft_consensus.cc:606] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Received request to transfer leadership to TS 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:08.290108 16826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1725bcd67ff544409a19572a6640a334"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
mode: GRACEFUL
new_leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:35398
I20260709 13:05:08.290649 16826 raft_consensus.cc:606] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Received request to transfer leadership to TS 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:08.303628 16899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e"
dest_uuid: "7c03699471964faf80df9d86840a7132"
mode: GRACEFUL
new_leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:52336
I20260709 13:05:08.304150 16899 raft_consensus.cc:606] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Received request to transfer leadership to TS 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:08.308979 16826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eeca49bddce495faa60a662116ca5df"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
mode: GRACEFUL
new_leader_uuid: "7c03699471964faf80df9d86840a7132"
 from {username='slave'} at 127.0.0.1:35398
I20260709 13:05:08.309492 16826 raft_consensus.cc:606] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Received request to transfer leadership to TS 7c03699471964faf80df9d86840a7132
I20260709 13:05:08.342231 16973 consensus_queue.cc:1048] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.348512 16970 raft_consensus.cc:993] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99: : Instructing follower 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:08.349015 16949 raft_consensus.cc:1081] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Signalling peer 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:08.350628 16750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1725bcd67ff544409a19572a6640a334"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:05:08.352825 16750 raft_consensus.cc:493] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.353250 16750 raft_consensus.cc:3060] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.356638 16970 consensus_queue.cc:1048] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.359921 16750 raft_consensus.cc:515] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.367223 16750 leader_election.cc:290] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.367858 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1725bcd67ff544409a19572a6640a334" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:08.368425 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1725bcd67ff544409a19572a6640a334" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:08.368511 16826 raft_consensus.cc:3055] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.369097 16826 raft_consensus.cc:740] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:08.369151 16899 raft_consensus.cc:3060] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.370056 16826 consensus_queue.cc:260] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.371418 16826 raft_consensus.cc:3060] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.375470 16970 consensus_queue.cc:1048] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.376636 16899 raft_consensus.cc:2468] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:08.377768 16714 leader_election.cc:304] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:08.378224 16826 raft_consensus.cc:2468] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:08.378741 16979 raft_consensus.cc:2804] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.379357 16979 raft_consensus.cc:697] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:08.380177 16979 consensus_queue.cc:237] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.384847 16949 raft_consensus.cc:993] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99: : Instructing follower 7c03699471964faf80df9d86840a7132 to start an election
I20260709 13:05:08.385414 16973 raft_consensus.cc:1081] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Signalling peer 7c03699471964faf80df9d86840a7132 to start an election
I20260709 13:05:08.387635 16898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2eeca49bddce495faa60a662116ca5df"
dest_uuid: "7c03699471964faf80df9d86840a7132"
 from {username='slave'} at 127.0.0.1:52334
I20260709 13:05:08.388175 16898 raft_consensus.cc:493] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.388542 16898 raft_consensus.cc:3060] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.389518 16649 catalog_manager.cc:5697] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 1 to 2, leader changed from 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2) to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.390233 16973 consensus_queue.cc:1048] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.397233 16898 raft_consensus.cc:515] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.400511 16899 raft_consensus.cc:1240] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Rejecting Update request from peer 4b64c80440f64c5ba87e7cdf0c709c99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:08.400621 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eeca49bddce495faa60a662116ca5df" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:08.401881 16898 leader_election.cc:290] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 2 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:08.404248 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eeca49bddce495faa60a662116ca5df" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:08.404886 16826 raft_consensus.cc:3055] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.405242 16826 raft_consensus.cc:740] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:08.406052 16826 consensus_queue.cc:260] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.407083 16826 raft_consensus.cc:3060] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.410212 16970 consensus_queue.cc:1048] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.418259 16826 raft_consensus.cc:2468] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 2.
I20260709 13:05:08.419646 16864 leader_election.cc:304] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:08.420849 16946 raft_consensus.cc:2804] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.421352 16946 raft_consensus.cc:697] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 2 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:08.422420 16946 consensus_queue.cc:237] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.427248 16970 consensus_queue.cc:1048] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.433529 16647 catalog_manager.cc:5697] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 1 to 2, leader changed from 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2) to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.435885 16949 raft_consensus.cc:993] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99: : Instructing follower 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:08.436442 16970 raft_consensus.cc:1081] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Signalling peer 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:08.437991 16751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "242da6e6a5ea456e8e2790815657fc58"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:05:08.438591 16751 raft_consensus.cc:493] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.438947 16751 raft_consensus.cc:3060] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.444649 16751 raft_consensus.cc:515] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:08.446554 16751 leader_election.cc:290] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Requested vote from peers 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:08.447280 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242da6e6a5ea456e8e2790815657fc58" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:08.447947 16898 raft_consensus.cc:3060] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.447625 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242da6e6a5ea456e8e2790815657fc58" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:08.448732 16826 raft_consensus.cc:3055] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.449079 16826 raft_consensus.cc:740] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:08.449878 16826 consensus_queue.cc:260] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:08.451205 16826 raft_consensus.cc:3060] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.454434 16898 raft_consensus.cc:2468] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:08.455452 16714 leader_election.cc:304] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:08.456213 16979 raft_consensus.cc:2804] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.456607 16979 raft_consensus.cc:697] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:08.456722 16826 raft_consensus.cc:2468] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:08.457311 16979 consensus_queue.cc:237] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } }
I20260709 13:05:08.463387 16649 catalog_manager.cc:5697] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 1 to 2, leader changed from 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2) to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.488842 16946 consensus_queue.cc:1048] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.494935 16948 raft_consensus.cc:993] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132: : Instructing follower 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:08.495703 16946 raft_consensus.cc:1081] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Signalling peer 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:08.498211 16825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:35378
I20260709 13:05:08.498855 16825 raft_consensus.cc:493] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.499223 16825 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.500301 16948 consensus_queue.cc:1048] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.506889 16825 raft_consensus.cc:515] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.509763 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:08.510414 16751 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.510967 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:08.511616 16898 raft_consensus.cc:3055] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.511904 16898 raft_consensus.cc:740] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:08.512701 16898 consensus_queue.cc:260] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.513731 16898 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.515278 16825 leader_election.cc:290] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.517359 16751 raft_consensus.cc:2468] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:08.518684 16792 leader_election.cc:304] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:08.519652 16970 raft_consensus.cc:2804] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.520362 16970 raft_consensus.cc:697] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:08.520764 16898 raft_consensus.cc:2468] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:08.521209 16970 consensus_queue.cc:237] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.528326 16647 catalog_manager.cc:5697] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 1 to 2, leader changed from 7c03699471964faf80df9d86840a7132 (127.6.236.3) to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.564944 16970 consensus_queue.cc:1048] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.577013 16970 consensus_queue.cc:1048] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.607507 16970 consensus_queue.cc:1048] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.619648 17014 consensus_queue.cc:1048] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.631161 16979 consensus_queue.cc:1048] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.643079 17017 consensus_queue.cc:1048] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.660349 17014 consensus_queue.cc:1048] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.670506 17014 consensus_queue.cc:1048] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.692282 17009 consensus_queue.cc:1048] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.702342 16946 consensus_queue.cc:1048] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.712270 16948 raft_consensus.cc:993] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132: : Instructing follower 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:08.712811 17022 raft_consensus.cc:1081] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Signalling peer 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:08.714489 16751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28fe1cafc89044f1ab57ed9abb53e490"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:51330
I20260709 13:05:08.715044 16751 raft_consensus.cc:493] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.715387 16751 raft_consensus.cc:3060] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.720384 16751 raft_consensus.cc:515] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.721930 16751 leader_election.cc:290] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:08.722822 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28fe1cafc89044f1ab57ed9abb53e490" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:08.722915 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28fe1cafc89044f1ab57ed9abb53e490" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:08.723503 16825 raft_consensus.cc:3060] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.723556 16898 raft_consensus.cc:3055] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.724067 16898 raft_consensus.cc:740] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:08.724841 16898 consensus_queue.cc:260] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.726130 16898 raft_consensus.cc:3060] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.728834 16825 raft_consensus.cc:2468] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:08.729838 16715 leader_election.cc:304] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:08.730531 17017 raft_consensus.cc:2804] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.730983 17017 raft_consensus.cc:697] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:08.731240 16898 raft_consensus.cc:2468] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:08.731917 17017 consensus_queue.cc:237] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:08.738116 16649 catalog_manager.cc:5697] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 1 to 2, leader changed from 7c03699471964faf80df9d86840a7132 (127.6.236.3) to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.855396 16751 raft_consensus.cc:3060] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.860936 16751 raft_consensus.cc:1275] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Refusing update from remote peer 7c03699471964faf80df9d86840a7132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.862205 17022 consensus_queue.cc:1048] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.869993 16825 raft_consensus.cc:1275] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 7c03699471964faf80df9d86840a7132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.871426 16948 consensus_queue.cc:1048] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.887036 16825 raft_consensus.cc:1275] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.888211 17017 consensus_queue.cc:1048] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.895922 16898 raft_consensus.cc:1275] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.897770 16947 consensus_queue.cc:1048] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.927114 16751 raft_consensus.cc:1275] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.928233 17014 consensus_queue.cc:1048] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.936832 16898 raft_consensus.cc:1275] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.938020 16899 raft_consensus.cc:1275] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.938508 16970 consensus_queue.cc:1048] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.939638 16947 consensus_queue.cc:1048] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.947906 16825 raft_consensus.cc:1275] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.949483 17024 consensus_queue.cc:1048] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:09.249253 16898 raft_consensus.cc:1275] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.250535 17024 consensus_queue.cc:1048] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.258347 16825 raft_consensus.cc:1275] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.259711 17024 consensus_queue.cc:1048] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:11.339932 16647 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42790:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:11.342651 16647 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:11.398593 16735 tablet_service.cc:1511] Processing CreateTablet for tablet f0b589e07e404e7ba75beb958bb44635 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.399696 16810 tablet_service.cc:1511] Processing CreateTablet for tablet f0b589e07e404e7ba75beb958bb44635 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.400585 16735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b589e07e404e7ba75beb958bb44635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.401268 16810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b589e07e404e7ba75beb958bb44635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.408993 16737 tablet_service.cc:1511] Processing CreateTablet for tablet 4b321541825b4339b75b585170ed4595 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.409381 16811 tablet_service.cc:1511] Processing CreateTablet for tablet 4b321541825b4339b75b585170ed4595 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.410655 16737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b321541825b4339b75b585170ed4595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.410872 16811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b321541825b4339b75b585170ed4595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.411427 16884 tablet_service.cc:1511] Processing CreateTablet for tablet 211c954cd24b4eb0bc63401492b9a1d7 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.413019 16884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211c954cd24b4eb0bc63401492b9a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.414219 16883 tablet_service.cc:1511] Processing CreateTablet for tablet 4b321541825b4339b75b585170ed4595 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.415601 16883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b321541825b4339b75b585170ed4595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.416144 16890 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1988d038f3400c9a89dabb8240e30c (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.417496 16890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1988d038f3400c9a89dabb8240e30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.419236 16736 tablet_service.cc:1511] Processing CreateTablet for tablet 211c954cd24b4eb0bc63401492b9a1d7 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.420569 16736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211c954cd24b4eb0bc63401492b9a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.421273 16888 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3ec41205954a0391b6c3f100b5c8e1 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.422539 16888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3ec41205954a0391b6c3f100b5c8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.423103 16885 tablet_service.cc:1511] Processing CreateTablet for tablet f0b589e07e404e7ba75beb958bb44635 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.424300 16885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b589e07e404e7ba75beb958bb44635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.427922 16734 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1988d038f3400c9a89dabb8240e30c (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.429433 16734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1988d038f3400c9a89dabb8240e30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.430975 16740 tablet_service.cc:1511] Processing CreateTablet for tablet f49ab3b940484918b80515e5f3b06637 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.433357 16741 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3ec41205954a0391b6c3f100b5c8e1 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.435788 16738 tablet_service.cc:1511] Processing CreateTablet for tablet dfdf252f573e4408ac0145b7b9591974 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.439019 16741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3ec41205954a0391b6c3f100b5c8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.441013 16740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49ab3b940484918b80515e5f3b06637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.442898 16738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdf252f573e4408ac0145b7b9591974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.463444 16809 tablet_service.cc:1511] Processing CreateTablet for tablet 211c954cd24b4eb0bc63401492b9a1d7 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.465059 16809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211c954cd24b4eb0bc63401492b9a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.467604 16812 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1988d038f3400c9a89dabb8240e30c (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.469074 16812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1988d038f3400c9a89dabb8240e30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.471300 16815 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3ec41205954a0391b6c3f100b5c8e1 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.476123 16739 tablet_service.cc:1511] Processing CreateTablet for tablet 44ed8de1c7044a78b0eef133407369f9 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.477550 16739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ed8de1c7044a78b0eef133407369f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.479228 16808 tablet_service.cc:1511] Processing CreateTablet for tablet f49ab3b940484918b80515e5f3b06637 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.482548 16813 tablet_service.cc:1511] Processing CreateTablet for tablet dfdf252f573e4408ac0145b7b9591974 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.485455 16816 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0a98657fb44a2bad5e627ec506ac0d (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.486552 16813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdf252f573e4408ac0145b7b9591974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.487239 16815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3ec41205954a0391b6c3f100b5c8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.477064 16733 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0a98657fb44a2bad5e627ec506ac0d (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.490248 16733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0a98657fb44a2bad5e627ec506ac0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.490455 16816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0a98657fb44a2bad5e627ec506ac0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.491850 16887 tablet_service.cc:1511] Processing CreateTablet for tablet f49ab3b940484918b80515e5f3b06637 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.493060 16808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49ab3b940484918b80515e5f3b06637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.493290 16887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49ab3b940484918b80515e5f3b06637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.493728 16886 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0a98657fb44a2bad5e627ec506ac0d (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.495090 16886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0a98657fb44a2bad5e627ec506ac0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.495293 16889 tablet_service.cc:1511] Processing CreateTablet for tablet 44ed8de1c7044a78b0eef133407369f9 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.496596 16889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ed8de1c7044a78b0eef133407369f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.492396 16882 tablet_service.cc:1511] Processing CreateTablet for tablet dfdf252f573e4408ac0145b7b9591974 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.498715 16882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdf252f573e4408ac0145b7b9591974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.508683 16814 tablet_service.cc:1511] Processing CreateTablet for tablet 44ed8de1c7044a78b0eef133407369f9 (DEFAULT_TABLE table=soft_deleted_table [id=df55889776864e26850027728c10ff3f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.510963 16814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ed8de1c7044a78b0eef133407369f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.583366 17038 tablet_bootstrap.cc:492] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:11.610119 17039 tablet_bootstrap.cc:492] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:11.628808 17039 tablet_bootstrap.cc:654] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.631403 17038 tablet_bootstrap.cc:654] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.647979 17039 tablet_bootstrap.cc:492] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:11.650658 17039 ts_tablet_manager.cc:1403] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.009s
I20260709 13:05:11.656418 17039 raft_consensus.cc:359] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.652674 17038 tablet_bootstrap.cc:492] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:11.657871 17038 ts_tablet_manager.cc:1403] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.004s
I20260709 13:05:11.661072 17038 raft_consensus.cc:359] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.661748 17038 raft_consensus.cc:385] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.662055 17038 raft_consensus.cc:740] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.663237 17038 consensus_queue.cc:260] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.668762 17039 raft_consensus.cc:385] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.669272 17039 raft_consensus.cc:740] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.670663 17038 ts_tablet_manager.cc:1434] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:05:11.671631 17040 tablet_bootstrap.cc:492] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:11.672339 17038 tablet_bootstrap.cc:492] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:11.679309 17038 tablet_bootstrap.cc:654] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:11.682595 16789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.3:33367, user_credentials={real_user=slave}} blocked reactor thread for 48814.9us
I20260709 13:05:11.689968 17039 consensus_queue.cc:260] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.694959 17040 tablet_bootstrap.cc:654] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.700410 17039 ts_tablet_manager.cc:1434] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.010s
I20260709 13:05:11.701593 17039 tablet_bootstrap.cc:492] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:11.710981 17039 tablet_bootstrap.cc:654] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.717296 17038 tablet_bootstrap.cc:492] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:11.718429 17038 ts_tablet_manager.cc:1403] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.004s
I20260709 13:05:11.722458 17038 raft_consensus.cc:359] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.723340 17038 raft_consensus.cc:385] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.731297 17040 tablet_bootstrap.cc:492] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:11.734678 17038 raft_consensus.cc:740] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.734967 17040 ts_tablet_manager.cc:1403] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.019s
I20260709 13:05:11.736017 17038 consensus_queue.cc:260] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.738202 17038 ts_tablet_manager.cc:1434] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:05:11.738410 17040 raft_consensus.cc:359] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.739199 17040 raft_consensus.cc:385] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.739473 17040 raft_consensus.cc:740] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.742285 17038 tablet_bootstrap.cc:492] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:11.741957 17040 consensus_queue.cc:260] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.743124 17041 raft_consensus.cc:493] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.743691 17041 raft_consensus.cc:515] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.744675 17040 ts_tablet_manager.cc:1434] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:05:11.745728 17040 tablet_bootstrap.cc:492] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:11.746029 17041 leader_election.cc:290] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:11.747874 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
W20260709 13:05:11.749847 16792 leader_election.cc:343] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.752195 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:11.752631 17040 tablet_bootstrap.cc:654] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.752909 16898 raft_consensus.cc:2468] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:11.754128 17038 tablet_bootstrap.cc:654] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.754483 16789 leader_election.cc:304] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:11.756428 17041 raft_consensus.cc:2804] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.756879 17041 raft_consensus.cc:493] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.757261 17041 raft_consensus.cc:3060] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.761077 17039 tablet_bootstrap.cc:492] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:11.761734 17039 ts_tablet_manager.cc:1403] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.011s
I20260709 13:05:11.761893 17038 tablet_bootstrap.cc:492] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:11.762467 17038 ts_tablet_manager.cc:1403] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:05:11.764497 17039 raft_consensus.cc:359] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.765087 17039 raft_consensus.cc:385] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.765316 17039 raft_consensus.cc:740] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.761919 17040 tablet_bootstrap.cc:492] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:11.765623 17041 raft_consensus.cc:515] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.766350 17040 ts_tablet_manager.cc:1403] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.009s
I20260709 13:05:11.765991 17039 consensus_queue.cc:260] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.765547 17038 raft_consensus.cc:359] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.767151 17038 raft_consensus.cc:385] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.767366 17038 raft_consensus.cc:740] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.768031 17038 consensus_queue.cc:260] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.768921 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:11.769543 16898 raft_consensus.cc:3060] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.770308 17038 ts_tablet_manager.cc:1434] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:11.771349 17038 tablet_bootstrap.cc:492] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:11.771602 17039 ts_tablet_manager.cc:1434] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:11.769575 17040 raft_consensus.cc:359] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.772547 17040 raft_consensus.cc:385] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.772823 17040 raft_consensus.cc:740] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.773543 17040 consensus_queue.cc:260] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.775828 17040 ts_tablet_manager.cc:1434] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:11.768951 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:11.777671 17039 tablet_bootstrap.cc:492] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:11.778213 17038 tablet_bootstrap.cc:654] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:11.779065 16792 leader_election.cc:343] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.776762 17040 tablet_bootstrap.cc:492] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:11.789222 17039 tablet_bootstrap.cc:654] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.794970 17040 tablet_bootstrap.cc:654] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.797003 17041 leader_election.cc:290] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:11.797749 17025 raft_consensus.cc:493] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.798346 17025 raft_consensus.cc:515] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.797129 16898 raft_consensus.cc:2468] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:11.801275 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:11.801859 17025 leader_election.cc:290] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:11.801891 16789 leader_election.cc:304] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5
W20260709 13:05:11.802784 16792 leader_election.cc:343] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.802871 17025 raft_consensus.cc:2804] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.803551 17025 raft_consensus.cc:697] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:11.804518 17025 consensus_queue.cc:237] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.805826 17039 tablet_bootstrap.cc:492] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:11.806329 17039 ts_tablet_manager.cc:1403] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 13:05:11.806911 17040 tablet_bootstrap.cc:492] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:11.807426 17040 ts_tablet_manager.cc:1403] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.001s
I20260709 13:05:11.809173 17039 raft_consensus.cc:359] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.809947 17039 raft_consensus.cc:385] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.810246 17039 raft_consensus.cc:740] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.810894 17039 consensus_queue.cc:260] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.811736 17040 raft_consensus.cc:359] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.812445 17040 raft_consensus.cc:385] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.812740 17040 raft_consensus.cc:740] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.813063 17039 ts_tablet_manager.cc:1434] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:05:11.813544 17040 consensus_queue.cc:260] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.816149 17040 ts_tablet_manager.cc:1434] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:11.817126 17040 tablet_bootstrap.cc:492] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:11.818228 17044 raft_consensus.cc:493] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.818749 17044 raft_consensus.cc:515] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.820850 17038 tablet_bootstrap.cc:492] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:11.821118 17044 leader_election.cc:290] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:11.821370 17038 ts_tablet_manager.cc:1403] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.013s
I20260709 13:05:11.822894 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:11.823642 17040 tablet_bootstrap.cc:654] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:11.824681 16715 leader_election.cc:343] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.824939 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:11.826376 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:11.824546 17038 raft_consensus.cc:359] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.827172 17038 raft_consensus.cc:385] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.827461 17038 raft_consensus.cc:740] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
W20260709 13:05:11.828431 16714 leader_election.cc:343] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.828191 17038 consensus_queue.cc:260] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.829012 16714 leader_election.cc:304] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5; no voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132
W20260709 13:05:11.826445 16789 leader_election.cc:343] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.830451 16789 leader_election.cc:304] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132
I20260709 13:05:11.831292 17044 raft_consensus.cc:2749] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.831604 17041 raft_consensus.cc:2749] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.832273 17038 ts_tablet_manager.cc:1434] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:05:11.826480 17039 tablet_bootstrap.cc:492] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:11.835638 17038 tablet_bootstrap.cc:492] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:11.835299 16647 catalog_manager.cc:5697] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.841058 17039 tablet_bootstrap.cc:654] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.842537 17038 tablet_bootstrap.cc:654] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.846376 17040 tablet_bootstrap.cc:492] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:11.846879 17040 ts_tablet_manager.cc:1403] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.002s
I20260709 13:05:11.847831 17038 tablet_bootstrap.cc:492] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:11.848237 17038 ts_tablet_manager.cc:1403] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:05:11.851155 17038 raft_consensus.cc:359] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.851854 17038 raft_consensus.cc:385] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.852232 17038 raft_consensus.cc:740] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.852944 17038 consensus_queue.cc:260] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.854086 17039 tablet_bootstrap.cc:492] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:11.854627 17039 ts_tablet_manager.cc:1403] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.005s
I20260709 13:05:11.855250 17038 ts_tablet_manager.cc:1434] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:11.856283 17038 tablet_bootstrap.cc:492] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:11.863945 17038 tablet_bootstrap.cc:654] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.864396 17039 raft_consensus.cc:359] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.865162 17039 raft_consensus.cc:385] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.866631 17041 raft_consensus.cc:493] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.866995 17039 raft_consensus.cc:740] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.867442 17041 raft_consensus.cc:515] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.867841 17039 consensus_queue.cc:260] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.870177 17039 ts_tablet_manager.cc:1434] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:05:11.851754 17040 raft_consensus.cc:359] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.870894 17040 raft_consensus.cc:385] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.871281 17039 tablet_bootstrap.cc:492] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:11.871241 17040 raft_consensus.cc:740] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.872303 17040 consensus_queue.cc:260] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.874832 17040 ts_tablet_manager.cc:1434] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:05:11.876271 17040 tablet_bootstrap.cc:492] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:11.883701 17039 tablet_bootstrap.cc:654] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.886662 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1988d038f3400c9a89dabb8240e30c" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:11.887512 16751 raft_consensus.cc:2468] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:11.889770 17040 tablet_bootstrap.cc:654] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.890853 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1988d038f3400c9a89dabb8240e30c" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:11.891611 16898 raft_consensus.cc:2468] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:11.895155 16792 leader_election.cc:304] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:11.901901 17025 raft_consensus.cc:2804] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.902493 17025 raft_consensus.cc:493] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.902906 17025 raft_consensus.cc:3060] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.917758 17044 raft_consensus.cc:493] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.918498 17044 raft_consensus.cc:515] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.920991 17044 leader_election.cc:290] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:11.869967 17041 leader_election.cc:290] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:11.928774 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:11.931403 16948 raft_consensus.cc:493] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.932049 16948 raft_consensus.cc:515] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:11.934796 16948 leader_election.cc:290] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:11.935477 17044 raft_consensus.cc:493] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.936182 17044 raft_consensus.cc:515] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
W20260709 13:05:11.941233 16697 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:11.937304 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed8de1c7044a78b0eef133407369f9" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:11.943621 17044 leader_election.cc:290] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:11.944235 16826 raft_consensus.cc:2468] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:11.950598 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b321541825b4339b75b585170ed4595" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:11.956187 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:11.974030 16864 leader_election.cc:304] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:11.974625 16898 raft_consensus.cc:2393] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293ddb5b6a0648bfa50cab64b88019d5 in current term 1: Already voted for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in this term.
I20260709 13:05:11.957290 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b321541825b4339b75b585170ed4595" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:11.975121 16948 raft_consensus.cc:2804] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.975745 16948 raft_consensus.cc:493] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.969151 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed8de1c7044a78b0eef133407369f9" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:11.976133 16948 raft_consensus.cc:3060] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.985386 16714 leader_election.cc:304] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5; no voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132
I20260709 13:05:11.987176 17026 raft_consensus.cc:3060] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:11.994730 16866 leader_election.cc:343] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:11.999080 16714 leader_election.cc:343] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:12.006839 16715 leader_election.cc:343] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.007516 16715 leader_election.cc:304] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5; no voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132
I20260709 13:05:12.008862 17044 raft_consensus.cc:2749] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.016609 17026 raft_consensus.cc:2749] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.021431 17025 raft_consensus.cc:515] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.023618 17039 tablet_bootstrap.cc:492] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:12.024245 17039 ts_tablet_manager.cc:1403] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.153s	user 0.053s	sys 0.080s
I20260709 13:05:12.024931 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1988d038f3400c9a89dabb8240e30c" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:12.025185 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1988d038f3400c9a89dabb8240e30c" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.025544 16751 raft_consensus.cc:3060] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.025755 16900 raft_consensus.cc:3060] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.027597 17039 raft_consensus.cc:359] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.028486 17039 raft_consensus.cc:385] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.028760 17039 raft_consensus.cc:740] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.031520 17038 tablet_bootstrap.cc:492] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:12.032119 17038 ts_tablet_manager.cc:1403] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.176s	user 0.063s	sys 0.099s
I20260709 13:05:12.033982 16751 raft_consensus.cc:2468] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:12.034991 16900 raft_consensus.cc:2468] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:12.035447 16792 leader_election.cc:304] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.036118 17062 raft_consensus.cc:493] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.036573 17063 raft_consensus.cc:2804] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.037161 17025 leader_election.cc:290] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.037402 17063 raft_consensus.cc:697] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:12.029807 17039 consensus_queue.cc:260] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.036649 17062 raft_consensus.cc:515] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.038461 17063 consensus_queue.cc:237] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.035272 17038 raft_consensus.cc:359] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.039525 17038 raft_consensus.cc:385] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.039860 17038 raft_consensus.cc:740] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.040655 17038 consensus_queue.cc:260] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.041606 17062 leader_election.cc:290] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:12.042307 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:12.043066 17038 ts_tablet_manager.cc:1434] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:05:12.036957 16948 raft_consensus.cc:515] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
W20260709 13:05:12.043629 16866 leader_election.cc:343] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.044202 17038 tablet_bootstrap.cc:492] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:12.045571 16948 leader_election.cc:290] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:12.046379 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed8de1c7044a78b0eef133407369f9" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
W20260709 13:05:12.047597 16866 leader_election.cc:343] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.056783 17040 tablet_bootstrap.cc:492] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:12.057482 17040 ts_tablet_manager.cc:1403] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.049s
I20260709 13:05:12.059391 17039 ts_tablet_manager.cc:1434] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 13:05:12.060549 17039 tablet_bootstrap.cc:492] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:12.061100 17040 raft_consensus.cc:359] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.061896 17040 raft_consensus.cc:385] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.062211 17040 raft_consensus.cc:740] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.062891 17040 consensus_queue.cc:260] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.061201 16649 catalog_manager.cc:5697] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.056954 17038 tablet_bootstrap.cc:654] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.067693 17039 tablet_bootstrap.cc:654] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.072294 16824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed8de1c7044a78b0eef133407369f9" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.073029 16824 raft_consensus.cc:3060] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.073658 17040 ts_tablet_manager.cc:1434] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:05:12.074949 17040 tablet_bootstrap.cc:492] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:12.076839 17039 tablet_bootstrap.cc:492] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:12.077437 17039 ts_tablet_manager.cc:1403] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:05:12.080909 17039 raft_consensus.cc:359] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.081664 17040 tablet_bootstrap.cc:654] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.081668 17039 raft_consensus.cc:385] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.083264 17039 raft_consensus.cc:740] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.084643 17062 raft_consensus.cc:493] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.085259 17038 tablet_bootstrap.cc:492] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:12.085937 17038 ts_tablet_manager.cc:1403] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.014s
I20260709 13:05:12.085270 17062 raft_consensus.cc:515] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.089131 17038 raft_consensus.cc:359] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.089488 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:12.089838 17038 raft_consensus.cc:385] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.090260 16751 raft_consensus.cc:2468] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:12.084928 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:12.090307 17038 raft_consensus.cc:740] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.091509 16866 leader_election.cc:304] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:12.094457 17038 consensus_queue.cc:260] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
W20260709 13:05:12.092499 16864 leader_election.cc:343] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.091908 17039 consensus_queue.cc:260] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.095866 16864 leader_election.cc:304] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:12.098388 17038 ts_tablet_manager.cc:1434] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:05:12.099098 16948 raft_consensus.cc:2804] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.099691 17038 tablet_bootstrap.cc:492] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:12.098659 17039 ts_tablet_manager.cc:1434] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.006s
I20260709 13:05:12.101290 17062 leader_election.cc:290] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:12.102011 17062 raft_consensus.cc:2749] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.102537 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:12.103320 16825 raft_consensus.cc:2468] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:12.105068 17039 tablet_bootstrap.cc:492] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:12.105755 16824 raft_consensus.cc:2468] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:12.106835 17038 tablet_bootstrap.cc:654] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.107084 16864 leader_election.cc:304] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:12.108457 17064 raft_consensus.cc:2804] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.109014 17064 raft_consensus.cc:697] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:12.099709 16948 raft_consensus.cc:493] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.110764 16948 raft_consensus.cc:3060] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.111199 17040 tablet_bootstrap.cc:492] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:12.111724 17040 ts_tablet_manager.cc:1403] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 13:05:12.113550 17039 tablet_bootstrap.cc:654] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.114872 17040 raft_consensus.cc:359] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.118764 17040 raft_consensus.cc:385] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.119138 17040 raft_consensus.cc:740] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.119964 17040 consensus_queue.cc:260] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.120792 17064 consensus_queue.cc:237] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.121394 16948 raft_consensus.cc:515] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.122925 17040 ts_tablet_manager.cc:1434] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:12.127259 17040 tablet_bootstrap.cc:492] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:12.127758 16948 leader_election.cc:290] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:12.128408 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:12.129007 16751 raft_consensus.cc:3060] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.128904 16824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.133211 16824 raft_consensus.cc:3060] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.125422 17038 tablet_bootstrap.cc:492] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:12.134568 17038 ts_tablet_manager.cc:1403] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.009s
I20260709 13:05:12.137518 17038 raft_consensus.cc:359] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.138854 17038 raft_consensus.cc:385] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.139317 17038 raft_consensus.cc:740] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.137243 16751 raft_consensus.cc:2468] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:12.140046 17038 consensus_queue.cc:260] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.142197 16866 leader_election.cc:304] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:12.142314 17038 ts_tablet_manager.cc:1434] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:05:12.143644 17038 tablet_bootstrap.cc:492] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99: Bootstrap starting.
I20260709 13:05:12.143564 16948 raft_consensus.cc:2804] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.144907 16948 raft_consensus.cc:697] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:12.145707 16948 consensus_queue.cc:237] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.142587 17040 tablet_bootstrap.cc:654] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.151243 17038 tablet_bootstrap.cc:654] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.164866 16824 raft_consensus.cc:2468] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:12.169464 17039 tablet_bootstrap.cc:492] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:12.170452 17039 ts_tablet_manager.cc:1403] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.013s
I20260709 13:05:12.172925 16649 catalog_manager.cc:5697] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.173446 17039 raft_consensus.cc:359] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.174257 17039 raft_consensus.cc:385] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.174588 17039 raft_consensus.cc:740] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.175454 17039 consensus_queue.cc:260] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.178012 17039 ts_tablet_manager.cc:1434] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:12.179056 17039 tablet_bootstrap.cc:492] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:12.179803 17040 tablet_bootstrap.cc:492] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:12.180464 17040 ts_tablet_manager.cc:1403] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.053s	user 0.003s	sys 0.026s
I20260709 13:05:12.183835 17040 raft_consensus.cc:359] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.184646 17040 raft_consensus.cc:385] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.184964 17040 raft_consensus.cc:740] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.186019 17039 tablet_bootstrap.cc:654] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.185823 17040 consensus_queue.cc:260] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.192013 16647 catalog_manager.cc:5697] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.196626 17038 tablet_bootstrap.cc:492] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99: No bootstrap required, opened a new log
I20260709 13:05:12.197199 17038 ts_tablet_manager.cc:1403] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.020s
I20260709 13:05:12.197594 17040 ts_tablet_manager.cc:1434] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:05:12.197959 17039 tablet_bootstrap.cc:492] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:12.198547 17039 ts_tablet_manager.cc:1403] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:05:12.198702 17040 tablet_bootstrap.cc:492] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:12.199992 17038 raft_consensus.cc:359] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.200788 17038 raft_consensus.cc:385] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.201057 17038 raft_consensus.cc:740] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.201848 17038 consensus_queue.cc:260] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.201907 17039 raft_consensus.cc:359] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.202761 17039 raft_consensus.cc:385] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.203111 17039 raft_consensus.cc:740] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.204002 17039 consensus_queue.cc:260] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.205713 17040 tablet_bootstrap.cc:654] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.206477 17039 ts_tablet_manager.cc:1434] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:12.207443 17039 tablet_bootstrap.cc:492] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132: Bootstrap starting.
I20260709 13:05:12.213943 17064 raft_consensus.cc:493] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.214419 17064 raft_consensus.cc:515] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.217013 17038 ts_tablet_manager.cc:1434] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:12.217692 17039 tablet_bootstrap.cc:654] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.218123 17064 leader_election.cc:290] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:12.218837 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
W20260709 13:05:12.220259 16866 leader_election.cc:343] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.223953 16824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:12.224700 16824 raft_consensus.cc:2468] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:12.226398 16864 leader_election.cc:304] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:12.227882 17064 raft_consensus.cc:2804] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.228291 17064 raft_consensus.cc:493] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.228634 17064 raft_consensus.cc:3060] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.228819 17040 tablet_bootstrap.cc:492] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:12.229286 17040 ts_tablet_manager.cc:1403] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.006s
I20260709 13:05:12.231482 17040 raft_consensus.cc:359] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.231969 17040 raft_consensus.cc:385] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.232182 17040 raft_consensus.cc:740] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.232740 17040 consensus_queue.cc:260] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.234551 17040 ts_tablet_manager.cc:1434] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:12.235878 17040 tablet_bootstrap.cc:492] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5: Bootstrap starting.
I20260709 13:05:12.236424 17064 raft_consensus.cc:515] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.239394 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:12.240329 17039 tablet_bootstrap.cc:492] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132: No bootstrap required, opened a new log
I20260709 13:05:12.240926 17039 ts_tablet_manager.cc:1403] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.006s
I20260709 13:05:12.241743 17040 tablet_bootstrap.cc:654] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:12.243144 16866 leader_election.cc:343] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.245198 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.245808 16825 raft_consensus.cc:3060] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.243731 17039 raft_consensus.cc:359] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.249478 17039 raft_consensus.cc:385] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.249758 17039 raft_consensus.cc:740] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.250517 17039 consensus_queue.cc:260] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.252476 17039 ts_tablet_manager.cc:1434] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:12.254161 16825 raft_consensus.cc:2468] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:12.255230 17064 leader_election.cc:290] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:12.255319 16864 leader_election.cc:304] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:12.256282 16948 raft_consensus.cc:2804] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.256745 16948 raft_consensus.cc:697] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:12.257594 16948 consensus_queue.cc:237] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.259164 17040 tablet_bootstrap.cc:492] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5: No bootstrap required, opened a new log
I20260709 13:05:12.259661 17040 ts_tablet_manager.cc:1403] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.005s
I20260709 13:05:12.262739 17040 raft_consensus.cc:359] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.263818 17040 raft_consensus.cc:385] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.264066 17040 raft_consensus.cc:740] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.264672 17040 consensus_queue.cc:260] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.266790 17040 ts_tablet_manager.cc:1434] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:12.273190 17063 consensus_queue.cc:1048] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.277913 17063 raft_consensus.cc:493] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.278451 17063 raft_consensus.cc:515] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.281224 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c954cd24b4eb0bc63401492b9a1d7" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:12.281870 16751 raft_consensus.cc:2468] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:12.279544 16648 catalog_manager.cc:5697] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.283030 16792 leader_election.cc:304] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.283958 17060 raft_consensus.cc:2804] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.284346 17060 raft_consensus.cc:493] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.284619 17063 leader_election.cc:290] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.285609 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c954cd24b4eb0bc63401492b9a1d7" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:12.284680 17060 raft_consensus.cc:3060] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.286382 16898 raft_consensus.cc:2468] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 0.
I20260709 13:05:12.295554 17063 consensus_queue.cc:1048] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.296739 17060 raft_consensus.cc:515] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.300117 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c954cd24b4eb0bc63401492b9a1d7" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:12.300773 16750 raft_consensus.cc:3060] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.309077 16750 raft_consensus.cc:2468] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:12.310148 16792 leader_election.cc:304] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.311007 17063 raft_consensus.cc:2804] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.311496 17063 raft_consensus.cc:697] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:12.312296 17063 consensus_queue.cc:237] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.323522 17060 leader_election.cc:290] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.324556 16648 catalog_manager.cc:5697] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 1 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.329252 16948 raft_consensus.cc:493] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.330037 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c954cd24b4eb0bc63401492b9a1d7" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.329869 16948 raft_consensus.cc:515] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.332046 16948 leader_election.cc:290] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:12.333573 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b321541825b4339b75b585170ed4595" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:12.334336 16825 raft_consensus.cc:2468] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:12.335340 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b321541825b4339b75b585170ed4595" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5" is_pre_election: true
I20260709 13:05:12.335654 16864 leader_election.cc:304] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:12.336112 16751 raft_consensus.cc:2468] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 0.
I20260709 13:05:12.336570 16948 raft_consensus.cc:2804] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.337158 16948 raft_consensus.cc:493] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.337658 16948 raft_consensus.cc:3060] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.338570 16900 raft_consensus.cc:3060] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.344723 16948 raft_consensus.cc:515] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.345392 16900 raft_consensus.cc:2468] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 1.
I20260709 13:05:12.346992 16948 leader_election.cc:290] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:12.348146 16751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b321541825b4339b75b585170ed4595" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:12.348111 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b321541825b4339b75b585170ed4595" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.348832 16751 raft_consensus.cc:3060] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.348901 16825 raft_consensus.cc:3060] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.355791 16751 raft_consensus.cc:2468] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:12.355803 16825 raft_consensus.cc:2468] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 1.
I20260709 13:05:12.357059 16866 leader_election.cc:304] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:12.358101 16948 raft_consensus.cc:2804] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.358513 16948 raft_consensus.cc:697] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:12.359287 16948 consensus_queue.cc:237] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.366768 16648 catalog_manager.cc:5697] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 1 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.448454 17026 raft_consensus.cc:493] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.448912 17026 raft_consensus.cc:515] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.450738 17026 leader_election.cc:290] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.451483 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:12.451795 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:12.452358 16825 raft_consensus.cc:2393] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293ddb5b6a0648bfa50cab64b88019d5 in current term 1: Already voted for candidate 7c03699471964faf80df9d86840a7132 in this term.
I20260709 13:05:12.452476 17026 raft_consensus.cc:493] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.453356 16715 leader_election.cc:304] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5; no voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132
I20260709 13:05:12.453513 17026 raft_consensus.cc:515] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.454186 17044 raft_consensus.cc:3060] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.455892 17026 leader_election.cc:290] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.456032 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:12.456723 16825 raft_consensus.cc:2468] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 0.
I20260709 13:05:12.456903 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:12.457530 16900 raft_consensus.cc:2468] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 0.
I20260709 13:05:12.457722 16715 leader_election.cc:304] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.458668 17026 raft_consensus.cc:2804] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.459030 17026 raft_consensus.cc:493] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.459340 17026 raft_consensus.cc:3060] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.461822 17044 raft_consensus.cc:2749] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.465128 17026 raft_consensus.cc:515] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.466809 17026 leader_election.cc:290] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.467650 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.467780 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.468389 16900 raft_consensus.cc:3060] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.468362 16825 raft_consensus.cc:3060] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.475499 16825 raft_consensus.cc:2468] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 1.
I20260709 13:05:12.475497 16900 raft_consensus.cc:2468] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 1.
I20260709 13:05:12.476698 16715 leader_election.cc:304] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.477444 17026 raft_consensus.cc:2804] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.477826 17026 raft_consensus.cc:697] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:12.478564 17026 consensus_queue.cc:237] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.485136 16648 catalog_manager.cc:5697] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.543213 16751 raft_consensus.cc:3060] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.548403 16948 consensus_queue.cc:1048] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.558106 17064 consensus_queue.cc:1048] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.593390 17063 consensus_queue.cc:1048] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.603176 17025 consensus_queue.cc:1048] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.616869 17026 raft_consensus.cc:493] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.617456 17026 raft_consensus.cc:515] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.619035 17026 leader_election.cc:290] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.619659 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" is_pre_election: true
I20260709 13:05:12.619874 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132" is_pre_election: true
I20260709 13:05:12.620349 16825 raft_consensus.cc:2468] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 0.
I20260709 13:05:12.620457 16900 raft_consensus.cc:2468] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 0.
I20260709 13:05:12.621398 16715 leader_election.cc:304] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.621994 17026 raft_consensus.cc:2804] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.622303 17026 raft_consensus.cc:493] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.622557 17026 raft_consensus.cc:3060] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.627429 17026 raft_consensus.cc:515] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.628916 17026 leader_election.cc:290] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.629714 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.629810 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.630250 16825 raft_consensus.cc:3060] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.630379 16900 raft_consensus.cc:3060] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.635257 16825 raft_consensus.cc:2468] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 1.
I20260709 13:05:12.635330 16900 raft_consensus.cc:2468] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 1.
I20260709 13:05:12.636304 16715 leader_election.cc:304] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.636945 17026 raft_consensus.cc:2804] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.637395 17026 raft_consensus.cc:697] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:12.638015 17026 consensus_queue.cc:237] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.645174 16649 catalog_manager.cc:5697] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 1 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.674273 16824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
mode: GRACEFUL
new_leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:35398
I20260709 13:05:12.674847 16824 raft_consensus.cc:606] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Received request to transfer leadership to TS 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:12.679517 16900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b321541825b4339b75b585170ed4595"
dest_uuid: "7c03699471964faf80df9d86840a7132"
mode: GRACEFUL
new_leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:52336
I20260709 13:05:12.680125 16900 raft_consensus.cc:606] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Received request to transfer leadership to TS 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:12.684605 16824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "211c954cd24b4eb0bc63401492b9a1d7"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
mode: GRACEFUL
new_leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:35398
I20260709 13:05:12.685081 16824 raft_consensus.cc:606] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Received request to transfer leadership to TS 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:12.688687 17061 raft_consensus.cc:993] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99: : Instructing follower 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:12.689131 17061 raft_consensus.cc:1081] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Signalling peer 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:12.690362 16824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c1988d038f3400c9a89dabb8240e30c"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
mode: GRACEFUL
new_leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:35398
I20260709 13:05:12.690833 16751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:05:12.690984 16824 raft_consensus.cc:606] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Received request to transfer leadership to TS 293ddb5b6a0648bfa50cab64b88019d5
I20260709 13:05:12.692065 16751 raft_consensus.cc:493] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.692416 16751 raft_consensus.cc:3060] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.694160 17064 consensus_queue.cc:1048] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.698382 17061 consensus_queue.cc:1048] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.700083 16751 raft_consensus.cc:515] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.702592 16824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.702864 16751 leader_election.cc:290] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.703936 16898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1"
dest_uuid: "7c03699471964faf80df9d86840a7132"
mode: GRACEFUL
new_leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:52336
I20260709 13:05:12.704493 16898 raft_consensus.cc:606] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Received request to transfer leadership to TS 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:12.710134 16948 consensus_queue.cc:1048] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.710348 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b589e07e404e7ba75beb958bb44635" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.710889 16898 raft_consensus.cc:3060] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.715042 16824 raft_consensus.cc:3055] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:12.715487 16824 raft_consensus.cc:740] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:12.716260 16824 consensus_queue.cc:260] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.717408 16824 raft_consensus.cc:3060] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.720790 17064 consensus_queue.cc:1048] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.725032 16824 raft_consensus.cc:2468] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:12.730340 16715 leader_election.cc:304] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.731186 17026 raft_consensus.cc:2804] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:12.731624 17026 raft_consensus.cc:697] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:12.732393 17026 consensus_queue.cc:237] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.735879 16948 raft_consensus.cc:993] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132: : Instructing follower 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:12.736408 16948 raft_consensus.cc:1081] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Signalling peer 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:12.736626 17060 consensus_queue.cc:1048] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.738412 16825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:35378
I20260709 13:05:12.738997 16825 raft_consensus.cc:493] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.739347 16825 raft_consensus.cc:3060] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.748885 17066 consensus_queue.cc:1048] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.764308 16898 raft_consensus.cc:2468] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:12.770584 16825 raft_consensus.cc:515] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.769086 16648 catalog_manager.cc:5697] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 1 to 2, leader changed from 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2) to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.776364 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:12.776996 16750 raft_consensus.cc:3060] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.777765 16825 leader_election.cc:290] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.779158 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ec41205954a0391b6c3f100b5c8e1" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.779815 16898 raft_consensus.cc:3055] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:12.780437 16898 raft_consensus.cc:740] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:12.781352 16898 consensus_queue.cc:260] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.782506 16898 raft_consensus.cc:3060] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.787333 17060 raft_consensus.cc:993] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99: : Instructing follower 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:12.787889 17060 raft_consensus.cc:1081] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Signalling peer 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:12.789815 16751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "211c954cd24b4eb0bc63401492b9a1d7"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:05:12.790380 16751 raft_consensus.cc:493] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.790724 16751 raft_consensus.cc:3060] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.790922 16749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
mode: GRACEFUL
new_leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:57458
I20260709 13:05:12.791657 16749 raft_consensus.cc:606] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Received request to transfer leadership to TS 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:12.793125 16750 raft_consensus.cc:2468] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:12.794270 16792 leader_election.cc:304] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.795158 17061 raft_consensus.cc:2804] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:12.795620 17061 raft_consensus.cc:697] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:12.796324 17061 consensus_queue.cc:237] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.798061 16900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974"
dest_uuid: "7c03699471964faf80df9d86840a7132"
mode: GRACEFUL
new_leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:52336
I20260709 13:05:12.798748 16900 raft_consensus.cc:606] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Received request to transfer leadership to TS 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:12.799070 16898 raft_consensus.cc:2468] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:12.801646 16751 raft_consensus.cc:515] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.804236 16751 leader_election.cc:290] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.804347 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c954cd24b4eb0bc63401492b9a1d7" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.805186 16750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
mode: GRACEFUL
new_leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:57458
I20260709 13:05:12.805801 16825 raft_consensus.cc:3055] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:12.806178 16825 raft_consensus.cc:740] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:12.806232 16750 raft_consensus.cc:606] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Received request to transfer leadership to TS 4b64c80440f64c5ba87e7cdf0c709c99
I20260709 13:05:12.807499 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c954cd24b4eb0bc63401492b9a1d7" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.808056 16898 raft_consensus.cc:3060] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.809720 16825 consensus_queue.cc:260] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.811007 16825 raft_consensus.cc:3060] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.814597 16898 raft_consensus.cc:2468] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:12.815653 16714 leader_election.cc:304] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:12.816459 17026 raft_consensus.cc:2804] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:12.816910 17026 raft_consensus.cc:697] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:12.817687 17026 consensus_queue.cc:237] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.817721 16647 catalog_manager.cc:5697] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 1 to 2, leader changed from 7c03699471964faf80df9d86840a7132 (127.6.236.3) to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.818719 16825 raft_consensus.cc:2468] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:12.824536 16649 catalog_manager.cc:5697] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 1 to 2, leader changed from 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2) to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.827848 17066 consensus_queue.cc:1048] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.838373 17064 consensus_queue.cc:1048] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.849277 17062 raft_consensus.cc:993] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132: : Instructing follower 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:12.849716 17064 raft_consensus.cc:1081] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Signalling peer 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:12.851127 16750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b321541825b4339b75b585170ed4595"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:51330
I20260709 13:05:12.851679 16750 raft_consensus.cc:493] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.852048 16750 raft_consensus.cc:3060] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.858628 16750 raft_consensus.cc:515] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.860589 16750 leader_election.cc:290] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.861132 16825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b321541825b4339b75b585170ed4595" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:12.861737 16825 raft_consensus.cc:3060] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.862769 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b321541825b4339b75b585170ed4595" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.863370 16898 raft_consensus.cc:3055] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:12.863662 16898 raft_consensus.cc:740] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:12.864341 16898 consensus_queue.cc:260] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.865492 16898 raft_consensus.cc:3060] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.866999 17026 consensus_queue.cc:1048] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.868921 16825 raft_consensus.cc:2468] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:12.870004 16715 leader_election.cc:304] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.870677 17026 raft_consensus.cc:2804] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:12.871168 17026 raft_consensus.cc:697] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:12.871905 16898 raft_consensus.cc:2468] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:12.872092 17026 consensus_queue.cc:237] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.880347 17026 consensus_queue.cc:1048] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.884753 16647 catalog_manager.cc:5697] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 1 to 2, leader changed from 7c03699471964faf80df9d86840a7132 (127.6.236.3) to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.888676 17105 raft_consensus.cc:993] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5: : Instructing follower 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:12.889192 17026 raft_consensus.cc:1081] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Signalling peer 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:12.890761 16825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:12.891294 16825 raft_consensus.cc:493] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.891631 16825 raft_consensus.cc:3060] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.896870 16825 raft_consensus.cc:515] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.898545 16825 leader_election.cc:290] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:12.899313 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:12.899937 16750 raft_consensus.cc:3055] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:12.899883 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0a98657fb44a2bad5e627ec506ac0d" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:12.900432 16750 raft_consensus.cc:740] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:12.900621 16898 raft_consensus.cc:3060] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.901283 16750 consensus_queue.cc:260] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.902585 16750 raft_consensus.cc:3060] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.906553 16898 raft_consensus.cc:2468] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:12.907897 16750 raft_consensus.cc:2468] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:12.909008 16792 leader_election.cc:304] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:12.909667 17061 raft_consensus.cc:2804] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:12.910048 17061 raft_consensus.cc:697] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:12.910826 17061 consensus_queue.cc:237] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:12.916917 16647 catalog_manager.cc:5697] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 1 to 2, leader changed from 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1) to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.017947 17026 consensus_queue.cc:1048] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.024735 17105 raft_consensus.cc:993] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5: : Instructing follower 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:13.025245 17105 raft_consensus.cc:1081] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Signalling peer 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:13.026981 16826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:35384
I20260709 13:05:13.028599 16826 raft_consensus.cc:493] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.028967 16826 raft_consensus.cc:3060] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.033362 17105 consensus_queue.cc:1048] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.036432 16826 raft_consensus.cc:515] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.040184 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:13.040840 16750 raft_consensus.cc:3055] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.041180 16750 raft_consensus.cc:740] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:13.041442 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49ab3b940484918b80515e5f3b06637" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:13.041935 16750 consensus_queue.cc:260] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.042934 16750 raft_consensus.cc:3060] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.040359 16826 leader_election.cc:290] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:13.049645 16750 raft_consensus.cc:2468] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:13.050779 16792 leader_election.cc:304] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 7c03699471964faf80df9d86840a7132
I20260709 13:05:13.051489 17061 raft_consensus.cc:2804] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.051927 17061 raft_consensus.cc:697] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:13.052645 17061 consensus_queue.cc:237] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.058971 16649 catalog_manager.cc:5697] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 1 to 2, leader changed from 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1) to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.155315 17060 raft_consensus.cc:993] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99: : Instructing follower 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:13.155800 17061 raft_consensus.cc:1081] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Signalling peer 293ddb5b6a0648bfa50cab64b88019d5 to start an election
I20260709 13:05:13.157392 16750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c1988d038f3400c9a89dabb8240e30c"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:05:13.157858 16750 raft_consensus.cc:493] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.158152 16750 raft_consensus.cc:3060] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.161070 16898 raft_consensus.cc:1275] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.162276 17105 consensus_queue.cc:1048] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.163937 16750 raft_consensus.cc:515] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.166627 16750 leader_election.cc:290] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Requested vote from peers 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:13.170234 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1988d038f3400c9a89dabb8240e30c" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:13.170912 16898 raft_consensus.cc:3060] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.172374 16826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1988d038f3400c9a89dabb8240e30c" candidate_uuid: "293ddb5b6a0648bfa50cab64b88019d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:13.173004 16826 raft_consensus.cc:3055] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.173061 16825 raft_consensus.cc:1275] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.173384 16826 raft_consensus.cc:740] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:13.174201 16826 consensus_queue.cc:260] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.175988 17105 consensus_queue.cc:1048] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.177582 16898 raft_consensus.cc:2468] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:13.175467 16826 raft_consensus.cc:3060] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.179824 16714 leader_election.cc:304] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:13.180835 17044 raft_consensus.cc:2804] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.181290 17044 raft_consensus.cc:697] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Becoming Leader. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:13.181440 17064 raft_consensus.cc:993] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132: : Instructing follower 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:13.181957 17064 raft_consensus.cc:1081] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Signalling peer 4b64c80440f64c5ba87e7cdf0c709c99 to start an election
I20260709 13:05:13.182786 17044 consensus_queue.cc:237] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.187830 16825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
 from {username='slave'} at 127.0.0.1:35378
I20260709 13:05:13.188529 16825 raft_consensus.cc:493] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.188912 16825 raft_consensus.cc:3060] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.193102 16826 raft_consensus.cc:2468] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293ddb5b6a0648bfa50cab64b88019d5 in term 2.
I20260709 13:05:13.199265 16898 raft_consensus.cc:1275] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.199395 16825 raft_consensus.cc:515] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.200769 17044 consensus_queue.cc:1048] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.201749 16825 leader_election.cc:290] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 7c03699471964faf80df9d86840a7132 (127.6.236.3:33367)
I20260709 13:05:13.201889 16649 catalog_manager.cc:5697] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 reported cstate change: term changed from 1 to 2, leader changed from 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2) to 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1). New cstate: current_term: 2 leader_uuid: "293ddb5b6a0648bfa50cab64b88019d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.203004 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:13.203594 16750 raft_consensus.cc:3060] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.208030 16900 raft_consensus.cc:1275] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.212464 16750 raft_consensus.cc:2468] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:13.214191 16826 raft_consensus.cc:1275] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.215381 16898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdf252f573e4408ac0145b7b9591974" candidate_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c03699471964faf80df9d86840a7132"
I20260709 13:05:13.215765 16792 leader_election.cc:304] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293ddb5b6a0648bfa50cab64b88019d5, 4b64c80440f64c5ba87e7cdf0c709c99; no voters: 
I20260709 13:05:13.216042 16898 raft_consensus.cc:3055] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.216451 16898 raft_consensus.cc:740] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:13.216807 17060 raft_consensus.cc:2804] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.217365 17060 raft_consensus.cc:697] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Becoming Leader. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:13.218343 17061 consensus_queue.cc:1048] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.218216 17060 consensus_queue.cc:237] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.217382 16898 consensus_queue.cc:260] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:13.220566 17044 consensus_queue.cc:1048] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.221097 16898 raft_consensus.cc:3060] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.228492 16898 raft_consensus.cc:2468] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b64c80440f64c5ba87e7cdf0c709c99 in term 2.
I20260709 13:05:13.229496 16648 catalog_manager.cc:5697] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 reported cstate change: term changed from 1 to 2, leader changed from 7c03699471964faf80df9d86840a7132 (127.6.236.3) to 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2). New cstate: current_term: 2 leader_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.237241 16750 raft_consensus.cc:1275] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.238883 17025 consensus_queue.cc:1048] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.273249 16826 raft_consensus.cc:1275] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.274451 17044 consensus_queue.cc:1048] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.284410 16899 raft_consensus.cc:1275] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.286002 17109 consensus_queue.cc:1048] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.331744 16750 raft_consensus.cc:1275] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.332909 17025 consensus_queue.cc:1048] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.339872 16899 raft_consensus.cc:1275] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.341460 17061 consensus_queue.cc:1048] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.620354 16899 raft_consensus.cc:3060] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.626134 16899 raft_consensus.cc:1275] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.627421 17061 consensus_queue.cc:1048] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.637271 16750 raft_consensus.cc:1275] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.638546 17025 consensus_queue.cc:1048] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.701848 16750 raft_consensus.cc:1275] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.703004 17025 consensus_queue.cc:1048] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.705101 16899 raft_consensus.cc:1275] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 4b64c80440f64c5ba87e7cdf0c709c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.707824 17060 consensus_queue.cc:1048] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.762174 16899 raft_consensus.cc:1275] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.763200 17109 consensus_queue.cc:1048] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.771340 16825 raft_consensus.cc:1275] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 293ddb5b6a0648bfa50cab64b88019d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.773041 17044 consensus_queue.cc:1048] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:15.813612 16648 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42790:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:15.832396 16648 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42790:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:15.853343  7088 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:15.938879 17148 tablet.cc:1724] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:15.972090 16777 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:6e3ec41205954a0391b6c3f100b5c8e1)
W20260709 13:05:15.977092 16777 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:6e3ec41205954a0391b6c3f100b5c8e1)
W20260709 13:05:15.977880 16777 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:6e3ec41205954a0391b6c3f100b5c8e1)
I20260709 13:05:16.005582 17152 tablet.cc:1724] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:15.993131 17147 tablet.cc:1724] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.071719 17152 tablet.cc:1724] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.076710 17156 tablet.cc:1724] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.137969 17162 tablet.cc:1724] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.140264 17158 tablet.cc:1724] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.146513 16750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0"
dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
mode: GRACEFUL
new_leader_uuid: "7c03699471964faf80df9d86840a7132"
 from {username='slave'} at 127.0.0.1:57460
I20260709 13:05:16.147240 16750 raft_consensus.cc:606] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Received request to transfer leadership to TS 7c03699471964faf80df9d86840a7132
W20260709 13:05:16.077406 16792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.236.1:38269, user_credentials={real_user=slave}} blocked reactor thread for 64639.6us
I20260709 13:05:16.158361 17148 tablet.cc:1724] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.153839 17147 tablet.cc:1724] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.197621 17152 tablet.cc:1724] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.207077 17156 tablet.cc:1724] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.202948 17147 tablet.cc:1724] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.257519 17158 tablet.cc:1724] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.288079 17169 tablet.cc:1724] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.291505 17176 tablet.cc:1724] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.295315 17147 tablet.cc:1724] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.313089 17176 tablet.cc:1724] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.305563 17156 tablet.cc:1724] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.331265 17162 tablet.cc:1724] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.356833 16823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e"
dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
mode: GRACEFUL
new_leader_uuid: "7c03699471964faf80df9d86840a7132"
 from {username='slave'} at 127.0.0.1:39048
I20260709 13:05:16.357702 16823 raft_consensus.cc:606] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Received request to transfer leadership to TS 7c03699471964faf80df9d86840a7132
I20260709 13:05:16.359215  7088 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:16.359855  7088 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:16.374717 17115 raft_consensus.cc:993] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99: : Instructing follower 7c03699471964faf80df9d86840a7132 to start an election
I20260709 13:05:16.375515 17110 raft_consensus.cc:1081] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Signalling peer 7c03699471964faf80df9d86840a7132 to start an election
I20260709 13:05:16.378419 17156 tablet.cc:1724] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.381485 16898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e"
dest_uuid: "7c03699471964faf80df9d86840a7132"
 from {username='slave'} at 127.0.0.1:52334
I20260709 13:05:16.382193 16898 raft_consensus.cc:493] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.382561 16898 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.400559 17181 tablet.cc:1724] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.416298 16898 raft_consensus.cc:515] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:16.411904 17176 tablet.cc:1724] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.420380 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:16.421418 16750 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.421936 16898 leader_election.cc:290] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 3 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:16.424986 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95d1e3b4f45486bbf236c5cf7ae8c0e" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:16.425509 16823 raft_consensus.cc:3055] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:16.425798 16823 raft_consensus.cc:740] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b64c80440f64c5ba87e7cdf0c709c99, State: Running, Role: LEADER
I20260709 13:05:16.426654 16823 consensus_queue.cc:260] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:16.427723 16823 raft_consensus.cc:3060] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.406720 17182 tablet.cc:1724] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.432525 17171 raft_consensus.cc:993] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5: : Instructing follower 7c03699471964faf80df9d86840a7132 to start an election
I20260709 13:05:16.433032 17171 raft_consensus.cc:1081] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Signalling peer 7c03699471964faf80df9d86840a7132 to start an election
I20260709 13:05:16.432282 17181 tablet.cc:1724] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.435274 16823 raft_consensus.cc:2468] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 3.
I20260709 13:05:16.435809 16898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0"
dest_uuid: "7c03699471964faf80df9d86840a7132"
 from {username='slave'} at 127.0.0.1:52320
I20260709 13:05:16.436494 16864 leader_election.cc:304] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:16.436691 16898 raft_consensus.cc:493] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.437345 17062 raft_consensus.cc:2804] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:16.437526 16898 raft_consensus.cc:3060] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.437894 17062 raft_consensus.cc:697] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 3 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:16.438810 17062 consensus_queue.cc:237] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:16.443228 16750 raft_consensus.cc:2468] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 3.
I20260709 13:05:16.418744 17183 tablet.cc:1724] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.446120 16898 raft_consensus.cc:515] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:16.449468 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293ddb5b6a0648bfa50cab64b88019d5"
I20260709 13:05:16.450279 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4ecce4d294cd5902214e71710c5a0" candidate_uuid: "7c03699471964faf80df9d86840a7132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b64c80440f64c5ba87e7cdf0c709c99"
I20260709 13:05:16.450846 16823 raft_consensus.cc:3060] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.450538 16750 raft_consensus.cc:3055] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:16.452203 16750 raft_consensus.cc:740] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293ddb5b6a0648bfa50cab64b88019d5, State: Running, Role: LEADER
I20260709 13:05:16.452947 16750 consensus_queue.cc:260] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:16.453976 16750 raft_consensus.cc:3060] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.449712 16898 leader_election.cc:290] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 2 election: Requested vote from peers 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269), 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053)
I20260709 13:05:16.460184 16823 raft_consensus.cc:2468] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 2.
I20260709 13:05:16.461480 16864 leader_election.cc:304] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b64c80440f64c5ba87e7cdf0c709c99, 7c03699471964faf80df9d86840a7132; no voters: 
I20260709 13:05:16.462378 17062 raft_consensus.cc:2804] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:16.462805 17062 raft_consensus.cc:697] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 2 LEADER]: Becoming Leader. State: Replica: 7c03699471964faf80df9d86840a7132, State: Running, Role: LEADER
I20260709 13:05:16.463511 17062 consensus_queue.cc:237] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } }
I20260709 13:05:16.467693 16750 raft_consensus.cc:2468] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c03699471964faf80df9d86840a7132 in term 2.
I20260709 13:05:16.470181 17182 tablet.cc:1724] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.473455 17176 tablet.cc:1724] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.474761 16646 catalog_manager.cc:6242] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705: soft_deleted_table [id=df55889776864e26850027728c10ff3f] alter complete (version 1)
I20260709 13:05:16.488088 16649 catalog_manager.cc:5697] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 2 to 3, leader changed from 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2) to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 3 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.489606 16649 catalog_manager.cc:5697] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 reported cstate change: term changed from 1 to 2, leader changed from 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1) to 7c03699471964faf80df9d86840a7132 (127.6.236.3). New cstate: current_term: 2 leader_uuid: "7c03699471964faf80df9d86840a7132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c03699471964faf80df9d86840a7132" member_type: VOTER last_known_addr { host: "127.6.236.3" port: 33367 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.859117 16823 raft_consensus.cc:1275] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Refusing update from remote peer 7c03699471964faf80df9d86840a7132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.860369 17062 consensus_queue.cc:1048] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:16.870841 16750 raft_consensus.cc:1275] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Refusing update from remote peer 7c03699471964faf80df9d86840a7132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.872545 17062 consensus_queue.cc:1048] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.001176 16751 raft_consensus.cc:1275] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 3 FOLLOWER]: Refusing update from remote peer 7c03699471964faf80df9d86840a7132: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.002305 17062 consensus_queue.cc:1048] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293ddb5b6a0648bfa50cab64b88019d5" member_type: VOTER last_known_addr { host: "127.6.236.1" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.011154 16823 raft_consensus.cc:1275] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 3 FOLLOWER]: Refusing update from remote peer 7c03699471964faf80df9d86840a7132: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.012692 17062 consensus_queue.cc:1048] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b64c80440f64c5ba87e7cdf0c709c99" member_type: VOTER last_known_addr { host: "127.6.236.2" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.414716  7088 tablet_server.cc:179] TabletServer@127.6.236.1:0 shutting down...
I20260709 13:05:17.437680  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:17.438558  7088 tablet_replica.cc:333] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.439360  7088 raft_consensus.cc:2243] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.439949  7088 raft_consensus.cc:2272] T dfdf252f573e4408ac0145b7b9591974 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.442459  7088 tablet_replica.cc:333] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.443219  7088 raft_consensus.cc:2243] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.443765  7088 raft_consensus.cc:2272] T f49ab3b940484918b80515e5f3b06637 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.445478  7088 tablet_replica.cc:333] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.445961  7088 raft_consensus.cc:2243] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.446390  7088 raft_consensus.cc:2272] T 44ed8de1c7044a78b0eef133407369f9 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.448038  7088 tablet_replica.cc:333] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.448525  7088 raft_consensus.cc:2243] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.448889  7088 raft_consensus.cc:2272] T 0b0a98657fb44a2bad5e627ec506ac0d P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.450660  7088 tablet_replica.cc:333] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.451171  7088 raft_consensus.cc:2243] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.451853  7088 raft_consensus.cc:2272] T f0b589e07e404e7ba75beb958bb44635 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.453502  7088 tablet_replica.cc:333] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.453998  7088 raft_consensus.cc:2243] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.454437  7088 raft_consensus.cc:2272] T 6e3ec41205954a0391b6c3f100b5c8e1 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.456112  7088 tablet_replica.cc:333] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.456689  7088 raft_consensus.cc:2243] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.457090  7088 raft_consensus.cc:2272] T 4f8e616be17347a99d684ae602eac78f P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.459060  7088 tablet_replica.cc:333] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.459563  7088 raft_consensus.cc:2243] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.460017  7088 raft_consensus.cc:2272] T 141813c83c074f688219ba864c9c0439 P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.462229  7088 tablet_replica.cc:333] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.462904  7088 raft_consensus.cc:2243] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.463449  7088 raft_consensus.cc:2272] T 117c7f089e1842799cd6b94b41f91e3c P 293ddb5b6a0648bfa50cab64b88019d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.465809  7088 tablet_replica.cc:333] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.466379  7088 raft_consensus.cc:2243] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.466794  7088 raft_consensus.cc:2272] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 293ddb5b6a0648bfa50cab64b88019d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.469415  7088 tablet_replica.cc:333] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.469964  7088 raft_consensus.cc:2243] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.470930  7088 raft_consensus.cc:2272] T 0c1988d038f3400c9a89dabb8240e30c P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.473003  7088 tablet_replica.cc:333] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.473559  7088 raft_consensus.cc:2243] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.474318  7088 raft_consensus.cc:2272] T 28fe1cafc89044f1ab57ed9abb53e490 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.476327  7088 tablet_replica.cc:333] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.476848  7088 raft_consensus.cc:2243] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.477553  7088 raft_consensus.cc:2272] T 4b321541825b4339b75b585170ed4595 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.479310  7088 tablet_replica.cc:333] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.479785  7088 raft_consensus.cc:2243] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.480155  7088 raft_consensus.cc:2272] T ceb4ecce4d294cd5902214e71710c5a0 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.482748  7088 tablet_replica.cc:333] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.483265  7088 raft_consensus.cc:2243] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.483980  7088 raft_consensus.cc:2272] T 242da6e6a5ea456e8e2790815657fc58 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.486251  7088 tablet_replica.cc:333] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.486753  7088 raft_consensus.cc:2243] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.487464  7088 raft_consensus.cc:2272] T 1725bcd67ff544409a19572a6640a334 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.489545  7088 tablet_replica.cc:333] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.489986  7088 raft_consensus.cc:2243] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.490767  7088 raft_consensus.cc:2272] T 211c954cd24b4eb0bc63401492b9a1d7 P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.492669  7088 tablet_replica.cc:333] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5: stopping tablet replica
I20260709 13:05:17.493113  7088 raft_consensus.cc:2243] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.493494  7088 raft_consensus.cc:2272] T 2eeca49bddce495faa60a662116ca5df P 293ddb5b6a0648bfa50cab64b88019d5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:17.531636 16866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38269: connect: Connection refused (error 111) [suppressed 26 similar messages]
I20260709 13:05:17.533456  7088 tablet_server.cc:196] TabletServer@127.6.236.1:0 shutdown complete.
W20260709 13:05:17.534876 16866 consensus_peers.cc:597] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 -> Peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Couldn't send request to peer 293ddb5b6a0648bfa50cab64b88019d5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.562541  7088 tablet_server.cc:179] TabletServer@127.6.236.2:0 shutting down...
W20260709 13:05:17.585988 16792 consensus_peers.cc:597] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 -> Peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Couldn't send request to peer 293ddb5b6a0648bfa50cab64b88019d5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.588608  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:17.589401  7088 tablet_replica.cc:333] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.590008  7088 raft_consensus.cc:2243] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.590932  7088 raft_consensus.cc:2272] T f49ab3b940484918b80515e5f3b06637 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.592783  7088 tablet_replica.cc:333] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.593315  7088 raft_consensus.cc:2243] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.594023  7088 raft_consensus.cc:2272] T 6e3ec41205954a0391b6c3f100b5c8e1 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.595837  7088 tablet_replica.cc:333] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.596346  7088 raft_consensus.cc:2243] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.596745  7088 raft_consensus.cc:2272] T 44ed8de1c7044a78b0eef133407369f9 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.598722  7088 tablet_replica.cc:333] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.599289  7088 raft_consensus.cc:2243] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.600229  7088 raft_consensus.cc:2272] T dfdf252f573e4408ac0145b7b9591974 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:17.602396 16792 consensus_peers.cc:597] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 -> Peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Couldn't send request to peer 293ddb5b6a0648bfa50cab64b88019d5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.602514  7088 tablet_replica.cc:333] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.603204  7088 raft_consensus.cc:2243] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.603979  7088 raft_consensus.cc:2272] T 4f8e616be17347a99d684ae602eac78f P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.605975  7088 tablet_replica.cc:333] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.606612  7088 raft_consensus.cc:2243] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.607333  7088 raft_consensus.cc:2272] T 0b0a98657fb44a2bad5e627ec506ac0d P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.609110  7088 tablet_replica.cc:333] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.609644  7088 raft_consensus.cc:2243] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.610014  7088 raft_consensus.cc:2272] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 4b64c80440f64c5ba87e7cdf0c709c99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.612692  7088 tablet_replica.cc:333] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.613193  7088 raft_consensus.cc:2243] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.613912  7088 raft_consensus.cc:2272] T 117c7f089e1842799cd6b94b41f91e3c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.615887  7088 tablet_replica.cc:333] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.616384  7088 raft_consensus.cc:2243] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.617118  7088 raft_consensus.cc:2272] T 141813c83c074f688219ba864c9c0439 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.619127  7088 tablet_replica.cc:333] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.619678  7088 raft_consensus.cc:2243] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.620090  7088 raft_consensus.cc:2272] T 242da6e6a5ea456e8e2790815657fc58 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.622243  7088 tablet_replica.cc:333] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.622789  7088 raft_consensus.cc:2243] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.623279  7088 raft_consensus.cc:2272] T ceb4ecce4d294cd5902214e71710c5a0 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.625667  7088 tablet_replica.cc:333] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.626271  7088 raft_consensus.cc:2243] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.626735  7088 raft_consensus.cc:2272] T f0b589e07e404e7ba75beb958bb44635 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.628585  7088 tablet_replica.cc:333] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.629068  7088 raft_consensus.cc:2243] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.629447  7088 raft_consensus.cc:2272] T 211c954cd24b4eb0bc63401492b9a1d7 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.631136  7088 tablet_replica.cc:333] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.631565  7088 raft_consensus.cc:2243] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.631937  7088 raft_consensus.cc:2272] T 2eeca49bddce495faa60a662116ca5df P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.633706  7088 tablet_replica.cc:333] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.634181  7088 raft_consensus.cc:2243] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.634546  7088 raft_consensus.cc:2272] T 4b321541825b4339b75b585170ed4595 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.636114  7088 tablet_replica.cc:333] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.636533  7088 raft_consensus.cc:2243] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.636878  7088 raft_consensus.cc:2272] T 0c1988d038f3400c9a89dabb8240e30c P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.638533  7088 tablet_replica.cc:333] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.638975  7088 raft_consensus.cc:2243] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.639376  7088 raft_consensus.cc:2272] T 28fe1cafc89044f1ab57ed9abb53e490 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.641268  7088 tablet_replica.cc:333] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99: stopping tablet replica
I20260709 13:05:17.641736  7088 raft_consensus.cc:2243] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.642278  7088 raft_consensus.cc:2272] T 1725bcd67ff544409a19572a6640a334 P 4b64c80440f64c5ba87e7cdf0c709c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.678637  7088 tablet_server.cc:196] TabletServer@127.6.236.2:0 shutdown complete.
W20260709 13:05:17.680907 16864 consensus_peers.cc:597] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 -> Peer 4b64c80440f64c5ba87e7cdf0c709c99 (127.6.236.2:37053): Couldn't send request to peer 4b64c80440f64c5ba87e7cdf0c709c99. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.2:37053: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.708838  7088 tablet_server.cc:179] TabletServer@127.6.236.3:0 shutting down...
I20260709 13:05:17.731453  7088 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:17.732146  7088 tablet_replica.cc:333] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.732758  7088 raft_consensus.cc:2243] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.733217  7088 raft_consensus.cc:2272] T 0b0a98657fb44a2bad5e627ec506ac0d P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.735117  7088 tablet_replica.cc:333] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.735648  7088 raft_consensus.cc:2243] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.736057  7088 raft_consensus.cc:2272] T dfdf252f573e4408ac0145b7b9591974 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.737774  7088 tablet_replica.cc:333] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.738349  7088 raft_consensus.cc:2243] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.738755  7088 raft_consensus.cc:2272] T 6e3ec41205954a0391b6c3f100b5c8e1 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.740443  7088 tablet_replica.cc:333] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.740948  7088 raft_consensus.cc:2243] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.741333  7088 raft_consensus.cc:2272] T f49ab3b940484918b80515e5f3b06637 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.743105  7088 tablet_replica.cc:333] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.743616  7088 raft_consensus.cc:2243] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.744330  7088 raft_consensus.cc:2272] T 44ed8de1c7044a78b0eef133407369f9 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.746022  7088 tablet_replica.cc:333] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.746618  7088 raft_consensus.cc:2243] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.747283  7088 raft_consensus.cc:2272] T f95d1e3b4f45486bbf236c5cf7ae8c0e P 7c03699471964faf80df9d86840a7132 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.749616  7088 tablet_replica.cc:333] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.750170  7088 raft_consensus.cc:2243] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.750578  7088 raft_consensus.cc:2272] T 4b321541825b4339b75b585170ed4595 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.752219  7088 tablet_replica.cc:333] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.752698  7088 raft_consensus.cc:2243] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.753118  7088 raft_consensus.cc:2272] T 28fe1cafc89044f1ab57ed9abb53e490 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.755071  7088 tablet_replica.cc:333] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.755581  7088 raft_consensus.cc:2243] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.755970  7088 raft_consensus.cc:2272] T 0c1988d038f3400c9a89dabb8240e30c P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.757812  7088 tablet_replica.cc:333] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.758517  7088 raft_consensus.cc:2243] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.759016  7088 raft_consensus.cc:2272] T 4f8e616be17347a99d684ae602eac78f P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.761304  7088 tablet_replica.cc:333] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.761787  7088 raft_consensus.cc:2243] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.762220  7088 raft_consensus.cc:2272] T 1725bcd67ff544409a19572a6640a334 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.764065  7088 tablet_replica.cc:333] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.764547  7088 raft_consensus.cc:2243] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.765029  7088 raft_consensus.cc:2272] T 117c7f089e1842799cd6b94b41f91e3c P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.767748  7088 tablet_replica.cc:333] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.768350  7088 raft_consensus.cc:2243] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.768883  7088 raft_consensus.cc:2272] T 141813c83c074f688219ba864c9c0439 P 7c03699471964faf80df9d86840a7132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:17.769531 16866 consensus_peers.cc:597] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 -> Peer 293ddb5b6a0648bfa50cab64b88019d5 (127.6.236.1:38269): Couldn't send request to peer 293ddb5b6a0648bfa50cab64b88019d5. Status: Network error: Client connection negotiation failed: client connection to 127.6.236.1:38269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.771026  7088 tablet_replica.cc:333] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.771593  7088 raft_consensus.cc:2243] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.772009  7088 raft_consensus.cc:2272] T f0b589e07e404e7ba75beb958bb44635 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.773699  7088 tablet_replica.cc:333] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.774216  7088 raft_consensus.cc:2243] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.774607  7088 raft_consensus.cc:2272] T 211c954cd24b4eb0bc63401492b9a1d7 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.776283  7088 tablet_replica.cc:333] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.776780  7088 raft_consensus.cc:2243] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.777527  7088 raft_consensus.cc:2272] T 2eeca49bddce495faa60a662116ca5df P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.779908  7088 tablet_replica.cc:333] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.780421  7088 raft_consensus.cc:2243] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.780809  7088 raft_consensus.cc:2272] T 242da6e6a5ea456e8e2790815657fc58 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.782840  7088 tablet_replica.cc:333] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132: stopping tablet replica
I20260709 13:05:17.783270  7088 raft_consensus.cc:2243] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.783943  7088 raft_consensus.cc:2272] T ceb4ecce4d294cd5902214e71710c5a0 P 7c03699471964faf80df9d86840a7132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.812090  7088 tablet_server.cc:196] TabletServer@127.6.236.3:0 shutdown complete.
I20260709 13:05:17.840677  7088 master.cc:562] Master@127.6.236.62:43531 shutting down...
I20260709 13:05:17.861703  7088 raft_consensus.cc:2243] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.862376  7088 raft_consensus.cc:2272] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.862687  7088 tablet_replica.cc:333] T 00000000000000000000000000000000 P eb1bee315c244c5487f90e4c6b48b705: stopping tablet replica
I20260709 13:05:17.881685  7088 master.cc:584] Master@127.6.236.62:43531 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11162 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26841 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (284470 ms total)
[  PASSED  ] 8 tests.
I20260709 13:05:17.931413  7088 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 143 messages since previous log ~1 seconds ago
I20260709 13:05:17.931664  7088 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 143 messages since previous log ~1 seconds ago
I20260709 13:05:17.931845  7088 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 137 messages since previous log ~1 seconds ago
I20260709 13:05:17.932062  7088 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:05:17.932235  7088 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:05:17.932420  7088 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 9 messages since previous log ~173 seconds ago
I20260709 13:05:17.932677  7088 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 4 messages since previous log ~0 seconds ago
I20260709 13:05:17.932960  7088 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
